image-augmenter 0.5.5

A tiny python library to augment the images dataset aimed for a ML classification system

Table of Contents

• Scope
• Setup
  • Versions
  • Virtualenv
  • Installation
  • Tests
• APIs
  • Labeller
  • Normalizer
  • Augmenter
  • Persister
  • Zipper

Scope

The scope of this library is to augment the dataset for an image classification ML system.

Setup

Versions

The library is compatible with python 3.6 on.

Virtualenv

We suggest to isolate your installation via python virtualenv:

python3 -m venv .imgaug
...
source .imgaug/bin/activate

Installation

Update pip package manager:

pip install pip --upgrade
...
pip install -r requirements.txt

Tests

The library is covered, by fast, isolated unit and doc testing (the latter to grant reliable documentation):

python -m unittest discover -s imgaug -p '*'

APIs

The library is composed by different collaborators, each with its specific responsibility. Each class tries to expose a minimal public APIs in the form of __call__ or __iter__ methods (when generators are used).
The classes are aimed to work with one image at time, in case you need to transform and augment multiple images, avoid creating multiple instances of the classes, just change the argument of the __call__ function (but for Persister, which need a new instance and/or instance attribute modification).

Labeller

The target label is extracted directly by inspecting the image name and trying to extract meaningful information (customisable).

lbl = Labeller(digits=10)

lbl('resources/bag.png')
'bag'

lbl('resources/109-602-3906-001-c-suit-veletta-albino.jpg')
'1096023906'

Normalizer

The images are normalized by:

• resizing them to the specified max size (default to 256 pixels)
• optionally applying a squared, transparent/backgound canvas and centering the image on it, thus avoiding any deformation

norm = Normalizer(size=128, canvas=True)
img = norm('resources/bag.png')
img.shape
(128, 128, 4)

Augmenter

The number of images is augmented by two orders of magnitude (depending on the cutoff float attribute) by applying different transformations to the original one.
Transformations are applied by using generators, thus saving memory consumption.

aug = Augmenter(cutoff=.5)
aug('resources/bag.png')
<generator object Augmenter.__call__ at 0x125354480>

Persister

Images are persisted upon normalization and augmentation, by specifying an action function that accepts the name of the file (original basename suffixed by an index) and a BytesIO object containing the image data stream.
The persister supports both a filename path and, optionally, a stream-like object (in case the file is not yet persisted to disk).
The persister supports iteration by yielding the image label and the function return value (typically the saved path), allowing to generate CSV files specific to cloud platforms (i.e. Google Vision APIs).

def persist(name, stream):
    filename = f'temp/{name}'
    with open(filename, 'wb') as f:
        f.write(stream.getvalue())
    return filename

pers = Persister('resources/skirt.jpg', action=perist)
for label, filename in pers:
    print(label, filename)

Zipper

In case you need an archive with each normalised augmentations within the recognised label subfolder, you can rely on the Zipper interface: it creates a ZIP file on current path, by scanning the specified folder for PNG or JPG images.

zipper = Zipper('.resources/', normalizer=image.Normalizer(16), augmenter=image.Augmenter(.05))
zipper()