manini 0.0.4

An user-friendly plugin that enables to annotate images from a pre-trained model (segmentation, classification, detection) given by an user.

manini

An user-friendly plugin that enables to annotate images from pre-trained model (segmentation, classification, detection)

---

The Manini plugin for napari a tool to perform image inference from a pre-trained model (tensorflow .h5) and then annotate the resulting images with the tools provided by napari. Its development is ongoing.

---

This napari plugin was generated with Cookiecutter using @napari's cookiecutter-napari-plugin template.

Installation

You can install manini via pip:

pip install manini

To install latest development version :

pip install git+https://github.com/hereariim/manini.git

Description

This plugin is a tool to perform 2D image inference. The inference is open to the model for image segmentation (binary or multiclass), image classification and object detection. This tool is compatible with tensorflow h5 models. In this format, the h5 file must contain all the elements of the model (architecture, weights, etc).

Image segmentation

This tool allows image inference from a segmentation model.

Input

The user must deposit two items (+1 optional item).

• A compressed file (.zip) containing the images in RGB

.
└── input.zip
    ├── im_1.JPG
    ├── im_2.JPG 
    ├── im_3.JPG
    ...
    └── im_n.JPG

• A tensorflow h5 file (.h5) which is the segmentation model
• A text file (.txt) containing the names of the classes (optional)

The Ok button is used to validate the imported elements. The Run button is used to launch the segmentation.

Processing

Once the image inference is complete, the plugin returns a drop-down menu showing a list of RGB images contained in the compressed file. When the user clicks on an image displayed in this list, two items appear in the napari window:

• A layer label which is the segmentation mask
• A layer image which is the RGB image

A widget also appears to the right of the window. This is a list of the classes in the model with their associated colours. In this tool, the number of classes is limited to 255.

The user can make annotations on the layer label. For example, the user can correct mispredicted pixels by annotating them with a brush or an eraser.

Output

The Save button allows you to obtain a compressed image file. This file contains folders containing the RGB images and their greyscale mask.

Image classification

This tool performs image inference from an image classification model.

Input

This tool offers three mandatory inputs:

• A compressed file (.zip) containing the RGB images

.
└── input.zip
    ├── im_1.JPG
    ├── im_2.JPG 
    ├── im_3.JPG
    ...
    └── im_n.JPG

• A tensorflow h5 (.h5) file which is the image classification model
• A text file (.txt) containing the class names

The Ok button is used to validate the imported elements. The Run button is used to launch the classification.

Processing

Once the image inference is complete, the plugin returns two elements :

• a drop-down menu showing a list of RGB images contained in the compressed file.
• an table containing the predicted class for each image.

The user can change the predicted class by selecting a class displayed in the associated drop-down menu for an image.

Output

The Save button allows you to obtain a csv file. This file is the table on which the user had made his modifications.

Detection

This tool performs image inference from an yolo object detection model. The inference is made from [darknet] command

Input

This tool offers five mandatory inputs:

• A folder which is the darknet repository images
• A file (.data) containing the paths (train,validation,test,class) and the number of class
• A file (.cfg) containing the model architecture
• A file (.weight) containing the weights associated to the model (.cfg) cited just above
• A file (.txt) that indicates the path of the images

The Ok button is used to validate the imported elements. The Run button is used to launch the command ./darknet detector test .

Processing

When the prediction of bounding box coordinates is complete for each image, the plugin returns two elements:

• A menu that presents a list of the RGB images given as input.
• A menu that presents a list of the classes given as input

The window displays the bounding boxes and the RGB image. The bounding box coordinates are taken from the json file which is an output file of the darknet detector test command. The user can update these coordinates by deleting or adding one or more bounding boxes. From the list of classes, the user can quickly add a bounding box to the image.

Output

The Save button allows you to obtain a json file. This file contains for each image, the bounding box coordinates and the class for each detected object.

License

Distributed under the terms of the BSD-3 license, "manini" is free and open source software

Issues

If you encounter any problems, please file an issue along with a detailed description.