A plugin for segmentation by pixel classification using convolutional feature extraction
Project description
This napari plugin can be used to segment objects or structures in images based on a few brush strokes providing examples of the classes. Based on the same idea as other tools like ilastik, its main strength is that it can use features from pretrained neural networks like VGG16 or DINOV2, enabling the segmentation of more complex images.
Find more information and tutorials in the docs or read the preprint.
Installation
You can install napari-convpaint
via pip
pip install napari-convpaint
To install latest development version :
pip install git+https://github.com/guiwitz/napari-convpaint.git
Example use case: Tracking shark body parts in a movie
These are the scribble annotations provided for training:
And this is the resulting Convpaint segmentation:
Check out the documentation or the paper for more usecases!
License
Distributed under the terms of the BSD-3 license, "napari-convpaint" is free and open source software
Contributing
Contributions are very welcome. Tests can be run with tox, please ensure the coverage at least stays the same before you submit a pull request.
Issues
If you encounter any problems, please file an issue along with a detailed description.
Authors
The idea behind this napari plugin was first developed by Lucien Hinderling in the group of Olivier Pertz, at the Institute of Cell Biology, University of Bern. The code has first been shared as open source resource in form of a Jupyter Notebook. With the desire to make this resource accessible to a broader public in the scientific community, the Pertz lab obtained a CZI napari plugin development grant with the title "Democratizing Image Analysis with an Easy-to-Train Classifier" which supported the adaptation of the initial concept as a napari plugin called napari-convpaint. The plugin has been developed by Guillaume Witz, Mykhailo Vladymyrov and Ana Stojiljkovic at the Data Science Lab, University of Bern, in tight collaboration with the Pertz lab (Lucien Hinderling, Roman Schwob, Benjamin Gräedel, Maciej Dobrzyński).
Cite Convpaint
If you find Convpaint useful in your research, please consider citing:
@article {Hinderling2024.09.12.610926,
author = {Hinderling, Lucien and Witz, Guillaume and Schwob, Roman and Stojiljkovic, Ana and Dobrzynski, Maciej and Vladymyrov, Mykhailo and Frei, Joel and Graedel, Benjamin and Frismantiene, Agne and Pertz, Olivier},
title = {Convpaint - Universal framework for interactive pixel classification using pretrained neural networks},
year = {2024},
doi = {10.1101/2024.09.12.610926},
URL = {https://www.biorxiv.org/content/early/2024/09/14/2024.09.12.610926},
journal = {bioRxiv}
}
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file napari_convpaint-0.5.2.tar.gz
.
File metadata
- Download URL: napari_convpaint-0.5.2.tar.gz
- Upload date:
- Size: 17.4 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 319821f3967f1c883b75cb3598506d78310ea44dba60759a3ddea1e0b1844275 |
|
MD5 | af5bca33ae68cf49f0ae9cb8995679ec |
|
BLAKE2b-256 | 84782e1a4afc18d45140d7e690fd27e294aa18452672ad1b6c3cccdf3ac2c697 |
File details
Details for the file napari_convpaint-0.5.2-py3-none-any.whl
.
File metadata
- Download URL: napari_convpaint-0.5.2-py3-none-any.whl
- Upload date:
- Size: 42.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c4f2f22e3019e8d4ba2bef86afded4e72a11e3f97dc2e18479a1f5ca72794abf |
|
MD5 | 2085160c1902f8c364a8835a27af327d |
|
BLAKE2b-256 | 85cf222de84e6fd21be3232fd4c0e198529ec20ea38f50e4e3505afdb0457a51 |