Skip to main content

NU-Net

Project description

NU-Net: a self-supervised smart filter for enhancing blobs in bioimages

While supervised deep neural networks have become the dominant method for image analysis tasks in bioimages, truly versatile methods are not available yet because of the diversity of modalities and conditions and the cost of retraining. In practice, day-to-day biological image analysis still largely relies on ad hoc workflows often using classical linear filters. We propose NU-Net, a convolutional neural network filter selectively enhancing cells and nuclei, as a drop-in replacement of chains of classical linear filters in bioimage analysis pipelines. Using a style transfer architecture, a novel perceptual loss implicitly learns a soft separation of background and foreground. We used self-supervised training using 25 datasets covering diverse modalities of nuclear and cellular images. We show its ability to selectively improve contrast, remove background and enhance objects across a wide range of datasets and workflow while keeping image content. The pre-trained models are light and practical, and published as free and open-source software for the community. NU-Net is also available as a plugin for Napari.

Installation

Use PyPI (Python Package Index)

pip install nunet

or clone this repo and install it locally

git clone https://github.com/LaboratoryOpticsBiosciences/nunet.git
cd nunet
pip install -e .

Usage

The repo provides two scripts: one to test and the other to train a NU-Net.

For common steps to test and train NU-Nets,

  1. Go to release page https://github.com/LaboratoryOpticsBiosciences/nunet/releases

  2. Download an archive called nunet_models.tar and unzip it in the root directory of the repo. It should unzip config/ folder and models_filter_slider/ folder.

To test pre-trained NU-Nets,

  • Execute ./scripts/test_nunet.py following its instruction on the top of the script.

Get help message by invoking the script python scripts/test_nunet.py --help.

To train the pre-trained NU-Nets

  • Execute ./scripts/train_nunet.py folowing its instruction.

Note that the provided NU-Net models on the releases page are not reproducible until we later release private datasets, namely ones prefixed with LOB_. Find more details in the paper.

Citation

This work was accepted by BIC (Bio-Image Computing) workshop at ICCV2023. The paper will become available soon.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nunet-0.1.2.tar.gz (21.8 kB view details)

Uploaded Source

Built Distribution

nunet-0.1.2-py3-none-any.whl (2.4 kB view details)

Uploaded Python 3

File details

Details for the file nunet-0.1.2.tar.gz.

File metadata

  • Download URL: nunet-0.1.2.tar.gz
  • Upload date:
  • Size: 21.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/4.0.2 CPython/3.11.7

File hashes

Hashes for nunet-0.1.2.tar.gz
Algorithm Hash digest
SHA256 4dd87f4a9c62dfd584180e1bacef8a5fd3ba09c033eadd47107be2c58c5e3a9d
MD5 70a82d6ae804bd669403e0128b47d122
BLAKE2b-256 d1231296990e0fddc3419f8a147b206649d8703248d1fb56965d8743502679c8

See more details on using hashes here.

File details

Details for the file nunet-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: nunet-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 2.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/4.0.2 CPython/3.11.7

File hashes

Hashes for nunet-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 7bdc477382edfffbac2ac588ce855bd6b9874e5ab196a1bcd965b64c8b2b08c6
MD5 a1e667ea189e0e383721e2f02f7cadd5
BLAKE2b-256 64da6be71877650c50c27f5d3809ae1c51a819967b9d9ae9ea5b9f8470444658

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page