The Tensorflow, Keras implementation of U-net, V-net, U-net++, UNET 3+, Attention U-net, R2U-net, ResUnet-a, U^2-Net, TransUNET, and Swin-UNET with optional ImageNet-trained backbones.
Project description
keras-unet-collection
The tensorflow.keras
implementation of U-net, V-net, U-net++, UNET 3+, Attention U-net, R2U-net, ResUnet-a, U^2-Net, TransUNET, and Swin-UNET with optional ImageNet-trained backbones.
keras_unet_collection.models
contains functions that configure keras models with hyper-parameter options.
- Pre-trained ImageNet backbones are supported for U-net, U-net++, UNET 3+, Attention U-net, and TransUNET.
- Deep supervision is supported for U-net++, UNET 3+, and U^2-Net.
- See the User guide for other options and use cases.
keras_unet_collection.models |
Name | Reference |
---|---|---|
unet_2d |
U-net | Ronneberger et al. (2015) |
vnet_2d |
V-net (modified for 2-d inputs) | Milletari et al. (2016) |
unet_plus_2d |
U-net++ | Zhou et al. (2018) |
r2_unet_2d |
R2U-Net | Alom et al. (2018) |
att_unet_2d |
Attention U-net | Oktay et al. (2018) |
resunet_a_2d |
ResUnet-a | Diakogiannis et al. (2020) |
u2net_2d |
U^2-Net | Qin et al. (2020) |
unet_3plus_2d |
UNET 3+ | Huang et al. (2020) |
transunet_2d |
TransUNET | Chen et al. (2021) |
swin_unet_2d |
Swin-UNET | Hu et al. (2021) |
Note: the two Transformer models are incompatible with Numpy 1.20
; NumPy 1.19.5
is recommended.
keras_unet_collection.base
contains functions that build the base architecture (i.e., without model heads) of Unet variants for model customization and debugging.
keras_unet_collection.base |
Notes |
---|---|
unet_2d_base , vnet_2d_base , unet_plus_2d_base , unet_3plus_2d_base , att_unet_2d_base , r2_unet_2d_base , resunet_a_2d_base , u2net_2d_base , transunet_2d_base , swin_unet_2d_base |
Functions that accept an input tensor and hyper-parameters of the corresponded model, and produce output tensors of the base architecture. |
keras_unet_collection.activations
and keras_unet_collection.losses
provide additional activation layers and loss functions.
keras_unet_collection.activations |
Name | Reference |
---|---|---|
GELU |
Gaussian Error Linear Units (GELU) | Hendrycks et al. (2016) |
Snake |
Snake activation | Liu et al. (2020) |
keras_unet_collection.losses |
Name | Reference |
---|---|---|
dice |
Dice loss | Sudre et al. (2017) |
tversky |
Tversky loss | Hashemi et al. (2018) |
focal_tversky |
Focal Tversky loss | Abraham et al. (2019) |
ms_ssim |
Multi-scale Structural Similarity Index loss | Wang et al. (2003) |
iou_seg |
Intersection over Union (IoU) loss for segmentation | Rahman and Wang (2016) |
iou_box |
(Generalized) IoU loss for object detection | Rezatofighi et al. (2019) |
triplet_1d |
Semi-hard triplet loss (experimental) | |
crps2d_tf |
CRPS loss (experimental) |
Installation and usage
pip install keras-unet-collection
from keras_unet_collection import models
# e.g. models.unet_2d(...)
-
Note: Currently supported backbone models are:
VGG[16,19]
,ResNet[50,101,152]
,ResNet[50,101,152]V2
,DenseNet[121,169,201]
, andEfficientNetB[0-7]
. See Keras Applications for details. -
Note: Neural networks produced by this package may contain customized layers that are not part of the Tensorflow. It is reommended to save and load model weights.
Examples
-
Jupyter notebooks are provided as examples:
-
Attention U-net with VGG16 backbone [link].
-
UNET 3+ with deep supervision, classification-guided module, and hybrid loss [link].
-
Vision-Transformer-based examples are in progress, and available at keras-vision-transformer
-
Dependencies
-
TensorFlow 2.5.0, Keras 2.5.0, Numpy 1.19.5.
-
(Optional for examples) Pillow, matplotlib, etc.
Overview
U-net is a convolutional neural network with encoder-decoder architecture and skip-connections, loosely defined under the concept of "fully convolutional networks." U-net was originally proposed for the semantic segmentation of medical images and is modified for solving a wider range of gridded learning problems.
U-net and many of its variants take three or four-dimensional tensors as inputs and produce outputs of the same shape. One technical highlight of these models is the skip-connections from downsampling to upsampling layers, which benefit the reconstruction of high-resolution, gridded outputs.
Contact
Yingkai (Kyle) Sha <yingkai@eoas.ubc.ca> <yingkaisha@gmail.com>
License
Citation
- Sha, Y., 2021: Keras-unet-collection. GitHub repository, accessed 4 September 2021, https://doi.org/10.5281/zenodo.5449801
@misc{keras-unet-collection,
author = {Sha, Yingkai},
title = {Keras-unet-collection},
year = {2021},
publisher = {GitHub},
journal = {GitHub repository},
howpublished = {\url{https://github.com/yingkaisha/keras-unet-collection}},
doi = {10.5281/zenodo.5449801}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for keras-unet-collection-0.1.13.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | d7c0291944f198f990309987fd1108f1463acb8aa20ed1d800b8d3bbfb73061d |
|
MD5 | 1f7224d7943ba902d2c5bcc4545821ac |
|
BLAKE2b-256 | deff327b15609e498354cc15909280953b72f35854d33bc5fb9554e300e7968a |
Hashes for keras_unet_collection-0.1.13-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 12ce8457c0eb99ca987633a58954ed62459bcf4c13f4450764df6462cdcc5186 |
|
MD5 | a755197ff05c5034ab7d64adfd471e36 |
|
BLAKE2b-256 | a41f5b17d50b28ffd81f39ebf5a2a85466517bd39375a47347cfd95547db58ab |