pytorch_segmentation_models_trainer
Framework based on Pytorch, Pytorch Lightning, segmentation_models.pytorch and hydra to train semantic segmentation models using yaml config files as follows:
model:
_target_: segmentation_models_pytorch.Unet
encoder_name: resnet34
encoder_weights: imagenet
in_channels: 3
classes: 1
loss:
_target_: segmentation_models_pytorch.utils.losses.DiceLoss
optimizer:
_target_: torch.optim.AdamW
lr: 0.001
weight_decay: 1e-4
hyperparameters:
batch_size: 1
epochs: 2
max_lr: 0.1
pl_trainer:
max_epochs: ${hyperparameters.batch_size}
gpus: 0
train_dataset:
_target_: pytorch_segmentation_models_trainer.dataset_loader.dataset.SegmentationDataset
input_csv_path: /path/to/input.csv
data_loader:
shuffle: True
num_workers: 1
pin_memory: True
drop_last: True
prefetch_factor: 1
augmentation_list:
- _target_: albumentations.HueSaturationValue
always_apply: false
hue_shift_limit: 0.2
p: 0.5
- _target_: albumentations.RandomBrightnessContrast
brightness_limit: 0.2
contrast_limit: 0.2
p: 0.5
- _target_: albumentations.RandomCrop
always_apply: true
height: 256
width: 256
p: 1.0
- _target_: albumentations.Flip
always_apply: true
- _target_: albumentations.Normalize
p: 1.0
- _target_: albumentations.pytorch.transforms.ToTensorV2
always_apply: true
val_dataset:
_target_: pytorch_segmentation_models_trainer.dataset_loader.dataset.SegmentationDataset
input_csv_path: /path/to/input.csv
data_loader:
shuffle: True
num_workers: 1
pin_memory: True
drop_last: True
prefetch_factor: 1
augmentation_list:
- _target_: albumentations.Resize
always_apply: true
height: 256
width: 256
p: 1.0
- _target_: albumentations.Normalize
p: 1.0
- _target_: albumentations.pytorch.transforms.ToTensorV2
always_apply: true
To train a model with configuration path /path/to/config/folder and name test.yaml:
pytorch-smt --config-dir /path/to/config/folder --config-name test +mode=train
The mode can be stored in configuration yaml as well. In this case, do not pass the +mode= argument. If the mode is stored in the yaml and you want to overwrite the value, do not use the + clause, just mode= .
This module suports hydra features such as configuration composition. For further information, please visit https://hydra.cc/docs/intro
Install
If you are not using docker and if you want to enable gpu acceleration, before installing this package, you should install pytorch_scatter as instructed in https://github.com/rusty1s/pytorch_scatter
After installing pytorch_scatter, just do
pip install pytorch_segmentation_models_trainer
We have a docker container in which all dependencies are installed and ready for gpu usage. You can pull the image from dockerhub:
docker pull phborba/pytorch_segmentation_models_trainer:latest
Citing:
@software{philipe_borba_2021_4574256,
author = {Philipe Borba},
title = {{phborba/pytorch\_segmentation\_models\_trainer:
Version 0.1.2}},
month = mar,
year = 2021,
publisher = {Zenodo},
version = {v0.1.2},
doi = {10.5281/zenodo.4574256},
url = {https://doi.org/10.5281/zenodo.4574256}
}
1 maintainer
Metadata
1 maintainer
Release files for pytorch-segmentation-models-trainer 0.7.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| pytorch_segmentation_models_trainer-0.7.2.tar.gz | 81.3 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pytorch_segmentation_models_trainer-0.7.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 198.0 kB
Release files / pytorch_segmentation_models_trainer-0.7.2.tar.gz
| Download URL | pytorch_segmentation_models_trainer-0.7.2.tar.gz |
|---|---|
| Size | 81.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
7c5cbf1a8df71778eeceea1af8d1ee056458cf82e50e7a4ba9ce5c7f88f728a1
|
|
BLAKE2b-256 checksum How to use checksums |
911eea26484e8d3dbb7953703c4c89d51271cef08bc135633cb07ad734901318
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/4.6.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5
|
Release files / pytorch_segmentation_models_trainer-0.7.2-py3-none-any.whl
| Download URL | pytorch_segmentation_models_trainer-0.7.2-py3-none-any.whl |
|---|---|
| Size | 116.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
08abd972f0841dcc9303c513fa1da38eeeabdf5ffd8a22d1b5bde85f08602aaa
|
|
BLAKE2b-256 checksum How to use checksums |
a6a48f13726e8022cf8cc63929c3ec36cc67b2685d908a4f305585a820ec5e6d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/4.6.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5
|
Security for pytorch-segmentation-models-trainer 0.7.2
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
