This release is a pre-release and may not be stable for production use.
serotiny
While going about the work of building deep learning projects, several simultaneous problems seemed to emerge:
- How do we reuse as much work from previous projects as possible, and focus on building the part of the project that makes it distinct?
- How can we automate the generation of new models that are based on existing models, but vary in a crucial yet non-trivial way?
- When generating a multiplicity of related models, how can we keep all of the results, predictions, and analyses straight?
- How can the results from any number of trainings and predictions be compared and integrated in an insightful yet generally applicable way?
Serotiny arose from the need to address these issues and convert the complexity of deep learning projects into something simple, reproducible, configurable, and automatable at scale.
Serotiny is still a work-in-progress, but as we go along the solutions to these problems become more clear. Maybe you've run into similar situations? We'd love to hear from you.
Overview
serotiny is a framework and set of tools to structure, configure and drive deep
learning projects, developed with the intention of streamlining the lifecycle of
deep learning projects at Allen Institute for Cell Science.
It achieves this goal by:
- Standardizing the structure of DL projects
- Relying on the modularity afforded by this standard structure to make DL projects highly configurable, using hydra as the framework for configuration
- Making it easy to adopt best-practices and latest-developments in DL infrastructure
by tightly integrating with
- Pytorch Lightning for neural net training/testing/prediction
- MLFlow for experiment tracking and artifact management
In doing so, DL projects become reproducible, easy to collaborate on and can benefit from general and powerful tooling.
Getting started
For more information, check our documentation, or jump straight into our getting started page, and learn how training a DL model can be as simple as:
$ serotiny train data=my_dataset model=my_model
Authors
- Guilherme Pires @colobas
- Ryan Spangler @prismofeverything
- Ritvik Vasan @ritvikvasan
- Caleb Chan @calebium
- Theo Knijnenburg @tknijnen
- Nick Gomez @gomeznick86
Citing
If you find serotiny useful, please cite this repository as:
Serotiny Authors (2022). Serotiny: a framework of tools to structure, configure and drive deep learning projects [Computer software]. GitHub. https://github.com/AllenCellModeling/serotiny
Free software: BSD-3-Clause
1 maintainer
Metadata
1 maintainer
Release files for serotiny 0.0.4.dev202210122315
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| serotiny-0.0.4.dev202210122315.tar.gz | 48.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| serotiny-0.0.4.dev202210122315-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 121.8 kB
Release files / serotiny-0.0.4.dev202210122315.tar.gz
| Download URL | serotiny-0.0.4.dev202210122315.tar.gz |
|---|---|
| Size | 48.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a5174486078174a9e14ec9468037dcee949b908d777a21c6881a552e09f59499
|
|
BLAKE2b-256 checksum How to use checksums |
a1fc533d0c1e2e02a31c33e4013db0d1d6689915b0bd22dbfae54d8bb909384e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.9.14
|
Release files / serotiny-0.0.4.dev202210122315-py3-none-any.whl
| Download URL | serotiny-0.0.4.dev202210122315-py3-none-any.whl |
|---|---|
| Size | 73.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b43b52f51a2a21678c1151590102735765abe677efaa810cee02be52a4e097ed
|
|
BLAKE2b-256 checksum How to use checksums |
ba546e8f21cbddaa4401a9f61ee004e517100fa70366ca994869b126285211d9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.9.14
|
