Connectome is a framework for datasets management with strong emphasis on simplicity, composability and reusability.
Features
- Self-consistency: connectome encourages data transformations that keep entries' fields consistent
- Caching: transformations' caching works out of the box and supports both caching to RAM and to Disk
- Automatic cache invalidation: connectome tracks all the changes made to a dataset and automatically invalidates the cache when something changes, making sure that your cache is always consistent with the data
- Invertible transformations: write consistent pre- and post- processing to build production-ready pipelines
Install
The simplest way is to get it from PyPi:
pip install connectome
Or if you want to try the latest version from GitHub:
git clone https://github.com/neuro-ml/connectome.git
cd connectome
pip install -e .
# or let pip handle the cloning:
pip install git+https://github.com/neuro-ml/connectome.git
Getting started
The docs are located here
Also, you can check out our Intro to connectome series of
tutorials here
Acknowledgements
Some parts of our automatic cache invalidation machinery vere heavily inspired by the cloudpickle project.
Release files for connectome 0.10.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| connectome-0.10.0.tar.gz | 47.8 kB | Details |
Release files / connectome-0.10.0.tar.gz
| Download URL | connectome-0.10.0.tar.gz |
|---|---|
| Size | 47.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
2f8248718ad30e35d5f2d170aa45b7e75b31eb498454970cab60b1385cfbd757
|
|
BLAKE2b-256 checksum How to use checksums |
10eb4275deb7c53c595c689c95792f2b57aaadfe948503252beb7053cffeed1e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.9.19
|
