Practical dataset management
Project description
Sefara is a Python library for managing your datasets. It provides a way to specify once what your datasets are (usually fileystem paths) and any metadata (e.g. which experiment they came from), then refer to them conveniently in analysis scripts and notebooks.
Sefara doesn’t assume anything about what your datasets are, what format they’re in, or are how they are accessed.
Quick example
Define a “resource collection” by making a file like this, which we’ll call datasets.sefara.py:
from sefara import export export( "my_first_dataset.hdf5", path="/path/to/file1.hdf5", tags=["first", "important"], ) export( "my_second_dataset.csv", path="/path/to/file2.csv", tags=["second", "unimportant"], )
Then, use Sefara to open it in Python:
>>> import sefara >>> datasets = sefara.load("datasets.sefara.py") >>> print(datasets.filter("tags.important")[0].path) /path/to/file1.hdf5
Documentation
Available at: http://timodonnell.github.io/sefara/docs/html
Installation
pip install sefara
To run the tests:
nosetests
To build the documentation:
pip install -e . pip install Sphinx cd docs make clean setup rst html
The docs will be written to the _build/html directory.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file sefara-0.2.1.tar.gz
.
File metadata
- Download URL: sefara-0.2.1.tar.gz
- Upload date:
- Size: 18.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5d92ca3dda227c5feafd30fa265b805a0719d0e2a587a42aa6151da2f8b75677 |
|
MD5 | 62e6adaaba46e287c03b350dfaa8dd1e |
|
BLAKE2b-256 | 9eb9b680f901b08b2b55ddd70ce8941c0926fafaf405b9740ca5e49fea6582ef |