Skip to main content

Practical dataset management

Project description

Sefara is a Python library for managing your datasets. It provides a way to specify once what your datasets are (usually fileystem paths) and any metadata (e.g. which experiment they came from), then refer to them conveniently in analysis scripts and notebooks.

Sefara doesn’t assume anything about what your datasets are, what format they’re in, or are how they are accessed.

Quick example

Define a “resource collection” by making a file like this, which we’ll call datasets.sefara.py:

from sefara import export

export(
    "my_first_dataset.hdf5",
    path="/path/to/file1.hdf5",
    tags=["first", "important"],
)
export(
    "my_second_dataset.csv",
    path="/path/to/file2.csv",
    tags=["second", "unimportant"],
)

Then, use Sefara to open it in Python:

>>> import sefara
>>> datasets = sefara.load("datasets.sefara.py")
>>> print(datasets.filter("tags.important")[0].path)
/path/to/file1.hdf5

Documentation

Available at: http://timodonnell.github.io/sefara/docs/html

Installation

pip install sefara

To run the tests:

nosetests

To build the documentation:

pip install -e .
pip install Sphinx
cd docs
make clean setup rst html

The docs will be written to the _build/html directory.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sefara-0.2.1.tar.gz (18.5 kB view details)

Uploaded Source

File details

Details for the file sefara-0.2.1.tar.gz.

File metadata

  • Download URL: sefara-0.2.1.tar.gz
  • Upload date:
  • Size: 18.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for sefara-0.2.1.tar.gz
Algorithm Hash digest
SHA256 5d92ca3dda227c5feafd30fa265b805a0719d0e2a587a42aa6151da2f8b75677
MD5 62e6adaaba46e287c03b350dfaa8dd1e
BLAKE2b-256 9eb9b680f901b08b2b55ddd70ce8941c0926fafaf405b9740ca5e49fea6582ef

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page