Skip to main content

F.A.S.T. package for describing datasets

Project description

pypi package pipeline status coverage report

fast-curator

Create, read and write dictionary descriptions of input datasets to process. Currently all datasets are expected to be built from sets of ROOT Trees.

Requirements

Installing

pip install --user fast-curator

Usage

# Local files:
fast_curator -o output_file_list.txt -t tree_name -d dataset_name --mc input/files/*root

# Single XROOTD files:
fast_curator -o output_file_list.txt --mc root://my.domain.with.files://input/files/one_file.root

# XROOTD files with several globs
fast_curator -o output_file_list.txt --mc root://my.domain.with.files://inp*/files/*.root

Notes:

  1. If the command is called multiple times with the same output file (using the -o option), the additional files specified will be appended to the output file.
  2. Arbitrary meta-data (such as cross-section, data quality, generator precision, etc) can be added to each dataset with the -m option.

For more guidance try the built-in help:

fast_curator --help

Reading dataset files back

import fast_curator
datasets = fast_curator.read.from_yaml("my_dataset_file.yml")

Will return a list of datasets with the default section applied to each dataset.

Further Documentation

Is on its way...

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fast-curator-0.2.0.tar.gz (6.5 kB view details)

Uploaded Source

Built Distribution

fast_curator-0.2.0-py2.py3-none-any.whl (8.3 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file fast-curator-0.2.0.tar.gz.

File metadata

  • Download URL: fast-curator-0.2.0.tar.gz
  • Upload date:
  • Size: 6.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.20.1 setuptools/40.6.2 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.1

File hashes

Hashes for fast-curator-0.2.0.tar.gz
Algorithm Hash digest
SHA256 dfb61aa90e647bd6eaa99f6f04edcdf9e92fd09ceff39157d02dd56ca27c3043
MD5 42b63b55d3bfee1d69de71b772372c66
BLAKE2b-256 d2a7f8117c7b4e824df9a824432fc17858306ae246d7a7612059f98d299eab70

See more details on using hashes here.

File details

Details for the file fast_curator-0.2.0-py2.py3-none-any.whl.

File metadata

  • Download URL: fast_curator-0.2.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 8.3 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.20.1 setuptools/40.6.2 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.1

File hashes

Hashes for fast_curator-0.2.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 18d4139f54e60902fb4ba7928ca44ca92b5c72ae91d8bf4e1cf08f43bc99c274
MD5 77cc0823cf144b64c0e62f97316783d8
BLAKE2b-256 12f04a1b50bb583b420ac6f5cf3c74c580b38c92e6538b0ff0b7f5c19de04ec8

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page