Skip to main content
Join the official 2019 Python Developers SurveyStart the survey!

F.A.S.T. package for describing datasets

Project description

pypi package pipeline status coverage report Gitter

fast-curator

Create, read and write dictionary descriptions of input datasets to process. Currently all datasets are expected to be built from sets of ROOT Trees.

Installing

pip install --user fast-curator

Usage

# Local files:
fast_curator -o output_file_list.txt -t tree_name -d dataset_name --mc input/files/*root

# Single XROOTD files:
fast_curator -o output_file_list.txt --mc root://my.domain.with.files://input/files/one_file.root

# XROOTD files with several globs
fast_curator -o output_file_list.txt --mc root://my.domain.with.files://inp*/files/*.root

Notes: 1. If the command is called multiple times with the same output file (using the -o option), the additional files specified will be appended to the output file. 2. Arbitrary meta-data (such as cross-section, data quality, generator precision, etc) can be added to each dataset with the -m option.

For more guidance try the built-in help:

fast_curator --help

Reading dataset files back

import fast_curator
datasets = fast_curator.read.from_yaml("my_dataset_file.yml")

Will return a list of datasets with the default section applied to each dataset.

Further Documentation

Is on its way…

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for fast-curator, version 0.4.1
Filename, size File type Python version Upload date Hashes
Filename, size fast_curator-0.4.1-py2.py3-none-any.whl (10.8 kB) File type Wheel Python version py2.py3 Upload date Hashes View hashes
Filename, size fast-curator-0.4.1.tar.gz (8.5 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page