Skip to main content

Dtool plugin for creating datasets

Project description

PyPi package Travis CI build status (Linux) Code Coverage

Installation

pip install dtool-create

Usage

Create a proto dataset:

dtool create my_dataset

Add some data to to the dataset:

cp *.csv my_dataset/data

Add descriptive metadata to the dataset:

dtool readme interative my_dataset

Convert the proto dataset to a dataset by freezing it:

dtool freeze my_dataset

See the dtool documentation for more detail.

Configuring the descriptive metadata template

It is possible to configure the required metadata prompted for by the dtool readme interactive command. The default template is the dtool_create/templates/README.yml.

One may want to create a custom YAML file specifying the required metadata that will be prompted for. This can be achieved by setting the DTOOL_README_TEMPLATE_FPATH environment variable, e.g.:

export DTOOL_README_TEMPLATE_FPATH=~/dtool_readme.yml

Alternatively, one can add the DTOOL_README_TEMPLATE_FPATH key to the ~/.config/dtool/dtool.json file. For example,

{
   "DTOOL_README_TEMPLATE_FPATH": "/Users/olssont/dtool_readme.yml"
}

If the ~/.config/dtool/dtool.json file does not exist one may need to create it.

Configuring the user’s full name and email for the descriptive metadata

When running the dtool interactive readme the default name and email address are Your Name and you@example.com. These defaults can be configured by setting the DTOOL_USER_FULL_NAME DTOOL_USER_EMAIL environment variables.

export DTOOL_USER_FULL_NAME="Care A. Bout-Data"
export DTOOL_USER_EMAIL=researcher@famous.uni.ac.uk

Alternatively, one can add the DTOOL_USER_FULL_NAME and DTOOL_USER_EMAIL keys to the ~/.config/dtool/dtool.json file. For example,

{
   "DTOOL_USER_FULL_NAME": "Care A. Bout-Data",
   "DTOOL_USER_EMAIL": "researcher@famous.uni.ac.uk"
}

If the ~/.config/dtool/dtool.json file does not exist one may need to create it.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dtool-create-0.17.0.tar.gz (6.7 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page