Skip to main content

Core API for managing (scientific) data

Project description

PyPi package Travis CI build status (Linux) AppVeyor CI build status (Windows) Code Coverage Documentation Status

Features

  • Core API for adding different types of metadata to files on disk

  • Automatic generation of structural metadata

  • Programmatic discovery and access of items in a dataset

  • Structural metadata includes hash, size and modification time for subsequent integrity checks

  • Ability to annotate individual files with arbitrary metadata

  • Metadata stored on disk as plain text files, i.e. disk datasets generated using this API can be accessed without special tools

  • Ability to create plugins for custom storage solutions

  • Plugins for iRODS and Microsoft Azure storage backends available

  • Cross-platform: Linux, Mac and Windows are all supported

  • Works with Python 2.7, 3.5 and 3.6

  • No external dependencies

Overview

The dtoolcore project provides a Python API for managing (scientific) data. It allows researchers to:

  • Package data and metadata into a dataset

  • Organise and backup datasets easily

  • Find datasets of interest

  • Verify the contents of datasets

  • Discover and work with data programatically

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dtoolcore-3.17.0.tar.gz (18.0 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page