Skip to main content

Core API for managing (scientific) data

Project description

PyPi package Travis CI build status (Linux) Code Coverage Documentation Status

Features

  • Core API for adding different types of metadata to files on disk
  • Automatic generation of structural metadata
  • Programmatic discovery and access of items in a dataset
  • Structural metadata includes hash, size and modification time for subsequent integrity checks
  • Ability to annotate individual files with arbitrary metadata
  • Metadata stored on disk as plain text files, i.e. disk datasets generated using this API can be accessed without special tools
  • Ability to create plugins for custom storage solutions
  • Plugins for iRODS and Microsoft Azure storage backends available
  • Works with Python 2.7, 3.5 and 3.6
  • No external dependencies

Overview

The dtoolcore project provides a Python API for managing (scientific) data. It aims to help in three areas:

  1. Adding structure and meta data to your project and files
  2. Providing programmatic discovery of your data
  3. Verifying the integrity of your data

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
dtoolcore-3.7.0.tar.gz (12.5 kB) Copy SHA256 hash SHA256 Source None Sep 7, 2018

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page