Skip to main content

Core API for managing (scientific) data

Project description

dtool PyPi package AppVeyor CI build status (Windows) test test Code Coverage Documentation Status

Features

  • Core API for adding different types of metadata to files on disk

  • Automatic generation of structural metadata

  • Programmatic discovery and access of items in a dataset

  • Structural metadata includes hash, size and modification time for subsequent integrity checks

  • Ability to annotate individual files with arbitrary metadata

  • Metadata stored on disk as plain text files, i.e. disk datasets generated using this API can be accessed without special tools

  • Ability to create plugins for custom storage solutions

  • Plugins for iRODS and Microsoft Azure storage backends available

  • Cross-platform: Linux, Mac and Windows are all supported

  • Works with Python 2.7, 3.5 and 3.6

  • No external dependencies

Overview

The dtoolcore project provides a Python API for managing (scientific) data. It allows researchers to:

  • Package data and metadata into a dataset

  • Organise and backup datasets easily

  • Find datasets of interest

  • Verify the contents of datasets

  • Discover and work with data programatically

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dtoolcore-3.19.0.tar.gz (50.4 kB view details)

Uploaded Source

Built Distribution

dtoolcore-3.19.0-py3-none-any.whl (20.9 kB view details)

Uploaded Python 3

File details

Details for the file dtoolcore-3.19.0.tar.gz.

File metadata

  • Download URL: dtoolcore-3.19.0.tar.gz
  • Upload date:
  • Size: 50.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for dtoolcore-3.19.0.tar.gz
Algorithm Hash digest
SHA256 32de6dda319002d41fc8a0b7a8835a1de37d9ca60265bf3416bc57caaba0b9f5
MD5 463f9c14f334f300437b151ff7380385
BLAKE2b-256 548d45e8822a653292ed7e78d0808ae836d9f381972a2dd7222d33b5c3293c0e

See more details on using hashes here.

File details

Details for the file dtoolcore-3.19.0-py3-none-any.whl.

File metadata

  • Download URL: dtoolcore-3.19.0-py3-none-any.whl
  • Upload date:
  • Size: 20.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for dtoolcore-3.19.0-py3-none-any.whl
Algorithm Hash digest
SHA256 748556a45f0bdd218462d480961f98f65f5b79617ca2d6a771c9078025a3095a
MD5 f8d29343f167ec372c66004e3dd41f43
BLAKE2b-256 46a0478d55f9175e067cbd2728395a9f7fe76291158145c0917a0a481491a882

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page