Skip to main content

Add HTTP read only dataset support to dtool

Project description

dtool pypi tag test coverage

Features

  • Publish dtool datasets by making them accessible via HTTP(S)

  • Interact with dtool datasets over HTTP(S)

  • Copy a dataset over HTTP(S)

Installation

To install the dtool-http package.

cd dtool-http
python setup.py install

Usage

To publish a dataset hosted in Amazon S3 or Microsoft Azure Storage use the dtool_publish_dataset command line utility:

$ dtool_publish_dataset azure://jicinformatics/c58038a4-3a54-425e-9087-144d0733387f
Dataset accessible at: https://jicinformatics.blob.core.windows.net/c58038a4-3a54-425e-9087-144d0733387f

To show the descriptive metadata of the published dataset:

$ dtool readme show https://jicinformatics.blob.core.windows.net/c58038a4-3a54-425e-9087-144d0733387f
---
description: Enterobacteria phage lambda, complete genome
creation_date: 2018-02-06
accession: NC_001416.1
link: https://www.ncbi.nlm.nih.gov/nuccore/NC_001416.1
reference: |
  Nucleotide [Internet]. Bethesda (MD):
  National Library of Medicine (US),
  National Center for Biotechnology Information; [1988] - .
  Accession No. NC_001416.1, Enterobacteria phage lambda, complete genome
  [cited 2018 Feb 06]
  Available from: https://www.ncbi.nlm.nih.gov/nuccore/NC_001416.1

To copy the dataset to local disk:

$ dtool copy https://jicinformatics.blob.core.windows.net/c58038a4-3a54-425e-9087-144d0733387f ~/my_datasets
Dataset copied to:
file:///Users/olssont/my_datasets/lamda-phage-genome

Serving a directory of datasets over HTTP

There is a simple utility for serving datasets in a directory over HTTP called dtool_serve_direcotry. This is mainly useful for testing purposes.

Usage:

$ dtool_serve_directory ~/my_datasets

The default port used is 8081. To show the descriptive metadata in the README one can use dtool:

$ dtool readme show http://localhost:8081/lamda-phage-genome
---
description: Enterobacteria phage lambda, complete genome
creation_date: 2018-02-06
accession: NC_001416.1
link: https://www.ncbi.nlm.nih.gov/nuccore/NC_001416.1
reference: |
  Nucleotide [Internet]. Bethesda (MD):
  National Library of Medicine (US),
  National Center for Biotechnology Information; [1988] - .
  Accession No. NC_001416.1, Enterobacteria phage lambda, complete genome
  [cited 2018 Feb 06]
  Available from: https://www.ncbi.nlm.nih.gov/nuccore/NC_001416.1

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dtool_http-0.5.2.tar.gz (16.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dtool_http-0.5.2-py3-none-any.whl (8.3 kB view details)

Uploaded Python 3

File details

Details for the file dtool_http-0.5.2.tar.gz.

File metadata

  • Download URL: dtool_http-0.5.2.tar.gz
  • Upload date:
  • Size: 16.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for dtool_http-0.5.2.tar.gz
Algorithm Hash digest
SHA256 656271bf48197b21bac776147182c7adbeb140f0145e69c4dcf8818baba621e6
MD5 6bfb448a8b8ff75939e0681e8211fcb0
BLAKE2b-256 ab0f50e7618ed2454efb807f21fd8368267e29ef451ba2f8d7b42b84cedffaba

See more details on using hashes here.

Provenance

The following attestation bundles were made for dtool_http-0.5.2.tar.gz:

Publisher: publish.yml on jic-dtool/dtool-http

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dtool_http-0.5.2-py3-none-any.whl.

File metadata

  • Download URL: dtool_http-0.5.2-py3-none-any.whl
  • Upload date:
  • Size: 8.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for dtool_http-0.5.2-py3-none-any.whl
Algorithm Hash digest
SHA256 f25254be4e67885b8c57774cd8432e3fe8b22a7efb4b871dbad2b65a97721dd8
MD5 185b1f6fa5cd08e80c4e2ad90eb16f4e
BLAKE2b-256 e590ea59bfe0353e05144d88a9e7cf0d7cf081d5928340eda09691e576e45dd2

See more details on using hashes here.

Provenance

The following attestation bundles were made for dtool_http-0.5.2-py3-none-any.whl:

Publisher: publish.yml on jic-dtool/dtool-http

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page