Skip to main content

Add Azure dataset support to dtool

Project description

PyPi package

Features

  • Copy datasets to and from Azure storage

  • List all the datasets in a Azure storage account

  • Create datasets directly in Azure storage

Installation

To install the dtool-azure package:

pip install dtool-azure

Configuration

Install the Azure command line client via:

pip install azure-cli

(you may wish to install this in a virtual environment)

Then:

az login

To log into Azure.

Then you need to run (changing the resource name/group as appropriate):

az storage account show-connection-string --name jicinformatics --resource-group jic_informatics_resources_ukwest

Then create the file .config/dtool/dtool.json and add the Azure account name and key using the format below:

{
    "DTOOL_AZURE_ACCOUNT_KEY_<ACCOUNT NAME>": "<KEY HERE>"
}

Changing the account name and key as appropriate. For example if the account name was “jicinformatics” and the key “some-secret-token”:

{
    "DTOOL_AZURE_ACCOUNT_KEY_jicinformatics": "some-secret-token"
}

Usage

To copy a dataset from local disk (my-dataset) to an Azure storage account (jicinformatics) one can use the command below:

dtool copy ./my-dataset azure://jicinformatics/

To list all the datasets in an Azure storage account one can use the command below:

dtool ls azure://jicinformatics/

See the dtool documentation for more detail.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dtool-azure-0.7.1.tar.gz (7.4 kB view details)

Uploaded Source

File details

Details for the file dtool-azure-0.7.1.tar.gz.

File metadata

  • Download URL: dtool-azure-0.7.1.tar.gz
  • Upload date:
  • Size: 7.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.7.7

File hashes

Hashes for dtool-azure-0.7.1.tar.gz
Algorithm Hash digest
SHA256 e78ce652565689307aee40a7acf0c1d8a4209757588002afbcbc1e61b3dedb3a
MD5 73f936798ee58ef5e00fd3c88d0f1dbe
BLAKE2b-256 0eda0939e3add5b58f484e44a241c842020fee21e4a908f1cb1af0d448fb9920

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page