Skip to main content

Add Azure dataset support to dtool

Project description

PyPi package

Features

  • Copy datasets to and from Azure storage
  • List all the datasets in a Azure storage account
  • Create datasets directly in Azure storage

Installation

To install the dtool-azure package:

pip install dtool-azure

Configuration

Install the Azure command line client via:

pip install azure-cli

(you may wish to install this in a virtual environment)

Then:

az login

To log into Azure.

Then you need to run (changing the resource name/group as appropriate):

az storage account show-connection-string --name jicinformatics --resource-group jic_informatics_resources_ukwest

Then create the file .config/dtool/dtool.json and add the Azure account name and key using the format below:

{
    "DTOOL_AZURE_ACCOUNT_KEY_<ACCOUNT NAME>": "<KEY HERE>"
}

Changing the account name and key as appropriate. For example if the account name was “jicinformatics” and the key “some-secret-token”:

{
    "DTOOL_AZURE_ACCOUNT_KEY_jicinformatics": "some-secret-token"
}

Usage

To copy a dataset from local disk (my-dataset) to an Azure storage account (jicinformatics) one can use the command below:

dtool copy ./my-dataset azure://jicinformatics/

To list all the datasets in an Azure storage account one can use the command below:

dtool ls azure://jicinformatics/

See the dtool documentation for more detail.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for dtool-azure, version 0.7.0
Filename, size File type Python version Upload date Hashes
Filename, size dtool-azure-0.7.0.tar.gz (7.4 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page