Add Azure dataset support to dtool
Project description
Free software: MIT License
Features
Copy datasets to and from Azure storage
List all the datasets in a Azure storage account
Create datasets directly in Azure storage
Installation
To install the dtool-azure package:
pip install dtool-azure
Configuration
Install the Azure command line client via:
pip install azure-cli
(you may wish to install this in a virtual environment)
Then:
az login
To log into Azure.
Then you need to run (changing the resource name/group as appropriate):
az storage account show-connection-string --name jicinformatics --resource-group jic_informatics_resources_ukwest
Then create the file .config/dtool/dtool.json and add the Azure account name and key using the format below:
{ "DTOOL_AZURE_ACCOUNT_KEY_<ACCOUNT NAME>": "<KEY HERE>" }
Changing the account name and key as appropriate. For example if the account name was “jicinformatics” and the key “some-secret-token”:
{ "DTOOL_AZURE_ACCOUNT_KEY_jicinformatics": "some-secret-token" }
Usage
To copy a dataset from local disk (my-dataset) to an Azure storage account (jicinformatics) one can use the command below:
dtool copy ./my-dataset azure://jicinformatics/
To list all the datasets in an Azure storage account one can use the command below:
dtool ls azure://jicinformatics/
See the dtool documentation for more detail.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.