Add Azure dataset support to dtool
Project description
Free software: MIT License
Features
Copy datasets to and from Azure storage
List all the datasets in a Azure storage account
Create datasets directly in Azure storage
Installation
To install the dtool-azure package:
pip install dtool-azure
Configuration
Install the Azure command line client via:
pip install azure-cli
(you may wish to install this in a virtual environment)
Then:
az login
To log into Azure.
Then you need to run (changing the resource name/group as appropriate):
az storage account show-connection-string --name jicinformatics --resource-group jic_informatics_resources_ukwest
Then create the file .config/dtool/dtool.json and add the Azure account name and key using the format below:
{ "DTOOL_AZURE_ACCOUNT_KEY_<ACCOUNT NAME>": "<KEY HERE>" }
Changing the account name and key as appropriate. For example if the account name was “jicinformatics” and the key “some-secret-token”:
{ "DTOOL_AZURE_ACCOUNT_KEY_jicinformatics": "some-secret-token" }
Usage
To copy a dataset from local disk (my-dataset) to an Azure storage account (jicinformatics) one can use the command below:
dtool copy ./my-dataset azure://jicinformatics/
To list all the datasets in an Azure storage account one can use the command below:
dtool ls azure://jicinformatics/
See the dtool documentation for more detail.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file dtool-azure-0.7.1.tar.gz
.
File metadata
- Download URL: dtool-azure-0.7.1.tar.gz
- Upload date:
- Size: 7.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.7.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | e78ce652565689307aee40a7acf0c1d8a4209757588002afbcbc1e61b3dedb3a |
|
MD5 | 73f936798ee58ef5e00fd3c88d0f1dbe |
|
BLAKE2b-256 | 0eda0939e3add5b58f484e44a241c842020fee21e4a908f1cb1af0d448fb9920 |