Skip to main content

Create dataset where data directory is a symlink

Project description

Add ability to create dataset where data directory is a symlink.

Installing this package provides the dtool command line client with a storage broker named symlink. This is useful if one wants to mark up files in a directory as a dataset without having to re-organise their structure on disk. For example if one wants to mark up some Next Generation Sequencing data that has arrived on an external hard disk as a dataset before copying the resulting dataset to some other form of storage.

If one wants to make use of the dtool_symlink.storagebroker.SymLinkStorageBroker class programatically one needs to create a function that returns the data directory to be symbolically linked. This function is then passed into the SymLinkStorageBroker.create_structure() method. For example:

from dtool_symlink.storagebroker import SymLinkStorageBroker

def get_data_dir():
    return "/my/path/with/data"

symlink_storage_broker = SymLinkStorageBroker("/path/to/dataset")
symlink_storage_broker.create_structure(get_data_dir)

Installation

To install the dtool-symlink package.

cd dtool-symlink
python setup.py install

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dtool-symlink-0.1.1.tar.gz (2.5 kB view details)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page