Skip to main content

Expedite access to files on a slow network volume

Project description

# hsmfile: a Python module to expedite access to files on a remote data store

## Synopsis

This module addresses the common case where there are large data files on a supercomputer and these are to be processed, maybe on the supercomputer or maybe on local machines that can mount the supercomputer file system. The hsmfile module provides functions to

  • Specify the file locations in a platform-independent way, given some platform-specific configuration data; and

  • Copy files automatically as necessary from the supercomputer to the local machines.

It is based on a set of IDL functions with a similar purpose with the prefix [mgh_san](https://github.com/hadfieldnz/idl-roms/tree/master/san).

For more information, see the [documentation on GitHub Pages](https://hadfieldnz.github.io/hsmfile/).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hsmfile-0.1.2.tar.gz (2.5 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page