Class Libraries for VOSpace file system
Project description
vosfs is a python module that allows a VOSpace service to be used as a file system.
The default installation of vosfs is tuned for accessing the VOSpace provided by the Canadian Advanced Network For Astronomical Research (CANFAR)
VOSpace is a Distributed Cloud storage service for use in Astronomy.
There are two ways to use vos:
make VOSpace appear as mounted filesystem: mountvofs
use the vosfs module inside a Python script: import vosfs
Authentication to the CANFAR VOSpace service is performed using X509 security certificates, header tokens or username/password pairs. The authentication system is managed by the CADC Group Management Service (GMS).
To retrieve an X509 security certificate for use with the vosfs tools use the cadc-get-cert script included with the cadcutils package.
Additional information is available in the CANFAR documentation
System Requirments
A CANFAR VOSpace account (required for WRITE access, READ access can be anonymous)
fuse OR OSX-FUSE (see additional documentation, only required for filesystem based access, not for command line or programmatic)
python2.6 or later
Installation
vosfs is distributed via PyPI/vos and PyPI is the most direct way to get the latest stable release:
pip install vosfs --upgrade --user
Or, you can retrieve the github distribution and use
python setup.py install --user
Tutorial
Get a CANFAR account
Install the vosfs package.
Retrieve a X509/SSL certificate using the installed in cadc-get-cert script.
Example Usage.
For filesystem usage: mountvofs mounts the CADC VOSpace root Container Node at /tmp/vospace and initiates a 5GB cache in the users home directory (${HOME}/vos_). fusermount -u /tmp/vospace (LINUX) or umount /tmp/vospace (OS-X) unmounts the file system. VOSpace does not have a mapping of your unix users IDs and thus files appear to be owned by the user who issued the ‘mountvofs’ command.
Development
A virtual environment (venv) is recommended to set up external dependencies without installing them system-wide. Following these instructions, install virtualenv:
$ pip install virtualenv
Next, create, and activate a local venv (this example uses bash):
$ virtualenv venv $ source venv/bin/activate
Setup the new development environment for testing by installing the appropriate packages:
$ pip install -r dev_requirements.txt
The test environment is built into the setup.py so that conducting unit-tests can be achieved like so:
python setup.py test
If you would like versbose output formated as a web page, for example, you can add options to the test call:
python setup.py test --addopts '--cov-report html:cov_html --cov=vosfs'
The same option attribute can be used to pass other arguments to py.test that is executing the test. To run specific only tests for example:
python setup.py test --addopts 'vos/test/Test_vos.py::TestClient::test_transfer_error'
Each time you resume work on the project and want to use the venv (e.g., from a new shell), simply re-activate it:
$ source venv/bin/activate
When done, just issue a
$ deactivate
command to deactivate the virtual environment.
Integration Tests
The integration tests are, at present, designed to run only with the CADC VOSpace. Tests assume that the vofs package has been installed.
Activate the venv and install vofs
$ source venv/bin/activate.csh $ pip install vofs
Run the tests:
``` $ ./test/scripts/vospace-mountvospace-atest.tcsh
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.