gdexws

Service tools for data processing and management.

Installation

Install the package in development mode:

pip install -e .

Or install normally:

pip install .

CLI Commands

All tools run through the single gdexws command: gdexws <tool> [options]. Run gdexws --help to list tools and gdexws <tool> --help for a tool's options. -d/--debug is available on every tool.

Adding a tool: drop a module into tools/ or composers/ that defines DESCRIPTION, add_arguments(parser) and run(args); it is discovered automatically as gdexws <module-name-with-hyphens>.

add-global-meta

Add a global attribute to a netCDF file.

gdexws add-global-meta -f /path/to/file.nc -n "attribute_name" -v "attribute_value"

create-exchange-dir

Create a directory directly under /glade/campaign/collections/gdex/data/exchange and grant an HPC user read/write access (rwx, plus a default ACL so new contents inherit it) via POSIX ACLs. Requires setfacl/getfacl.

gdexws create-exchange-dir <username> <dirname>

The directory name must be a single path component ([A-Za-z0-9._-], starting with a letter or digit), the user must exist on the machine (and not be uid 0), and the command fails if the directory already exists. If the ACL cannot be applied and verified, the new directory is removed.

Development

To install with development dependencies:

pip install -e ".[dev]"