Skip to main content

Cloudnet data submission tool

Project description

ACTRIS Cloudnet data submission tool

Tests

Installation

Linux/MacOS

If you have python and pip installed (python >= 3.8), run the command:

pip install cloudnet-submit

After that, you can use cloudnet-submit command to run the program.

Windows

If you are using Windows Subsystem for Linux, then the aforementioned Linux installation should work.

If you are using windows command prompt and have python and pip installed, you can install cloudnet-submit with pip:

pip install cloudnet-submit

Test if the cloudnet-submit command works:

cloudnet-submit --version

If not, you can use an alternative way to run the program:

python -m cloudnet_submit --version

Getting started

Configuration file

Generate a configuration file:

cloudnet-submit --generate-config

This will generate a cloudnet-config.toml file in your working directory.

Update your submission credentials in the user_account section, and update site, instrument, instrument_pid and path_fmt fields to match your instrument/model setup. Remove unnecessary instrument and model sections.

# cloudnet-config.toml
[user_account]
username       = "alice"
password       = "alicesSecretPassword"

[[instrument]]
site           = "hyytiala"
instrument     = "rpg-fmcw-94"
instrument_pid = "https://hdl.handle.net/21.12132/3.191564170f8a4686"
path_fmt       = "/home/alice/data/hyytiala/rpg-fmcw-94/%Y/%m/%Y%m%d_hyytiala.nc"

[[instrument]]
site           = "granada"
instrument     = "chm15k"
path_fmt       = "/home/alice/data/granada/chm/%Y-%m/chm_grandada_%Y-%m-%d-*.nc"

[[model]]
site           = "hyytiala"
model          = "ecmwf"
path_fmt       = "/home/alice/data/hyytiala/ecmwf/%Y/%Y%m%d_hyytiala_ecmwf.nc"

cloudnet-submit will look for files specified in the path_fmt field for a given measurement date.

Use the following format codes:

Directive Meaning Example
%Y Year with century 0001, ..., 2022
%y Year without century (zero-padded) 00, ..., 22
%m Month (zero-padded) 01, ..., 12
%d Day (zero-padded) 01, ..., 31

You can also use wildcard character * in path_fmt field.

By default, cloudnet-submit expects the cloudnet-config.toml file to be in your working directory. You can also use --config flag to define another location and name of the config file:

cloudnet-submit --config /path/to/your/config.toml

Usage

By default, cloudnet-submit submits data from the past three days.

Use --dry-run to list files that would be submitted:

cloudnet-submit --dry-run

Submit data to the Cloudnet dataportal:

cloudnet-submit

You can also set the number of days to be submitted (including today):

cloudnet-submit --last-ndays 5

You can also specify a date you want to submit:

cloudnet-submit --date 2022-06-21

Or a list of dates:

cloudnet-submit --date 2022-06-21 2022-05-1

Or a range of dates:

cloudnet-submit --from-date 2022-05-01 --to-date 2022-06-24

See all the options:

cloudnet-submit --help

Feedback and contact

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cloudnet-submit-0.0.3.tar.gz (9.7 kB view hashes)

Uploaded Source

Built Distribution

cloudnet_submit-0.0.3-py3-none-any.whl (10.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page