rda_python_metrics

RDA Python package to gather and view data usage metrics for the NSF NCAR Geoscience Data Exchange (GDEX).

Programs

The package provides two categories of programs:

Run as gdexdata via setuid (requires setup below):

Command Connector script Description
logarch setuid_logarch Archive RDA log files (web, TDS, AWS, OSDF, dssdb) to the DECSDATA area

Run as current user (no setuid required):

Command Description
fillawsusage Fill AWS usage metrics into the database
fillcdgusage Fill CDG usage metrics into the database
fillcodusage Fill COD usage metrics into the database
fillcountry Fill country information into the database
fillendtime Fill end times for usage records
fillgdexusage Fill GDEX usage metrics into the database
fillglobususage Fill Globus transfer usage metrics into the database
fillipinfo Fill IP geolocation info into the database
filloneorder Fill metrics for a single order
fillosdfusage Fill OSDF usage metrics into the database
fillrdadb Fill RDA database usage metrics
filltdsusage Fill TDS (THREDDS) usage metrics into the database
fillzenodousage Fill Zenodo usage metrics into the database
viewallusage View combined usage statistics
viewawsusage View AWS usage statistics
viewcheckusage View usage check results
viewcodusage View COD usage statistics
viewordusage View order usage statistics
viewosdfusage View OSDF usage statistics
viewrqstusage View request usage statistics
viewtdsusage View TDS usage statistics
viewwebfile View web file access records
viewwebusage View web usage statistics

Environment setup

Create a Python environment first; package installs in the next section run inside whichever environment you activate here.

Option A — Python venv (DECS machines)

python3 -m venv $ENVHOME          # e.g. /glade/u/home/gdexdata/gdexmsenv
source $ENVHOME/bin/activate

Option B — Conda (DAV/Casper)

conda create --prefix $ENVHOME python=3.12   # e.g. /glade/work/gdexdata/conda-envs/pg-gdex
conda activate $ENVHOME

Installing rda-python-metrics

Pick whichever install mode fits your workflow. All four pull in the transitive dependencies (rda_python_common, rda_python_setuid, geoip2, ipinfo, httplib2, dnspython, unidecode, urllib3>=2.5.0, requests>=2.33.0, idna>=3.10) automatically.

For local development, clone this repo alongside your project and install it in editable mode so that changes are picked up without re-installing:

git clone https://github.com/NCAR/rda-python-metrics.git
cd rda-python-metrics
pip install -e .

To test a specific branch (e.g. an in-progress feature or fix branch), pass -b/--branch to git clone:

git clone -b <branch-name> https://github.com/NCAR/rda-python-metrics.git
cd rda-python-metrics
pip install -e .

For a regular (non-editable) install from a checkout:

pip install /path/to/rda-python-metrics

For a production install on a system that uses the published distribution:

pip install rda_python_metrics

Setuid Setup

logarch runs as the common user PGLOG['COMMONUSER'] (default gdexdata) via the rda_python_setuid mechanism, which is pulled in automatically as a dependency. After pip install above, choose one of the wiring options below.

Note: If rda_python_setuid is already installed and fully set up in your environment, you can skip the compile step (-c/--compile) and the optional pgstart step (-p/--pgstart). The -l/--link step is still required to wire up this package's own setuid program.

Full setuid install (requires sudo access to COMMONUSER)

Run these steps once per environment:

# 1. Compile the pywrapper C binary (once per environment):
pywrapper-install -c|--compile -n|--username gdexdata

# 2. Wire up logarch as a setuid entry (or use 'all' to link every setuid_* at once):
pywrapper-install -l|--link logarch
pywrapper-install -l|--link all

# 3. Optionally, install a pgstart_<loginname> binary so <loginname> (any
#    user in the same group as PGLOG['COMMONUSER']) can run commands as
#    themselves.  Run either by PGLOG['ADMINUSER'] (default zji, if it has
#    'sudo -u <loginname>'), or by <loginname> directly:
pywrapper-install -p|--pgstart -n|--username <loginname>

pywrapper-install with no arguments displays the full user guide.

Simple install (no sudo required, runs as current user)

Users who do not need the setuid mechanism can create a direct symlink instead:

pywrapper-install -l|--link logarch -s|--simple
pywrapper-install -l|--link all -s|--simple   # or link every setuid_* at once

This creates bin/logarch -> bin/setuid_logarch and logarch runs as the current user with no privilege change.

Update an existing installation (no sudo required)

When the package is upgraded and a new pywrapper.c is bundled, recompile and reinstall all setuid binaries using the existing pgstart_* binaries:

pywrapper-install -u|--update

Setup guide

The shared setuid setup guide is shown automatically if setuid_logarch is invoked directly before the setuid wrapper has been configured.

Project links

Data verified by PyPI on Aug 26, 2026
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for zaihuaji from gravatar.com zaihuaji

Credits

PyPI data
Data sourced directly from PyPI's database.

Author: Zaihua Ji

GitHub Statistics

Data verified by PyPI on Aug 26, 2026
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License

MIT License

Requires

Python >=3.7

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rda_python_metrics-3.0.5.tar.gz (118.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

rda_python_metrics-3.0.5-py3-none-any.whl (232.2 kB view details)

Uploaded Python 3

File details

Details for the file rda_python_metrics-3.0.5.tar.gz.

File metadata

  • Download URL: rda_python_metrics-3.0.5.tar.gz
  • Upload date:
  • Size: 118.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for rda_python_metrics-3.0.5.tar.gz
Algorithm Hash digest
SHA256 c2a717ca86da5992e6dd0859d823d7f3144fb9b8cf65b7e1b3bfa1bec9d5a7f4
MD5 e84e94b3a175c4e148aa999f79b90134
BLAKE2b-256 17558b689d1484daef8bb15ffccd142ea5d3d31eca0c8078bb68288173a15074

See more details on using hashes here.

Provenance

The following attestation bundles were made for rda_python_metrics-3.0.5.tar.gz:

Publisher: publish.yml on NCAR/rda-python-metrics

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file rda_python_metrics-3.0.5-py3-none-any.whl.

File metadata

File hashes

Hashes for rda_python_metrics-3.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 6decf52e56174934f68757951d6801c725f1608f4e4fa46262b90bc207603656
MD5 82b3cc4d25a35ee0c427940084aa4992
BLAKE2b-256 c01cf49fb5820b1a6640ae1a4b96458a0659735af82726694672d97cde1efa73

See more details on using hashes here.

Provenance

The following attestation bundles were made for rda_python_metrics-3.0.5-py3-none-any.whl:

Publisher: publish.yml on NCAR/rda-python-metrics

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

3.0.5 This release

2 files

3.0.4

2 files

3.0.3

2 files

3.0.2

2 files

2.0.6

2 files

2.0.5

2 files

2.0.4

2 files

2.0.3

2 files

2.0.2

2 files

2.0.1

2 files

2.0.0

2 files

1.0.51

2 files

1.0.50

2 files

1.0.49

2 files

1.0.48

2 files

1.0.47

2 files

1.0.46

2 files

1.0.45

2 files

1.0.44

2 files

1.0.43

2 files

1.0.42

2 files

1.0.41

2 files

1.0.40

2 files

1.0.39

2 files

1.0.38

2 files

1.0.37

2 files

1.0.36

2 files

1.0.35

2 files

1.0.34

2 files

1.0.33

2 files

1.0.32

2 files

1.0.31

2 files

1.0.30

2 files

1.0.28

2 files

1.0.27

2 files

1.0.26

2 files

1.0.25

2 files

1.0.24

2 files

1.0.23

2 files

1.0.22

2 files

1.0.21

2 files

1.0.20

2 files

1.0.18

2 files

1.0.17

2 files

1.0.16

2 files

1.0.15

2 files

1.0.14

2 files

1.0.12

2 files

1.0.11

2 files

1.0.10

2 files

1.0.9

2 files

1.0.8

2 files

1.0.7

2 files

1.0.6

2 files

1.0.5

2 files

1.0.4

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page