Skip to main content

A Python wrapper to parallelize GAMIT executions

Project description

Parallel.GAMIT

A Python wrapper to manage GNSS data and metadata and parallelize GAMIT executions

Author: Demián D. Gómez

Parallel.GAMIT (PGAMIT) is a Python software solution for parallel GNSS processing of large regional or global networks. It incorporates a metadata and RINEX data management tool that guarantees a consistent archive. It relies on Postgres SQL (https://www.postgresql.org/) to store station metadata and the GPSPACE Precise-Point-Positioning (PPP) software (see installation instructions) to obtain reliable daily a-priori coordinates for GAMIT.

The software can be installed as a Python package (see INSTALL.md) allowing to import modules to perform time series analysis and extraction of trajectory parameters from the database.

PGAMIT also includes a backend (see branch web-ui-backend) and web frontend (see branch web-ui-frontend) that can be easily deployed to edit station related metadata (such as observation files and pictures) and processing metadata. The backend was developed in django and the frontend was developed using node.js.

PGAMIT uses dispy (https://github.com/pgiri/dispy) to create Python pickles that are sent to local or remote nodes for execution. PGAMIT has the ability to split a network of GNSS stations into subnetworks for processing in GAMIT (when the network is larger than 50 stations, depending on PGAMIT's configuration). The parallel execution is performed per day-subnetwork. In other words, a GAMIT pickle is built for each subnetwork-day being processed and sent to the available nodes. At the end of each PGAMIT run, the subnetworks are combined with GLOBK and inserted as records in the Postgres database for later use. Some routines (such as the SINEX parser) are modified versions of the code from @softwarespartan (https://github.com/softwarespartan).

Some of the tasks that PGAMIT can perform include:

  • Scan a directory structure containing RINEX files and add them to the Postgres database.
  • Manage station metadata in GAMIT's station info format with consistency check of the records.
  • Add new RINEX data to the database by geolocation, i.e. the data is incorporated not by station name but by running PPP and finding the corresponding station in the DB. This avoids problems with duplicate station codes and misidentified RINEX files.
  • Handle ocean loading coefficients to correct the PPP and GAMIT coordinates.
  • Plot PPP time series using Bevis and Brown's (2014) extended trajectory model.
  • Manage (i.e. add, merge, delete) GNSS stations.
  • Parse zenith tropospheric delays and store them in the database.
  • Stack the GAMIT solutions to produce regional or global reference frames following Bevis and Brown's (2014) and Gómez et al (2022).
  • Station name duplicate-tolerance by using a three-letter network code. Although this is not supported by GAMIT, PGAMIT converts duplicate station codes (stored in different networks) to unique IDs that are used during processing, which are later converted back to the original names after the GLOBK combination of the subnetworks.
  • Because all the information is stored in a relational database, PGAMIT can handle very large datasets easily (it has been tested with ~ 14M station-days but Postgres can easily handle more than 100 million records). Also, the relational database guarantees then consistency of the data and does not allow accidental duplicates in metadata.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pgamit-1.2.47.tar.gz (4.0 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pgamit-1.2.47-py3-none-any.whl (384.8 kB view details)

Uploaded Python 3

File details

Details for the file pgamit-1.2.47.tar.gz.

File metadata

  • Download URL: pgamit-1.2.47.tar.gz
  • Upload date:
  • Size: 4.0 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for pgamit-1.2.47.tar.gz
Algorithm Hash digest
SHA256 6ae31b2d1976e3f9cf23e5ad001737f3c957860607a1fdb55a59ef83867fbd7c
MD5 becd66a21b0918c32f9a9a2809ac1ee2
BLAKE2b-256 4327f0a4862883ba8fda02e44f00d86a03bd52d5bf159d9643aaaed395e0fde4

See more details on using hashes here.

Provenance

The following attestation bundles were made for pgamit-1.2.47.tar.gz:

Publisher: publish.yml on demiangomez/Parallel.GAMIT

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pgamit-1.2.47-py3-none-any.whl.

File metadata

  • Download URL: pgamit-1.2.47-py3-none-any.whl
  • Upload date:
  • Size: 384.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for pgamit-1.2.47-py3-none-any.whl
Algorithm Hash digest
SHA256 421703e59262c31c63297fe13761e57066fd310760032a39e34b6c8a1cf41e74
MD5 055503ff55c1bdf90587aa6a7ff51b6a
BLAKE2b-256 b39f0c306c5283b52a12796beb7075f4ac2f8184030f34bab362612be2f7427e

See more details on using hashes here.

Provenance

The following attestation bundles were made for pgamit-1.2.47-py3-none-any.whl:

Publisher: publish.yml on demiangomez/Parallel.GAMIT

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page