Skip to main content

Python RINEX 2/3 NAV/OBS reader that is very fast

Project description

Travis CI Coverage Status Build status PyPi versions PyPi wheels Maintainability PyPi Download stats Xarray badge

GeoRinex

RINEX 3 and RINEX 2 reader in Python -- reads NAV and OBS GPS RINEX data into xarray.Dataset for easy use in analysis and plotting. This gives remarkable speed vs. legacy iterative methods, and allows for HPC / out-of-core operations on massive amounts of GNSS data.

Writes to NetCDF4 (subset of HDF5), with zlib compression. This is a couple order of magnitude speedup in reading/converting RINEX data and allows filtering/processing of gigantic files too large to fit into RAM.

Another key advantage of GeoRinex is the Xarray base class, that allows all the database-like indexing power of Pandas to be unleashed.

GeoRinex works in Python ≥ 3.6.

RINEX plot

Install

python -m pip install -e .

Usage

The simplest command-line use is through the top-level ReadRinex script.

  • Read RINEX3 or RINEX 2 Obs or Nav file: ReadRinex myrinex.XXx
  • Read NetCDF converted RINEX data: ReadRinex myrinex.nc

It's suggested to save the GNSS data to NetCDF4 (a subset of HDF5) with the -ooption, as NetCDF4 is also human-readable, yet say 1000x faster to load than RINEX.

You can also of course use the package as a python imported module as in the following examples. Each example assumes you have first done:

import georinex as gr

read Rinex

This convenience function reads any possible Rinex 2/3 OBS/NAV or .nc file:

obs,nav = gr.readrinex('tests/demo.10o')

read Obs

If you desire to specifically read a RINEX 2 or 3 OBS file:

obs = gr.rinexobs('tests/demo_MO.rnx')

This returns an xarray.Dataset of data within the .XXo observation file.

NaN is used as a filler value, so the commands typically end with .dropna(dim='time',how='all') to eliminate the non-observable data vs time. As per pg. 15-20 of RINEX 3.03 specification, only certain fields are valid for particular satellite systems. Not every receiver receives every type of GNSS system. Most Android devices in the Americas receive at least GPS and GLONASS.

get OBS header

To get a dict() of the RINEX file header:

hdr = gr.rinexheader('myfile.rnx')

Index OBS data

assume the OBS data from a file is loaded in variable obs.

Select satellite(s) (here, G13) by

obs.sel(sv='G13').dropna(dim='time',how='all')

Pick any parameter (say, L1) across all satellites and time (or index via .sel() by time and/or satellite too) by:

obs['L1'].dropna(dim='time',how='all')

Indexing only a particular satellite system (here, Galileo) using Boolean indexing.

import georinex as gr
obs = gr.rinexobs('myfile.o', use='E')

would load only Galileo data by the parameter E. ReadRinex allow this to be specified as the -use command line parameter.

If however you want to do this after loading all the data anyway, you can make a Boolean indexer

Eind = obs.sv.to_index().str.startswith('E')  # returns a simple Numpy boolean 1-D array
Edata = obs.isel(sv=Eind)  # any combination of other indices at same time or before/after also possible

Plot OBS data

Plot for all satellites L1C:

from matplotlib.pyplot import figure, show
ax = figure().gca()
ax.plot(obs.time, obs['L1C'])
show()

Suppose L1C psuedorange plot is desired for G13:

obs['L1C'].sel(sv='G13').dropna(dim='time',how='all').plot()

read Nav

If you desire to specifically read a RINEX 2 or 3 NAV file:

nav = gr.rinexnav('tests/demo_MN.rnx')

This returns an xarray.Dataset of the data within the RINEX 3 or RINEX 2 Navigation file. Indexed by time x quantity

Index NAV data

assume the NAV data from a file is loaded in variable nav. Select satellite(s) (here, G13) by

nav.sel(sv='G13')

Pick any parameter (say, M0) across all satellites and time (or index by that first) by:

nav['M0']

Analysis

A significant reason for using xarray as the base class of GeoRinex is that big data operations are fast, easy and efficient. It's suggested to load the original RINEX files with the -use or use= option to greatly speed loading and convserve memory.

A copy of the processed data can be saved to NetCDF4 for fast reloading and out-of-core processing by:

obs.to_netcdf('process.nc', group='OBS')

georinex.__init.py__ shows examples of using compression and other options if desired.

Join data from multiple files

Please see documentation for xarray.concat and xarray.merge for more details. Assuming you loaded OBS data from one file into obs1 and data from another file into obs2, and the data needs to be concatenated in time:

obs = xarray.concat((obs1, obs2), dim='time')

The xarray.concatoperation may fail if there are different SV observation types in the files. you can try the more general:

obs = xarray.merge((obs1, obs2))

Converting to Pandas Dataframes

Although Pandas DataFrames are 2-D, using say df = nav.to_dataframe() will result in a reshaped 2-D DataFrame. Satellites can be selected like df.loc['G12'].dropna(0, 'all') using the usual Pandas Multiindexing methods.

Notes

RINEX 3.03 specification

RINEX OBS reader algorithm

  1. read overall OBS header (so we know what to expect in the rest of the OBS file)
  2. fill the xarray.Dataset with the data by reading in blocks -- another key difference from other programs out there, instead of reading character by character, I ingest a whole time step of text at once, helping keep the processing closer to CPU cache making it much faster.

Data

For capable Android devices, you can log RINEX 3 using the built-in GPS receiver.

Here is a lot of RINEX 3 data to work with:

Hatanaka compressed RINEX .crx not supported

The compressed Hatanaka .crx or .crx.gz files are not yet supported. There are distinct from the supported .rnx, .gz, or .zip RINEX files.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

georinex-1.5.0.tar.gz (17.7 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page