Skip to main content

Tools for documenting ocean bottom seismometer experiments and creating metadata

Project description

obsinfo

A system for for creating FDSN-standard data and metadata for ocean bottom seismometers using standardized, easy-to-read information files

Current goal

To come out with a first version (v1.x) schema for the information files. We ask for input from seismologists and ocean bottom seismometer manufacturers/operators about missing information/capabilities.
Existing questions can be found/modified in the gitlab ISSUES

Information files

The system is based on information files in JSON or YAML format, which can be used to create StationXML files and to record data preparation steps. The files duplicate the StationXML format where possible, deviating where necessary to reduce redundancy and to add functionality

There are 2 main file types:

Name Description Filled by When filled
network Deployed stations, their instruments and parameters OBS operator after a campaign
instrumentation including components (sensor, preamplifier, datalogger), stages and filters Instrument and component descriptions OBS operator and/or component manufacturers new/changed instruments, components, or calibrations

Each of these files can have subfiles referenced using the JSONref protocol. This allows, for example, one to make response and filter files to avoid repetition.

In principle (not yet implemented), the instrument_components files could be replaced by references to the AROL (Atomic Response Objects Library), but obsinfo provides a simpler and more standards-compliant way to specify the components, and it can automatically calculate response sensitivities based on gains and filter characteristics. Instrumentation files should also be able to make RESP-files and NRL directories (not implemented).

A third type of Information File is the campaign file, which allows the chief scientist to specify all of the stations and OBS operators used for a given experiment, as well as periods of data that they would like to see in order to validate the data preparation. For the moment, obsinfo doesn't do anything with these files, but can validate them.

Python code

The package name is obsinfo

obsinfo.network, obsinfo.instrumentation and obsinfo.instrument_components contain code to process the corresponding information files. obsinfo.misc contains code common to the above modules

obspy.addons contains modules specific to proprietary systems:

  • obspy.addons.LCHEAPO creates scripts to convert LCHEAPO OBS data to miniSEED using the lc2ms software
  • obspy.addons.SDPCHAIN creates scripts to convert basic miniSEED data to OBS-aware miniSEED using the SDPCHAIN software suite
  • obspy.addons.OCA creates JSON metadata in a format used by the Observatoire de la Cote d'Azur to create StationXML

Executables

The following command-line executables perform useful tasks:

  • obsinfo-validate: validates an information file against its schema
  • obsinfo-print: prints a summary of an information file
  • obsinfo-makeSTATIONXML: generates StationXML files from a network + instrumentation information files

The following command-line executables make scripts to run specific data conversion software:

  • obsinfo-make_LCHEAPO_scripts: Makes scripts to convert LCHEAPO data to miniSEED
  • obsinfo-make_SDPCHAIN_scripts: Makes scripts to drift correct miniSEED data and package them for FDSN-compatible data centers

Other subdirectories

obsinfo/data/schema

Contains JSON Schema for each file type.

obsinfo/_examples/

Contains example information files and scripts:

  • _examples/Information_Files contains a complete set of information files

    • .../network contains network files

    • .../instrumentation contains instrumentation files

    • .../sensor contains sensor files

    • .../preamplifier contains preamplifier files

    • .../datalogger contains datalogger files

Each one of the last three contain directories response and filter with the respective types of files. Other directories under Information_files contain auxiliary information files and are not part of the main hierarchy.

  • _examples/scripts contains bash scripts to look at and manipulate these files using the executables. Running these scripts is a good way to make sure your installation works, looking at the files they work on is a good way to start making your own information files.

Versioning

We use standard MAJOR.MINOR.MAINTENANCE version numbering but, while the system is in prerelease:

  • MAJOR==0

  • MINOR increments every time the information file structure changes in a non-backwards-compatible way

  • MAINTENANCE increments when the code changes or the file structure changes in a backwards-compatible way

More information

The program is on a Gitlab repository Documentation is on readthedocs.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

obsinfo-0.110.12.tar.gz (144.0 kB view details)

Uploaded Source

Built Distribution

obsinfo-0.110.12-py3-none-any.whl (227.9 kB view details)

Uploaded Python 3

File details

Details for the file obsinfo-0.110.12.tar.gz.

File metadata

  • Download URL: obsinfo-0.110.12.tar.gz
  • Upload date:
  • Size: 144.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/51.0.0.post20201207 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.8.5

File hashes

Hashes for obsinfo-0.110.12.tar.gz
Algorithm Hash digest
SHA256 139b81c6d376c001d567819d03727a043639476425ed7c174aed911daaf6472f
MD5 9177946c06ced43d839d0165ff835a7c
BLAKE2b-256 360621a47289bcb6e2347ad2ed468bc1de94cf7e3034bfc5f34fcc7d6b8338bf

See more details on using hashes here.

File details

Details for the file obsinfo-0.110.12-py3-none-any.whl.

File metadata

  • Download URL: obsinfo-0.110.12-py3-none-any.whl
  • Upload date:
  • Size: 227.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/51.0.0.post20201207 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.8.5

File hashes

Hashes for obsinfo-0.110.12-py3-none-any.whl
Algorithm Hash digest
SHA256 dd53269d1c385a9c7178b6f87707dae98c4116b23d65ced4446b60c5ae3694c2
MD5 2a1c51c3bf1409f644317f7c96a22e2f
BLAKE2b-256 f0561867d98c8a6cc75080ff94ccab0209207658a0969bcc53e1f370f37b15b4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page