Skip to main content

gms_preprocessing - Spatial and spectral homogenization of satellite remote sensing data.

The goal of the gms_preprocessing Python library is to provide a fully automatic pre-precessing pipeline for spatial and spectral fusion (i.e., homogenization) of multispectral satellite image data. Currently it offers compatibility to Landsat-5, Landsat-7, Landsat-8, Sentinel-2A and Sentinel-2B.

Status

https://gitext.gfz-potsdam.de/geomultisens/gms_preprocessing/badges/master/pipeline.svg https://gitext.gfz-potsdam.de/geomultisens/gms_preprocessing/badges/master/coverage.svg https://img.shields.io/pypi/v/gms_preprocessing.svg https://img.shields.io/conda/vn/conda-forge/gms_preprocessing.svg https://img.shields.io/pypi/l/gms_preprocessing.svg https://img.shields.io/pypi/pyversions/gms_preprocessing.svg

See also the latest coverage report and the nosetests HTML report.

Features

Level-1 processing:

  • data import and metadata homogenization (compatibility: Landsat-5/7/8, Sentinel-2A/2B)

  • equalization of acquisition- and illumination geometry

  • atmospheric correction (using SICOR)

  • correction of geometric errors (using AROSICS)

Level-2 processing:

  • spatial homogenization

  • spectral homogenization (using SpecHomo)

  • estimation of accuracy layers

=> application oriented analysis dataset

Getting started

Usage via WebApp

The recommended way to use gms_preprocessing is to setup the WebApp (see the gms-vis repository) providing a UI for GeoMultiSens. Using this UI, existing satellite data can be explored, filtered and selected for processing. New data homogenization jobs (using gms_preprocessing) can be defined and started. All configuration parameters of gms_preprocessing are accessible in the UI.

WebApp Screenshot

Usage via console interface

Homogenization jobs can also be created and started using the command line interface. Documentation can be found here.

Here is a small example:

# start the job with the ID 123456 and override default configuration with the given one.
>>> run_gms.py jobid 123456 --json_config /path/to/my/config.json

There is a default configuration file, called options_default.json. This file contains the documentation for all the available configuration parameters.

Usage via Python API

There is also a Python API that allows to setup and start homogenization jobs by a Python function call.

This is an example:

from gms_preprocessing import ProcessController

configuration = dict(
    db_host='localhost',
    CPUs=20
    )

PC = ProcessController(job_ID=123456, **configuration)
PC.run_all_processors()

Possible configuration arguments can be found here.

History / Changelog

You can find the protocol of recent changes in the gms_preprocessing package here.

License

gms_preprocessing - Spatial and spectral homogenization of satellite remote sensing data.

Copyright 2020 Helmholtz Centre Potsdam GFZ German Research Centre for Geosciences, Potsdam, Germany

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program. If not, see <http://www.gnu.org/licenses/>.

Contact

Daniel Scheffler

Helmholtz Centre Potsdam GFZ German Research Centre for Geoscienes
Section 1.4 Remote Sensing
Telegrafenberg
14473 Potsdam
Germany

Credits

The development of the gms_preprocessing package was funded by the German Federal Ministry of Education and Research (BMBF, project grant code: 01 IS 14 010 A-C).

The package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

Landsat-5/7/8 satellite data and SRTM/ASTER digital elevation models have been provided by the US Geological Survey. Sentinel-2 data have been provided by ESA.

Release files for gms-preprocessing 0.19.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for gms-preprocessing 0.19.3
File Size Uploaded
gms_preprocessing-0.19.3.tar.gz 41.2 MB Details

Release files / gms_preprocessing-0.19.3.tar.gz

Download URL gms_preprocessing-0.19.3.tar.gz
Size 41.2 MB
Tags Source
SHA-256 checksum
How to use checksums
f475dafa830cd6821522a8bbb84594e4c0e809b3b09089c27a924e82c8682d33
BLAKE2b-256 checksum
How to use checksums
dabcb7c81be86a3a5d23b4267a286f3295a166be867e5006c1cc85aae045a5a6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/49.6.0.post20201009 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.7.8

Release history Release notifications | RSS feed

This release

0.19.3 This release

1 release file

0.19.2

1 release file

0.19.1

1 release file

0.19.0

1 release file

0.18.12

1 release file

0.18.9

1 release file

0.18.8

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page