ISMN quality control procedures for in situ soil moisture time series
Citation
If you use the software in a publication then please cite:
Dorigo, W.A. , Xaver, A. Vreugdenhil, M. Gruber, A., Hegyiova, A. Sanchis-Dufau, A.D., Zamojski, D. , Cordes, C., Wagner, W., and Drusch, M. (2013). Global Automated Quality Control of In situ Soil Moisture data from the International Soil Moisture Network. Vadose Zone Journal, 12, 3, doi:10.2136/vzj2012.0097
Please also cite the correct version of this package. Click on the badge below, select the correct version and copy the text under “Cite as”.
Installation
For installation we recommend Miniconda. So please install it according to the official instructions. As soon as the conda command is available in your shell you can continue:
conda install -c conda-forge pandas scipy numpy
This following command will install the flagit pip package:
pip install flagit
To create a full development environment with conda, the environment.yml file in this repository can be used:
git clone git@github.com:TUW-GEO/flagit.git flagit
cd flagit
conda create -n flagit python=3.10 # or any supported python version
conda activate flagit
conda env update -f environment.yml -n flagit
python setup.py develop
After that you should be able to run:
python setup.py test
to run the test suite.
Description
The International Soil Moisture Network (ISMN) quality control procedures are used to detect implausible and dubious measurements in hourly situ soil moisture time series. When downloading data at ISMN all variable-data are provided with additional tags in column “qflag”, which can be one of three main categories: C (exceeding plausible geophysical range), D (questionable/dubious) or G (good).
code |
description |
ancillary data required |
|---|---|---|
C01 |
soil moisture < 0 m³/m³ |
|
C02 |
soil moisture > 0.60 m³/m³ |
|
C03 |
soil moisture > saturation point (based on HWSD) |
HWSD sand, clay and organic content |
D01 |
negative soil temperature (in situ) |
in situ soil temperature |
D02 |
negative air temperature (in situ) |
in situ air temperature |
D03 |
negative soil temperature (GLDAS) |
GLDAS soil temperature |
D04 |
rise in soil moisture without precipitation (in situ) |
in situ precipitation |
D05 |
rise in soil moisture without precipitation (GLDAS) |
GLDAS precipitation |
D06 |
spikes |
|
D07 |
negative breaks (drops) |
|
D08 |
positive breaks (jumps) |
|
D09 |
constant low values following negative break |
|
D10 |
saturated plateaus |
|
G |
good |
At ISMN, ancillary data sets are used for flags C03, D01 - D05 (see table above). Since we do not provide ancillary data, we kindly ask users to either provide their own ancillary in situ and GLDAS data (including a soil moisture saturation value for flag C03) in the input (pandas.DataFrame), or accept the limitation of the quality control to flags without ancillary requirements.
We hope to update the functionality of this package to facilitate the inclusion of ancillary data.
For a detailed description of the quality control procedures see paper on Global Automated quality control.
Contribute
We would be happy if you would like to contribute. Please raise an issue explaining what is missing or if you find a bug. We will also gladly accept pull requests against our main branch for new features or bug fixes.
Guidelines
If you want to contribute please follow these steps:
Fork the flagit repository to your account
Clone the repository
make a new feature branch from the flagit main branch
Add your feature
Please include tests for your contributions in one of the test directories. We use unittest so a simple function called test_my_feature is enough
submit a pull request to our main branch
Note
This project has been set up using PyScaffold 3.2.3. For details and usage information on PyScaffold see https://pyscaffold.org/.
Metadata
Release files for flagit 0.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| flagit-0.3.tar.gz | 41.4 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| flagit-0.3-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Total release size: 55.1 kB
Release files / flagit-0.3.tar.gz
| Download URL | flagit-0.3.tar.gz |
|---|---|
| Size | 41.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
fad8873177783a3843af84c6e9ecac5d4a3bde94f64888c89f231b3f537502d5
|
|
BLAKE2b-256 checksum How to use checksums |
c1d49b075b23d9b584dbe507d5eb71fd4ee03961ecb29cb31e0cef83a011782c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.8.20
|
Release files / flagit-0.3-py2.py3-none-any.whl
| Download URL | flagit-0.3-py2.py3-none-any.whl |
|---|---|
| Size | 13.7 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
1c002f7ef1b6c2ec9cbeb5d9a1103131e2ba150a98c78409aa2163c940e210d6
|
|
BLAKE2b-256 checksum How to use checksums |
058a92f212cbdfad1576b8927a5962c2448367a9e80b4bfe4cecbfd175385b73
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.8.20
|
Security for flagit 0.3
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.