rainfallqc 0.2.5

Quality control for rainfall data

Provides methods for running rainfall quality control.

NOTEBOOK DEMO AVAILABLE HERE

Please email [e-mail] if you have any questions.

Installation

RainfallQC can be installed from PyPi:

pip install rainfallqc

Example use

Example 1. - Individual quality checks on single rain gauge

from rainfallqc import gauge_checks, comparison_checks

data = pl.read_csv("rain_gauge_data.csv")
intermittency_flag = gauge_checks.check_intermittency(data, target_gauge_col="rain_mm")

Example 2. - Neighbourhood quality checks for the global sub-daily rain gauge network (GSDR)

from rainfallqc import neighbourhood_checks
from rainfallqc.utils import data_readers

distance_threshold = 50  # km
n_closest = 10 # number of closest neighbours to consider
min_overlap_days = 500  # minimum overlapping days to be considered a neighbour

gsdr_obj = data_readers.GSDRNetworkReader(path_to_gsdr_dir="path/to/GSDR/data")

nearby_ids = list(
    gsdr_obj.get_nearest_overlapping_neighbours_to_target(
        target_id="DE_00310", distance_threshold=distance_threshold, n_closest=n_closest, min_overlap_days=min_overlap_days
    )
)
nearby_ids.append(target_id)
nearby_data_paths = gsdr_obj.metadata.filter(pl.col("station_id").is_in(nearby_ids))["path"]

# Load those nearest gauges from network metadata
gsdr_network = gsdr_obj.load_network_data(data_paths=nearby_data_paths)

# Run wet neighbour check
extreme_wet_flags = neighbourhood_checks.check_wet_neighbours(
    gsdr_network,
    target_gauge_col="rain_mm_DE_02483",
    neighbouring_gauge_cols=gsdr_network.columns[1:],  # exclude time
    time_res="hourly",
    wet_threshold=1.0, # threshold for rainfall intensity to be considered
    min_n_neighbours=5, # number of neighbours needed for comparison
    n_neighbours_ignored=0, # ignore no neighbours and include all
)

Example 3. - Applying a framework of QC methods (e.g. IntenseQC)

from rainfallqc.qc_frameworks import apply_qc_framework

# 1. Decide which QC methods of IntenseQC will be run
qc_framework = "IntenseQC"
qc_methods_to_run = ["QC1", "QC8", "QC9", "QC10", "QC11", "QC12", "QC14", "QC15", "QC16"]

# 2 Decide which parameters for QC
qc_kwargs = {
    "QC1": {"quantile": 5},
    "QC14": {"wet_day_threshold": 1.0, "accumulation_multiplying_factor": 2.0},
    "QC16": {
        "neighbouring_gauge_cols": daily_gpcc_network.columns[2:],
        "wet_threshold": 1.0,
        "min_n_neighbours": 5,
        "n_neighbours_ignored": 0,
    },
    # Shared defaults applied to all
    "shared": {
        "target_gauge_col": "rain_mm_DE_02483",
        "gauge_lat": gpcc_metadata["latitude"],
        "gauge_lon": gpcc_metadata["longitude"],
        "time_res": "daily",
        "data_resolution": 0.1,
    },
}

# 3. Run QC methods on network data
qc_result = apply_qc_framework.run_qc_framework(
    daily_gpcc_network, qc_framework=qc_framework, qc_methods_to_run=qc_methods_to_run, qc_kwargs=qc_kwargs
)

Other examples

Also see example Jupyter Notebooks here: https://github.com/Thomasjkeel/RainfallQC-notebooks/tree/main

Documents

• Free software: GNU General Public License v3

• Documentation: https://rainfallqc.readthedocs.io.

Features

• 25 rainfall QC methods (all from IntenseQC)

• editable parameters so you can tweak thresholds, streak or accumulation lengths, and distances to neighbouring gauges

Credits

Based on the IntenseQC: https://github.com/nclwater/intense-qc/tree/master

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.