Skip to main content

EvaSuite (Evaluation Suite for climate data): a framework for evaluation and visualization of regional climate model simulations

Project description

EvaSuite – Evaluation Suite for Climate Data

EvaSuite Logo

Introduction

Evaluation Suite (EvaSuite) is a modular software framework for the standardised evaluation of regional climate model (RCM) simulations against observational and reference datasets, including model sensitivity analysis. It is designed for high-performance computing platforms and addresses the need for transparent, reproducible, and flexible evaluation workflows for RCMs. EvaSuite combines data harmonisation, spatial and temporal remapping, statistical evaluation, and visualisation within a unified fully configurable, end-to-end workflow. EvaSuite is an open-source evaluation framework maintained by the CLM-Community. It provides a covering preprocessing, regridding, statistical evaluation, and visualization.

All evaluation workflows in EvaSuite are controlled via YAML configuration files, which define:

  • the system settings (external dependencies)
  • the input datasets (model simulations and reference observations)
  • preprocessing steps (e.g. regridding, masking, temporal aggregation)
  • evaluation metrics (e.g. bias, RMSE, correlation, quantiles)
  • visualization settings (maps, time series, Taylor diagrams)

For a comprehensive introduction to EvaSuite please visit our documentation page.

Key Features

  • End-to-end evaluation workflow
    • Data harmonisation, regridding, metric computation, visualisation
  • YAML-driven configuration
    • Fully reproducible and automation-friendly workflows
  • HPC-ready design
    • Optimised for SLURM-based execution and batch processing
  • Flexible data support
    • CF-compliant NetCDF datasets (models, reanalysis, observations)
  • Advanced diagnostics
    • Bias, RMSE, correlation, quantile-based metrics, significance testing
  • Integrated visualisation
    • Maps, time series, QQ plots, Taylor diagrams
  • Modular extensions
    • GeoPackage, GriddedStations, ScoPi, PlotSmart, UrbanPlot

General Information

The history and recent updates of EvaSuite provide an overview of the framework evolution and newly introduced features. Detailed instructions for installation and system setup are described in the Installation Guide, including environment preparation and known issues. EvaSuite can be executed in different modes (main, interactive, debug), as explained in the running documentation, allowing flexible usage for both batch HPC workflows and exploratory analysis. User-specific customization of plots, maps, and diagnostics is controlled via configuration files, documented in the user settings sections for plots, maps and Taylor diagrams. A comprehensive collection of reproducible workflows is available in the examples, demonstrating typical evaluation setups and wrapper-based pipelines. Additional technical details, module descriptions, and theoretical background are provided in the full documentation. For advanced applications and extensions (e.g. SPICE workflows), see the dedicated SPICE documentation. Modular extensions presented in separate projects GeoPackage, GriddedStations, ScoPi and UrbanPlot

Getting help

The easiest way to get help, if you cannot find the answer in the documentation in our docs, is to open an issue on GitLab.

Citation

If you use EvaSuite in your research, please cite:

Petrik, R., Geyer, B., Churiulin, E., Rockel, B., & Braun, C. (2026). EvaSuite (Evaluation Suite for climate data) (v1.0.1). Zenodo. https://doi.org/10.5281/zenodo.19223685

BibTeX

@software{petrik2026evasuite,
  author       = {Petrik, Ronny and Geyer, Beate and Churiulin, Evgenii and Rockel, Burkhardt and Braun, Christoph},
  title        = {EvaSuite (Evaluation Suite for climate data)},
  year         = {2026},
  version      = {v1.0.1},
  publisher    = {Zenodo},
  doi          = {10.5281/zenodo.19223685},
  url          = {https://doi.org/10.5281/zenodo.19223685}
}

Contributing

If you would like to contribute a new diagnostic or feature, please have a join to the CLM-Community and read CLM-Community contribution guidelines.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hereon_evasuite-1.0.2.tar.gz (245.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hereon_evasuite-1.0.2-py3-none-any.whl (256.1 kB view details)

Uploaded Python 3

File details

Details for the file hereon_evasuite-1.0.2.tar.gz.

File metadata

  • Download URL: hereon_evasuite-1.0.2.tar.gz
  • Upload date:
  • Size: 245.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.0

File hashes

Hashes for hereon_evasuite-1.0.2.tar.gz
Algorithm Hash digest
SHA256 e598f5157eaec07dd337bd3cc85265a75d2353e4f5897defc04338e7c4cbdfeb
MD5 41f070c83648c8920f8746593331ce4d
BLAKE2b-256 dcdaebdad4496d91f68d28195a8dc8559371c5153e2bf37d5494cb90388b86e3

See more details on using hashes here.

File details

Details for the file hereon_evasuite-1.0.2-py3-none-any.whl.

File metadata

File hashes

Hashes for hereon_evasuite-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 5c9c8588df6bccde3edd67f7eb182fc30a06f3dd1b992307c61ce96dc6779302
MD5 b1ceb22b7348f84f73152880fe53be5c
BLAKE2b-256 bd1e93d8d323c57e803d6015fcaa6d5c5857c2d5fe58baa84dd02756a6f274c2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page