hereon-evasuite 0.0.4

EvaSuite (Evaluation Suite for climate data)

EvaSuite – Evaluation Suite for Climate Data

• Documentation
• EvaSuite Installation
• EvaSuite Examples
• EvaSuite Test Data
• EvaSuite Extensions

Introduction

Evaluation Suite (EvaSuite) is a modular software framework for the standardised evaluation of regional climate model (RCM) simulations against observational and reference datasets, including model sensitivity analysis. It is designed for high-performance computing platforms and addresses the need for transparent, reproducible, and flexible evaluation workflows for RCMs. EvaSuite combines data harmonisation, spatial and temporal remapping, statistical evaluation, and visualisation within a unified fully configurable, end-to-end workflow. EvaSuite is an open-source evaluation framework maintained by the CLM-Community. It provides a covering preprocessing, regridding, statistical evaluation, and visualization.

All evaluation workflows in EvaSuite are controlled via YAML configuration files, which define:

• the system settings (external dependencies)
• the input datasets (model simulations and reference observations)
• preprocessing steps (e.g. regridding, masking, temporal aggregation)
• evaluation metrics (e.g. bias, RMSE, correlation, quantiles)
• visualization settings (maps, time series, Taylor diagrams)

For a comprehensive introduction to EvaSuite please visit our documentation page.

Key Features

• End-to-end evaluation workflow
  • Data harmonisation, regridding, metric computation, visualisation
• YAML-driven configuration
  • Fully reproducible and automation-friendly workflows
• HPC-ready design
  • Optimised for SLURM-based execution and batch processing
• Flexible data support
  • CF-compliant NetCDF datasets (models, reanalysis, observations)
• Advanced diagnostics
  • Bias, RMSE, correlation, quantile-based metrics, significance testing
• Integrated visualisation
  • Maps, time series, QQ plots, Taylor diagrams
• Modular extensions
  • GeoPackage, GriddedStations, ScoPi, PlotSmart, UrbanPlot

General Information

The history and recent updates of EvaSuite provide an overview of the framework evolution and newly introduced features. Detailed instructions for installation and system setup are described in the Installation Guide, including environment preparation and known issues. EvaSuite can be executed in different modes (main, interactive, debug), as explained in the running documentation, allowing flexible usage for both batch HPC workflows and exploratory analysis. User-specific customization of plots, maps, and diagnostics is controlled via configuration files, documented in the user settings sections for plots, maps and Taylor diagrams. A comprehensive collection of reproducible workflows is available in the examples, demonstrating typical evaluation setups and wrapper-based pipelines. Additional technical details, module descriptions, and theoretical background are provided in the full documentation. For advanced applications and extensions (e.g. SPICE workflows), see the dedicated SPICE documentation. Modular extensions presented in separate projects GeoPackage, GriddedStations, ScoPi and UrbanPlot

Getting help

The easiest way to get help, if you cannot find the answer in the documentation in our docs, is to open an issue on GitLab.

Contributing

If you would like to contribute a new diagnostic or feature, please have a join to the CLM-Community and read CLM-Community contribution guidelines.