airoh 0.4.0

Because reproducible science takes clean tasks. And why don't you have a cup of relaxing jasmin tea?

airoh is a lightweight Python task library built with invoke, designed for reproducible research workflows. It provides pre-written, modular task definitions that can be easily reused in your own tasks.py file — no boilerplate, just useful automation. Access the documentation of the library on the airoh docs website for a list of available airoh tasks.

Installation

Installation through PIP:

pip install airoh

For local deployment:

git clone https://github.com/airoh-pipeline/airoh.git
cd airoh
pip install -e .

Usage

You can use airoh in your project simply by importing tasks in your tasks.py file.

Minimal Example

# tasks.py
from airoh.utils import run_notebooks, setup_env_python

Now you can call:

invoke run-notebooks
invoke setup-env-python

Keeping a project honest

Two modules exist for the parts of reproducibility that no pipeline run can check by itself.

airoh.verify compares a project against its own documentation — the task list in the README, the packages in requirements.txt versus pyproject.toml, the paths the docs name, the entries in each data folder versus its CONTENT.md, the size and type of what git tracks. It runs a flat list of independent checks and exits non-zero when any fails. Wire it up as its own task and run it before committing; never call it from run, so that reproducing results never depends on documentation hygiene.

airoh.provenance writes two records: record_sources describes what every declared asset actually resolved to (a URL, a real path behind a symlink, the commit of the repository it belongs to), and record_run describes what produced the current outputs (project commit, environment, input manifest, output checksums). Neither can fail a pipeline — a provenance record is documentation, not a precondition. Where datalad is in use it remains the only thing that can retrieve a past state; these records are what you get without it.

# tasks.py
from airoh.verify import verify            # noqa: F401  (exposes `invoke verify`)
from airoh.provenance import record_run, record_sources

Requirements

• Python ≥ 3.8
• invoke ≥ 2.0
• Docker (for container tasks)
• Apptainer (optional, for .sif support)
• jupyter (if using run-notebooks)

Note that a few more requirements are required for development, in particular pdoc which is used to generate the documentation website.

Philosophy

Inspired by Uncle Iroh from Avatar: The Last Airbender, airoh aims to bring simplicity, reusability, and clarity to research infrastructure — one well-structured task at a time. It is meant to support a concrete implementation of the YODA principles.

License

MIT © airoh contributors