Skip to main content

A simple automation framework

Project description

Kuristo

qa build codecov License Scc Count Badge PyPI

Kuristo is a flexible, plugin-enabled automation framework designed for scientific and HPC workflows. It supports sequential and parallel job execution, workflow definition via YAML, resource-aware scheduling, custom step and action definitions, and rich output with optional headless mode.

Demo

Features

  • YAML-based workflows (GitHub Actions style)
  • Custom steps and actions via Python plugins
  • Job dependency graph with parallel execution
  • Job labels for selective execution
  • Resource-aware scheduling with core-aware limits
  • Step & job timeouts
  • ANSI-rich output or plain mode for CI
  • Environment variable passing and output capture
  • Output validation (regex, float comparisons, CSV diffing)
  • Composite steps for reusable action pipelines
  • Built-in log directory and run tracking
  • Run tagging system to protect important results from cleanup
  • Test coverage with pytest
  • MPI support via configurable launcher (mpirun, mpiexec, etc.)

Install

Install from PyPI:

pip install kuristo

Or clone the repo and install locally:

git clone https://github.com/andrsd/kuristo.git
cd kuristo
pip install -e .

Usage

Run all tests in a directory:

kuristo run tests/assets/

Run a specific test set:

kuristo run tests/assets/tests1

Check your environment:

kuristo doctor

Headless/CI-safe mode

kuristo run tests --no-ansi

Workflow YAML Example

jobs:
  test-matrix:
    labels: [simulation, slow]
    strategy:
      matrix:
        include:
          - os: ubuntu
            version: 20.04
          - os: ubuntu
            version: 22.04

    steps:
      - name: Run simulation
        id: simulation
        run: ./simulate --config=${{ matrix.version }}

      - name: Check output
        uses: checks/regex
        with:
          input: ${{ steps.simulation.output }}
          pattern: "SUCCESS"

Writing Custom Actions

Create a plugin in .kuristo/actions.py:

import kuristo

@kuristo.action("my/special-step")
class MyAction(kuristo.ProcessAction):
    def __init__(self, name, context: kuristo.Context, **kwargs):
        super().__init__(name, context, **kwargs)
        self.input = kwargs["input"]

    def create_command(self):
        return f"echo Hello {self.input}"

Then, use in the workflow as:

jobs:
  test:
    steps:
      - name: My special test
        uses: my/special-step
        with:
          input: "world"

Kuristo will auto-discover .py files in .kuristo/.

Logging & Output

All logs and run data are saved in:

.kuristo-out/
├── runs/
│   ├── latest  20250620_101500/
│   └── 20250620_101500/

Set logging retention and cleanup in config.yaml:

log:
  dir-name: .kuristo-out
  history: 5
  cleanup: on_success

Configuration

You can define a global config at .kuristo/config.yaml:

resources:
  num-cores: 8

runner:
  mpi-launcher: mpiexec

Or override via environment variable:

KURISTO_MPI_LAUNCHER=mpiexec2 kuristo run tests/

Testing & Coverage

Run tests:

pytest -v

With coverage:

pytest --cov=kuristo --cov-report=term-missing

Philosophy

Kuristo is inspired by the structure of GitHub Actions but tailored for local and HPC workflows. It aims to be lightweight, extensible, and scriptable — with strong support for reproducibility and numerical simulation validation.

License

MIT

Fun Fact

"Kuristo" means "runner" in Esperanto. Because that’s what it does — it runs your stuff.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kuristo-0.11.0.tar.gz (1.3 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

kuristo-0.11.0-py3-none-any.whl (51.5 kB view details)

Uploaded Python 3

File details

Details for the file kuristo-0.11.0.tar.gz.

File metadata

  • Download URL: kuristo-0.11.0.tar.gz
  • Upload date:
  • Size: 1.3 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for kuristo-0.11.0.tar.gz
Algorithm Hash digest
SHA256 88847669c6efca84c79a47f25fb41381c03c642d91f9e9aa15b02b8c9d9d3f44
MD5 3e058c1f52368005fd30475adeae0ad8
BLAKE2b-256 48645f8c5ce4107e74847be9d77f595b71b991d50cdc8a9a0a114a6b89a25993

See more details on using hashes here.

File details

Details for the file kuristo-0.11.0-py3-none-any.whl.

File metadata

  • Download URL: kuristo-0.11.0-py3-none-any.whl
  • Upload date:
  • Size: 51.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for kuristo-0.11.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2fd76f65d442359c7aef3ef00ad1cc9444b0bbecc0eefe93bfb5a587ccd7739c
MD5 4414009f5fceb64da5865ba975563e8f
BLAKE2b-256 4a97cf81389cbb578b928fc3910c08ee4d1bfe404aa9c8d1023ecdae6e764b1e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page