Skip to main content

Fast task runner for Python projects

Project description

⚡ Zetten

The High-Performance Task Runner for Python Backends. Parallel. Deterministic. Fast.

PyPI - Version PyPI - License PyPI - Python Version Nightly Build

Zetten is a dependency-aware execution engine designed to unify how you run tests, linters, and builds. It ensures that your workflow remains identical across local development environments and any CI platform, only faster.


🚀 The Zetten Philosophy

Modern Python projects often require coordinating various tools (tests, type-checkers, formatters). Zetten eliminates "Glue Code Fatigue" by providing:

  • Parallel Execution: Automatically identifies independent tasks and runs them concurrently across your CPU cores.
  • Three-Tier Variable System: Advanced command templating with a strict priority hierarchy: CLI Flags (-k) > Config Vars > Environment Variables.
  • Smart Caching: Uses content-addressable hashing to skip tasks if their specific inputs haven't changed since the last run.
  • Platform Agnostic: Behaves identically on macOS, Windows, Linux, or any CI/CD provider.
  • Dependency Awareness: Define a Directed Acyclic Graph (DAG) of tasks to ensure correct execution order (e.g., setup always precedes test).

✨ Features

  • ⚡ Worker Pool Concurrency: Maximizes resource usage by running non-dependent tasks in parallel.
  • 🏷️ CI Tagging: Execute logical groups of tasks (e.g., run --tag ci) with a single command.
  • 🛡️ Failure Propagation: If a foundational task fails, Zetten halts downstream execution to prevent cascading errors.
  • 🔍 Intelligent Diagnostics: Includes ztn doctor to identify environment inconsistencies instantly.
  • ⏱️ Performance Analytics: (Coming Soon) Real-time insights into time saved via parallelism.


🏎️ Performance

Zetten is built for speed. Benchmarks against popular task runners show it provides the fastest developer experience for incremental builds.

Metric Tool Time vs Zetten
Startup ztn 2.08 ms 1.00x
(CLI overhead) just 2.15 ms 1.04x
make 3.85 ms 1.85x
poe 41.88 ms 20.15x
Smart Caching ztn 3.49 ms 1.00x
(No-op re-run) just 4.26 ms 1.22x
make 5.63 ms 1.61x
poe 64.68 ms 18.52x

> Benchmarks run on macOS (Apple Silicon). Startup measures tool --version. Smart Caching measures time to detect no input changes and skip execution.


🛠️ Quick Start

Install Zetten:

pip install zetten

Initiate a project:

ztn init

For Python script execution:

[tool.zetten.tasks.hello]
script = "my_module:main"  # Runs: python -c "import my_module; my_module.main()"
description = "Run a python function"

Define tasks in pyproject.toml:

[tool.zetten.tasks.lint]
cmd = "ruff check src"
inputs = ["src/"]
tags = ["ci"]

[tool.zetten.tasks.test]
cmd = "pytest"
depends_on = ["lint"]
inputs = ["src/", "tests/"]
tags = ["ci"]

[tool.zetten.tasks.build]
description = "Build the project"
# Supports Fallback Syntax: ${VAR:-default}
cmd = "mkdir -p ${build_dir} && python -m build --outdir ${DEST:-dist}"
depends_on = ["lint"]
inputs = ["src/"]

Define tasks in zetten.toml:

[tasks.setup]
cmd = "pip install -r requirements.txt"

[tasks.lint]
cmd = "ruff check src"
inputs = ["src/"]
tags = ["ci"]

[tasks.test]
cmd = "pytest"
depends_on = ["setup"]
inputs = ["src/", "tests/"]
tags = ["ci"]

Run tasks:

ztn run test
ztn run lint test

Zetten will only re-run tasks when their inputs change.


⚙️ The Variable Hierarchy

Zetten uses a deterministic three-tier system to resolve variables:

  • Tier 1 (CLI): ztn run build -k build_dir=output (Highest Priority)
  • Tier 2 (Config): Values defined in [tool.zetten.vars]
  • Tier 3 (Env): System environment variables (e.g., $USER, $PATH)

🚀 Running in CI

Zetten is designed for the modern CI/CD pipeline. By using Tags and Strict Mode, you can ensure your pipeline is both flexible and safe.

# Force a specific version and environment in CI
ztn run --tag ci -k VERSION=${GITHUB_SHA} -k ENV=prod

If a foundational task fails, Zetten halts downstream execution immediately to save CI minutes and prevent cascading failures.

⚙️ Configuration Model

Configuration is explicit by design:

  • No templating
  • No conditionals
  • No implicit behavior

Configuration lives in:

  • pyproject.toml (preferred)
  • zetten.toml (for legacy or minimal projects)

If no configuration is found, Zetten will explain how to resolve the issue.


🛠 Commands

  • ztn run <tasks> — Execute tasks with parallel dependency resolution.
  • ztn run <task> -k KEY=VAL — Override any variable via the CLI.
  • ztn watch <tasks> — Precision re-runs on input changes.
  • ztn graph — Visualizes the Directed Acyclic Graph (DAG) of your tasks.
  • ztn doctor — Diagnoses configuration and environmental health issues.
  • ztn init — Interactive project setup and template generation.

🛡 Status

Zetten is currently in v1.3.2. If no configuration file is found, Zetten will provide clear instructions on how to initialize your project.


Documentation

Full documentation is available at: docs.zetten.in


🤝 Contributing

We love Rust and Python! If you want to help make Zetten even faster:

  • Fork the repo.
  • Add your feature (don't forget the tests!).
  • Open a Pull Request.

Built with ❤️ for the Python community using the speed of Rust.

Please open an issue or discussion on GitHub before proposing large changes.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

zetten-1.3.3-py3-none-win_amd64.whl (1.7 MB view details)

Uploaded Python 3Windows x86-64

zetten-1.3.3-py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.7 MB view details)

Uploaded Python 3manylinux: glibc 2.5+ x86-64

zetten-1.3.3-py3-none-macosx_11_0_x86_64.whl (1.6 MB view details)

Uploaded Python 3macOS 11.0+ x86-64

zetten-1.3.3-py3-none-macosx_11_0_arm64.whl (1.5 MB view details)

Uploaded Python 3macOS 11.0+ ARM64

File details

Details for the file zetten-1.3.3-py3-none-win_amd64.whl.

File metadata

  • Download URL: zetten-1.3.3-py3-none-win_amd64.whl
  • Upload date:
  • Size: 1.7 MB
  • Tags: Python 3, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: maturin/1.11.5

File hashes

Hashes for zetten-1.3.3-py3-none-win_amd64.whl
Algorithm Hash digest
SHA256 cd572d40b354107aab534d83e042f0b8f5ea2ecb058134e4942afb7cc5448b94
MD5 9ef19c707dcf5033dcf592f91d09dc14
BLAKE2b-256 6a517d2a101a433866cf95b7f61fef9f84610723ff19e80d208cfadd745b7a99

See more details on using hashes here.

File details

Details for the file zetten-1.3.3-py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.

File metadata

File hashes

Hashes for zetten-1.3.3-py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl
Algorithm Hash digest
SHA256 90efff381389c00ccd0029cfc62822dbe60650ae6e85e0d6fdc5557f583fe1af
MD5 bd128e2ec7f43ce0be7d5fea7cc60b08
BLAKE2b-256 bd2ffd339388b45cca533eb1075b26d45aa196e16134779fa56f54cf1702c00b

See more details on using hashes here.

File details

Details for the file zetten-1.3.3-py3-none-macosx_11_0_x86_64.whl.

File metadata

File hashes

Hashes for zetten-1.3.3-py3-none-macosx_11_0_x86_64.whl
Algorithm Hash digest
SHA256 d07ecf0524a90735f61063512d0a52ea5912e826649c2d6656614bec60b878c1
MD5 0cefedc31c1ae6b0ae86aac9a9e47cfe
BLAKE2b-256 8e6fcc0892423a2f7a00a94aa7ce17b5d8c3fd49a4b22c32af269b232836ec65

See more details on using hashes here.

File details

Details for the file zetten-1.3.3-py3-none-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for zetten-1.3.3-py3-none-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 037bff1502af282c0ba702e3f75acb08cf9d54675aa5347b32db35cdf9e1de91
MD5 847a0d8f96cd2436bd0b3bac89c0030d
BLAKE2b-256 5d3ae40fed6a51047bf161bbe769d0ae0ea9e37a34c34216257a42fee3fdb14c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page