Skip to main content

Vivarium Dagger

https://badge.fury.io/py/vivarium-dagger.svg Documentation Status

This library builds and runs multi-step data pipelines. It provides dagger, a command that runs a pipeline described in a YAML file as one Jobmon workflow on a Slurm cluster.

Supported Python versions: 3.11, 3.12, 3.13

You can install vivarium-dagger from PyPI with pip:

pip install vivarium-dagger

or build it from source by cloning the monorepo and installing this package:

git clone https://github.com/ihmeuw/vivarium-suite.git
cd vivarium-suite
pip install libs/dagger

Multi-step workflows with dagger

A dagger workflow file lists steps that run in order. Each step gives its command and its compute resources:

workflow:
  name: my_pipeline
  project: proj_simscience
  queue: all.q
  output_directory: /path/to/output
  steps:
    - name: run_sims
      type: simulation
      resources:
        memory_gb: 3
        runtime: "24:00:00"
      args:
        model_specification: /path/to/model_specification.yaml
        branch_configuration: /path/to/branches.yaml
    - name: post_process
      command: my_post_processing_script /path/to/output
      resources:
        memory_gb: 8
        runtime: "00:30:00"

Launch the workflow with

dagger run -c /path/to/workflow.yaml

If a run fails partway through, resume it from its output directory, skipping steps that already completed, with

dagger restart /path/to/output

Check out the docs!

Metadata

Release files for vivarium-dagger 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vivarium-dagger 0.1.0
File Size Uploaded Provenance Actions
vivarium_dagger-0.1.0.tar.gz 70.7 kB With provenance Details for vivarium_dagger-0.1.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for vivarium-dagger 0.1.0
File Interpreter ABI Platform Actions
vivarium_dagger-0.1.0-py3-none-any.whl Python 3 none any Details for vivarium_dagger-0.1.0-py3-none-any.whl

Total release size: 100.9 kB

Release files / vivarium_dagger-0.1.0.tar.gz

Download URL vivarium_dagger-0.1.0.tar.gz
Size 70.7 kB
Tags Source
SHA-256 checksum
How to use checksums
4f0ed34e9ba173970156813e17dd03fdd9c341496b0f2941e4a699edeaf61383
BLAKE2b-256 checksum
How to use checksums
cfa720a91f6d33f07cfda7a57845671d78508408f6362f72444ac5a5d9d4c8a0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 4, 2026.

Transparency log

Release files / vivarium_dagger-0.1.0-py3-none-any.whl

Download URL vivarium_dagger-0.1.0-py3-none-any.whl
Size 30.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
437d441c65dc2421927776564bd6a6a22d9c27ec5174984515fdb55740568249
BLAKE2b-256 checksum
How to use checksums
5a999dfc76b0392619d5023c67ef3cc19c273659347cfa09f74284ce1caecaf7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 4, 2026.

Transparency log

Security for vivarium-dagger 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 2 files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for vivarium_dagger-0.1.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 4, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page