Skip to main content

Build taskcluster taskgraphs

Project description

Task Status pre-commit.ci status Code Coverage Pypi Version Documentation Status License

Taskgraph

Taskgraph is a Python library to generate graphs of tasks for the Taskcluster CI service. It is the recommended approach for configuring tasks once your project outgrows a single .taskcluster.yml file and is what powers the over 30,000 tasks and counting that make up Firefox’s CI.

For more information and usage instructions, see the docs.

How It Works

Taskgraph leverages the fact that Taskcluster is a generic task execution platform. This means that tasks can be scheduled via its comprehensive API, and aren’t limited to being triggered in response to supported events.

Taskgraph leverages this execution platform to allow CI systems to scale to any size or complexity.

  1. A decision task is created via Taskcluster’s normal .taskcluster.yml file. This task invokes taskgraph.

  2. Taskgraph evaluates a series of yaml based task definitions (similar to those other CI offerings provide).

  3. Taskgraph applies transforms on top of these task definitions. Transforms are Python functions that can programmatically alter or even clone a task definition.

  4. Taskgraph applies some optional optimization logic to remove unnecessary tasks.

  5. Taskgraph submits the resulting task graph to Taskcluster via its API.

Taskgraph’s combination of declarative task configuration combined with programmatic alteration are what allow it to support CI systems of any scale. Taskgraph is the library that powers the 30,000+ tasks making up Firefox’s CI.

Installation

Taskgraph supports Python 3.8 and up, and can be installed from Pypi:

pip install taskcluster-taskgraph

Alternatively, the repo can be cloned and installed directly:

git clone https://github.com/taskcluster/taskgraph
cd taskgraph
pip install .

In both cases, it’s recommended to use a Python virtual environment.

Get Involved

If you’d like to get involved, please see our contributing docs!

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

taskcluster_taskgraph-14.4.1.tar.gz (467.5 kB view details)

Uploaded Source

Built Distribution

taskcluster_taskgraph-14.4.1-py3-none-any.whl (198.6 kB view details)

Uploaded Python 3

File details

Details for the file taskcluster_taskgraph-14.4.1.tar.gz.

File metadata

  • Download URL: taskcluster_taskgraph-14.4.1.tar.gz
  • Upload date:
  • Size: 467.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for taskcluster_taskgraph-14.4.1.tar.gz
Algorithm Hash digest
SHA256 c20f28bb180950e22fd8478dca6218b29db6a1c76fcf2e4f2b7730f33983d891
MD5 191e8cba08393a5705e58b82ba96db79
BLAKE2b-256 867c760e6ec73d5137cb463568a4d6d98dd7ad9e48bf8aa902e042355e2343e5

See more details on using hashes here.

Provenance

The following attestation bundles were made for taskcluster_taskgraph-14.4.1.tar.gz:

Publisher: pypi-publish.yml on taskcluster/taskgraph

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file taskcluster_taskgraph-14.4.1-py3-none-any.whl.

File metadata

File hashes

Hashes for taskcluster_taskgraph-14.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 9ea58e096f41293b3f870a5b7f4765a5bf55a250ae5a35325a81ab8cfe1cdc89
MD5 949a7a5048d3892eb43e28fed6307f62
BLAKE2b-256 9e36e6745741f60e47104940259aa0a57555fcc8d62e9180fb8b22eb033028fc

See more details on using hashes here.

Provenance

The following attestation bundles were made for taskcluster_taskgraph-14.4.1-py3-none-any.whl:

Publisher: pypi-publish.yml on taskcluster/taskgraph

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page