Skip to main content

dagpiler

Tool to compile a DAG of a data processing pipeline from formatted TOML files.

By adhering to a portable, flexible standard, data science packages written by independent authors can be easily merged together. This foundational layer can then support and tie together tools and standards within and between disciplines.

Dagpiler is the first in a planned series of tools that will build on one another to standardize and facilitate common operations in data processing.

Useage

from dagpiler import compile_dag
from dagpiler.printer import print_dag, json_to_dag

# Compile the DAG from the various packages.
dag = compile_dag('package_name')

# Write the DAG to JSON file.
dag.print_dag('dag.json')

# Re-create the DAG from a JSON file.
dag_from_json = json_to_dag('dag.json')

Documentation

Documentation: https://researchos.github.io/dagpiler/

Metadata

Release files for dagpiler 0.1.6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dagpiler 0.1.6
File Size Uploaded Provenance Actions
dagpiler-0.1.6.tar.gz 12.6 MB Without provenance Details for dagpiler-0.1.6.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for dagpiler 0.1.6
File Interpreter ABI Platform Actions
dagpiler-0.1.6-py2.py3-none-any.whl Python 2, Python 3 none any Details for dagpiler-0.1.6-py2.py3-none-any.whl

Total release size: 12.7 MB

Release files / dagpiler-0.1.6.tar.gz

Download URL dagpiler-0.1.6.tar.gz
Size 12.6 MB
Tags Source
SHA-256 checksum
How to use checksums
ff1341c33389f9191fa09b77d0f5991a21b2a48e5e517eb110db5d8f380aa5a8
BLAKE2b-256 checksum
How to use checksums
83ad75cb52e54d502a8d3491f31c9ad0eca224379ab7e5ebf9a14acb9ac4bfa3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.12.6

Release files / dagpiler-0.1.6-py2.py3-none-any.whl

Download URL dagpiler-0.1.6-py2.py3-none-any.whl
Size 54.3 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
f811c947c662f2edb0ee96772e9e7391f02c298f1ede64d858f0315bf130e048
BLAKE2b-256 checksum
How to use checksums
4ddd3f1e826211b9ddaab4a2e8af2e847858a2a89940f6a9bb6bdf3e22f6faa9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.12.6

Security for dagpiler 0.1.6

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page