Skip to main content

Prefect ExecutionScheduler plugin for ETLantic.

Project description

etlantic-prefect

Optional Prefect ExecutionScheduler for ETLantic (etlantic.scheduler/1). The local MVP is shipped in ETLantic 0.20.

This is not an Airflow-style compile_plan / DAG compiler. It coordinates already-resolved PipelinePlan logical nodes via Prefect 3 tasks while ETLantic owns validation, retries, materialization, and PipelineRunReport.

Install

pip install etlantic-prefect

Usage

from etlantic import Profile, PipelineRuntime

profile = Profile(name="dev", orchestrator="prefect")
report = MyPipeline.run(profile=profile, runtime=runtime)

Local direct invocation only for the shipped 0.20 MVP — no Prefect Cloud/server or deployment/serve required. Keep LocalScheduler (orchestrator="local") as the default development path.

Decision table

Path Protocol Package
Local in-process ExecutionScheduler built-in
Prefect direct execution ExecutionScheduler etlantic-prefect
Airflow DAG artifacts OrchestratorPlugin / compile_plan etlantic-airflow

Links

Prefect example · Source · Issues

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_prefect-0.36.0.tar.gz (4.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_prefect-0.36.0-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_prefect-0.36.0.tar.gz.

File metadata

  • Download URL: etlantic_prefect-0.36.0.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_prefect-0.36.0.tar.gz
Algorithm Hash digest
SHA256 1b6ffc16110f6454e296bcda738ec5d4098520361ab2c58feac7c614c216772c
MD5 16a725357e2f7d7db6996c1df53e0ead
BLAKE2b-256 a63cd8559bca36117757d3c769ce7f703f380efd57d444bfee38d3532c336154

See more details on using hashes here.

File details

Details for the file etlantic_prefect-0.36.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_prefect-0.36.0-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_prefect-0.36.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a432d71dd8b5a7637e15057785e518f82cab69d376627865733631ca15341228
MD5 7699cc6a652fef8ff20deb0bcb43f1fe
BLAKE2b-256 55d512e64a87bc85ad2b9c03c0594bad0e8c0d1d617c6d07ca396796e6e72c3a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page