Skip to main content

Prefect ExecutionScheduler plugin for ETLantic.

Project description

etlantic-prefect

Optional Prefect ExecutionScheduler for ETLantic (etlantic.scheduler/1). The local MVP is shipped in ETLantic 0.20.

This is not an Airflow-style compile_plan / DAG compiler. It coordinates already-resolved PipelinePlan logical nodes via Prefect 3 tasks while ETLantic owns validation, retries, materialization, and PipelineRunReport.

Install

pip install "etlantic[prefect]==0.27.0"
# or
pip install 'etlantic==0.27.0' 'etlantic-prefect==0.27.0'

Usage

from etlantic import Profile, PipelineRuntime

profile = Profile(name="dev", orchestrator="prefect")
report = MyPipeline.run(profile=profile, runtime=runtime)

Local direct invocation only for the shipped 0.20 MVP — no Prefect Cloud/server or deployment/serve required. Keep LocalScheduler (orchestrator="local") as the default development path.

Decision table

Path Protocol Package
Local in-process ExecutionScheduler built-in
Prefect direct execution ExecutionScheduler etlantic-prefect
Airflow DAG artifacts OrchestratorPlugin / compile_plan etlantic-airflow

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_prefect-0.27.0.tar.gz (4.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_prefect-0.27.0-py3-none-any.whl (5.3 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_prefect-0.27.0.tar.gz.

File metadata

  • Download URL: etlantic_prefect-0.27.0.tar.gz
  • Upload date:
  • Size: 4.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_prefect-0.27.0.tar.gz
Algorithm Hash digest
SHA256 0004dd5af650db994773f877508fca55757387bf18c9d0af6f2faed55d469a5d
MD5 7d1a6cf439f90a0491311b6f571394e5
BLAKE2b-256 a9089d8550108db16c57173eac0498779453b06ff9f6f577b7d624cc89a1bbeb

See more details on using hashes here.

File details

Details for the file etlantic_prefect-0.27.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_prefect-0.27.0-py3-none-any.whl
  • Upload date:
  • Size: 5.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_prefect-0.27.0-py3-none-any.whl
Algorithm Hash digest
SHA256 5e3368e08923300f3ebcfb1d6b166897f052d7fb6c7308b9d78c993147f4cd52
MD5 005c1bd9ee7e9482bfb105871ac72ed4
BLAKE2b-256 6f3c0352f9414228e0ede29fb55cf3a2b61c7fd35d0947ed8a556045241de369

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page