Skip to main content

Prefect ExecutionScheduler plugin for ETLantic.

Project description

etlantic-prefect

Optional Prefect ExecutionScheduler for ETLantic (etlantic.scheduler/1). The local MVP is shipped in ETLantic 0.20.

This is not an Airflow-style compile_plan / DAG compiler. It coordinates already-resolved PipelinePlan logical nodes via Prefect 3 tasks while ETLantic owns validation, retries, materialization, and PipelineRunReport.

Install

pip install "etlantic[prefect]==0.33.0"
# or
pip install 'etlantic==0.33.0' 'etlantic-prefect==0.33.0'

Usage

from etlantic import Profile, PipelineRuntime

profile = Profile(name="dev", orchestrator="prefect")
report = MyPipeline.run(profile=profile, runtime=runtime)

Local direct invocation only for the shipped 0.20 MVP — no Prefect Cloud/server or deployment/serve required. Keep LocalScheduler (orchestrator="local") as the default development path.

Decision table

Path Protocol Package
Local in-process ExecutionScheduler built-in
Prefect direct execution ExecutionScheduler etlantic-prefect
Airflow DAG artifacts OrchestratorPlugin / compile_plan etlantic-airflow

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_prefect-0.33.0.tar.gz (4.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_prefect-0.33.0-py3-none-any.whl (5.3 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_prefect-0.33.0.tar.gz.

File metadata

  • Download URL: etlantic_prefect-0.33.0.tar.gz
  • Upload date:
  • Size: 4.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_prefect-0.33.0.tar.gz
Algorithm Hash digest
SHA256 ab2906814e7b27b71aa47342ceb7886d03cfbc4ea70ba73e44ab438c61e26a7c
MD5 fdafcad595b6a6c09ac3eea4bc37e5eb
BLAKE2b-256 e6122ef13b406bef520b16ffe52dbd810c23cc515ff2fd9028ab8beb4a415f27

See more details on using hashes here.

File details

Details for the file etlantic_prefect-0.33.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_prefect-0.33.0-py3-none-any.whl
  • Upload date:
  • Size: 5.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_prefect-0.33.0-py3-none-any.whl
Algorithm Hash digest
SHA256 5c16fcb19013a729d2fd3d3c07f66b2bf7084a4cd1a6f7b4bb321573fb359221
MD5 00bf0dc03f86477bd87e99e8400c9e7f
BLAKE2b-256 53b4f3039a24e9915bc833a590ce5b9844e467e9aa4b41f66e9ff1ca0420cd43

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page