Skip to main content

Prefect ExecutionScheduler plugin for ETLantic.

Project description

etlantic-prefect

Optional Prefect ExecutionScheduler for ETLantic (etlantic.scheduler/1). The local MVP is shipped in ETLantic 0.20.

This is not an Airflow-style compile_plan / DAG compiler. It coordinates already-resolved PipelinePlan logical nodes via Prefect 3 tasks while ETLantic owns validation, retries, materialization, and PipelineRunReport.

Install

pip install "etlantic[prefect]==0.23.0"
# or
pip install 'etlantic==0.23.0' 'etlantic-prefect==0.23.0'

Usage

from etlantic import Profile, PipelineRuntime

profile = Profile(name="dev", orchestrator="prefect")
report = MyPipeline.run(profile=profile, runtime=runtime)

Local direct invocation only for the shipped 0.20 MVP — no Prefect Cloud/server or deployment/serve required. Keep LocalScheduler (orchestrator="local") as the default development path.

Decision table

Path Protocol Package
Local in-process ExecutionScheduler built-in
Prefect direct execution ExecutionScheduler etlantic-prefect
Airflow DAG artifacts OrchestratorPlugin / compile_plan etlantic-airflow

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_prefect-0.23.0.tar.gz (4.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_prefect-0.23.0-py3-none-any.whl (5.3 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_prefect-0.23.0.tar.gz.

File metadata

  • Download URL: etlantic_prefect-0.23.0.tar.gz
  • Upload date:
  • Size: 4.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_prefect-0.23.0.tar.gz
Algorithm Hash digest
SHA256 98cb366c6160bdd1579093d1088c8f018a485e0c8024b906c6c19237c9911cf7
MD5 663f57d6f19e54a8ee6dd824e2fa0a69
BLAKE2b-256 f720e95b5bdb75094235e075076f4ccbbf564e3cc1fc6d1c22dcd3596fd1941a

See more details on using hashes here.

File details

Details for the file etlantic_prefect-0.23.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_prefect-0.23.0-py3-none-any.whl
  • Upload date:
  • Size: 5.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_prefect-0.23.0-py3-none-any.whl
Algorithm Hash digest
SHA256 1502dcd262e3953e8f7403e388a8d7a31123a6b87a3a7911468abeb3070339c2
MD5 f0fb2a6f0393f829f8257c3c10fdbfd2
BLAKE2b-256 724049e5c61f1abcfb84fa325e017b7f048cd8e597aef53b1442da2cc716ec7f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page