Skip to main content

Prefect ExecutionScheduler plugin for ETLantic.

Project description

etlantic-prefect

Optional Prefect ExecutionScheduler for ETLantic (etlantic.scheduler/1). The local MVP is shipped in ETLantic 0.20.

This is not an Airflow-style compile_plan / DAG compiler. It coordinates already-resolved PipelinePlan logical nodes via Prefect 3 tasks while ETLantic owns validation, retries, materialization, and PipelineRunReport.

Install

pip install "etlantic[prefect]==0.21.0"
# or
pip install 'etlantic==0.21.0' 'etlantic-prefect==0.21.0'

Usage

from etlantic import Profile, PipelineRuntime

profile = Profile(name="dev", orchestrator="prefect")
report = MyPipeline.run(profile=profile, runtime=runtime)

Local direct invocation only for the shipped 0.20 MVP — no Prefect Cloud/server or deployment/serve required. Keep LocalScheduler (orchestrator="local") as the default development path.

Decision table

Path Protocol Package
Local in-process ExecutionScheduler built-in
Prefect direct execution ExecutionScheduler etlantic-prefect
Airflow DAG artifacts OrchestratorPlugin / compile_plan etlantic-airflow

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_prefect-0.21.0.tar.gz (4.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_prefect-0.21.0-py3-none-any.whl (5.3 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_prefect-0.21.0.tar.gz.

File metadata

  • Download URL: etlantic_prefect-0.21.0.tar.gz
  • Upload date:
  • Size: 4.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_prefect-0.21.0.tar.gz
Algorithm Hash digest
SHA256 3c3c4a747ba8c4468d28575b70b9f6c8dc9a14c1da3c8163b8411bb51fddec1d
MD5 5d3a6d16c44ee9db1ed3dcceb3154157
BLAKE2b-256 e1af5f2eed0766349fcc907836126cc8058f3533391665632f5e589c1beaf323

See more details on using hashes here.

File details

Details for the file etlantic_prefect-0.21.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_prefect-0.21.0-py3-none-any.whl
  • Upload date:
  • Size: 5.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_prefect-0.21.0-py3-none-any.whl
Algorithm Hash digest
SHA256 cf24c121b19c5314a1d88180fbc13222c593556e08a76596d69b4c8add08902b
MD5 08de4451430e79e938a27524cc745694
BLAKE2b-256 bd9606d52b8f10dafbb72b21512955860f1b2302c655ba65939818406eb4078d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page