Skip to main content

Prefect ExecutionScheduler plugin for ETLantic.

Project description

etlantic-prefect

Optional Prefect ExecutionScheduler for ETLantic (etlantic.scheduler/1). The local MVP is shipped in ETLantic 0.20.

This is not an Airflow-style compile_plan / DAG compiler. It coordinates already-resolved PipelinePlan logical nodes via Prefect 3 tasks while ETLantic owns validation, retries, materialization, and PipelineRunReport.

Install

pip install "etlantic[prefect]==0.30.0"
# or
pip install 'etlantic==0.30.0' 'etlantic-prefect==0.30.0'

Usage

from etlantic import Profile, PipelineRuntime

profile = Profile(name="dev", orchestrator="prefect")
report = MyPipeline.run(profile=profile, runtime=runtime)

Local direct invocation only for the shipped 0.20 MVP — no Prefect Cloud/server or deployment/serve required. Keep LocalScheduler (orchestrator="local") as the default development path.

Decision table

Path Protocol Package
Local in-process ExecutionScheduler built-in
Prefect direct execution ExecutionScheduler etlantic-prefect
Airflow DAG artifacts OrchestratorPlugin / compile_plan etlantic-airflow

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_prefect-0.30.0.tar.gz (4.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_prefect-0.30.0-py3-none-any.whl (5.3 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_prefect-0.30.0.tar.gz.

File metadata

  • Download URL: etlantic_prefect-0.30.0.tar.gz
  • Upload date:
  • Size: 4.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_prefect-0.30.0.tar.gz
Algorithm Hash digest
SHA256 6cfd60e34928aeb924609f21da66299d8addaf848e09f0987bc1db645407554d
MD5 7db59ef6c027e15056affda0563c5a59
BLAKE2b-256 6f0c57629b3ab3f5840214b9dc98f3cc690b50340f218baf13c21f0e1ad1c9df

See more details on using hashes here.

File details

Details for the file etlantic_prefect-0.30.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_prefect-0.30.0-py3-none-any.whl
  • Upload date:
  • Size: 5.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_prefect-0.30.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8afc0610feeade735135f24ef3d8c7e6737401fe91a9ea3b957ea4adeb28526d
MD5 fc1ca8dcaa4d15cff4545309240f5da3
BLAKE2b-256 15bf41aff2dc1cc41c09e4352e8428c553f684a5d497d7269328a6a57e4f6688

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page