ETLantic
One typed pipeline model. Many execution backends.
Typed contracts. Deterministic plans. Pluggable execution.
Quickstart · Documentation · Is ETLantic for me? · Python API · CLI
ETLantic gives Python data pipelines one portable, typed logical model. It coordinates contracts, transformations, and topology while plugins handle execution. It validates wiring, capabilities, configuration, and plugin trust before producing a deterministic plan.
ETLantic complements dataframe engines and orchestrators; it does not replace them.
Quickstart
ETLantic requires Python 3.11 or newer. In an activated virtual environment:
python -m pip install 'etlantic==0.42.0'
python -m etlantic --version
mkdir my-pipeline
cd my-pipeline
python -m etlantic init --with-toml
python -m etlantic validate pipeline.py:SamplePipeline --profile development
python -m etlantic run pipeline.py:SamplePipeline --profile development
The run should succeed and write Ada and Grace to data/out.json. See the
full Quickstart
for setup details and expected output.
What it provides
- Typed
Data,Transformation,Extract,Load, andPipelinebuilding blocks. - Validation before execution or publication, with human, JSON, and SARIF diagnostics.
- Deterministic plans that can be inspected, fingerprinted, diffed, run, or compiled.
- Contract generation for ODCS, DTCS, and DPCS artifacts.
- Pluggable execution across local Python, Polars, Pandas, SQL, and PySpark, plus orchestration integrations.
Application code should use the curated public facade:
import etlantic as etl
The public CLI includes init, doctor, validate, inspect, plan, run,
compile, generate, diff, plugin, schema, reliability, viz, and
report.
Execution options
Core has no dataframe, database, Spark, or orchestrator dependency. Install only the integrations a pipeline needs:
| Capability | 0.42 |
|---|---|
| Local Python + JSON/CSV | etlantic |
| Polars or Pandas | etlantic[polars] or etlantic[pandas] |
| SQL or PySpark | etlantic[sql] or etlantic[pyspark] |
| Airflow or Prefect | etlantic[airflow] or etlantic[prefect] |
Each transformation must support the selected backend. In controlled deployments, pin ETLantic and official plugins to the same release. See engine selection and compatibility.
Security and production posture
ETLantic is currently Beta. It is suitable for documented, controlled, single-tenant pilots—not unrestricted enterprise production.
It does not include a managed runtime or multi-tenant control plane; that work is tracked in the control-plane program.
Plans and reports contain secret references, never resolved secret values.
Production profiles require an explicit non-empty plugin_allowlist; an
allowlist controls selection but is not a sandbox. Schema history stores
fingerprints and metadata, never source rows.
Review the production readiness and security model before a pilot.
Learn more
- Quickstart and first pipeline
- Is ETLantic for me? and capabilities
- CLI reference and Python API
- Plugin SDK and optional packages
Contributing
See CONTRIBUTING.md for development setup and pull-request guidance. Use GitHub Issues for bugs and questions, and follow the private instructions in SECURITY.md to report vulnerabilities.
ETLantic is available under the MIT License.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file etlantic-0.42.0.tar.gz.
File metadata
- Download URL: etlantic-0.42.0.tar.gz
- Upload date:
- Size: 949.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6c7563078c29535c13497414fd9ad45095559258b56f2a3e8992a8c09f69e83a
|
|
| MD5 |
22f3f6b4a6e2d7ede492ce95a3b381bb
|
|
| BLAKE2b-256 |
8e7f677db3c1faeab94f488691a22230fb20ba6b27b1afdf1aaaea165aafc698
|
File details
Details for the file etlantic-0.42.0-py3-none-any.whl.
File metadata
- Download URL: etlantic-0.42.0-py3-none-any.whl
- Upload date:
- Size: 631.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
cf5884ae63b5c1aac70cfe95e5c183f4005ca6419e79cfc12162640b1df96cc4
|
|
| MD5 |
7b16ca67b3b432cf7fee97431ccb8798
|
|
| BLAKE2b-256 |
3b0b4da381bea6c1bfa624b045497116660c467dd32dcdbfa66834a3a232b508
|
