Skip to main content

PostgreSQL reference SQL execution plugin for ETLantic.

Project description

etlantic-sql

PostgreSQL reference SQL execution plugin for ETLantic.

pip install etlantic-sql
# or: pip install 'etlantic[sql]'
export ETLANTIC_SQL_URL=postgresql+psycopg://user:pass@localhost:5432/etlantic
# SQLite is fine for demos only:
# export ETLANTIC_SQL_URL=sqlite+pysqlite:///:memory:

Uses SQLAlchemy Core. Driver dependencies stay out of etlantic core.

Wiring

from etlantic import Profile

Profile(name="sql-prod", sql_engine="sql")

Register @Transformation.implementation("sql") handlers that take RelationRef inputs and return SQL query handles (not fetched rows).

Capabilities (0.6)

  • SQL→SQL fusion without intermediate Python row fetch
  • Durable run-scoped staging tables (not session TEMP)
  • Insert-select / CTAS-style publication
  • Fail-closed planning when required capabilities are missing

Not included: MERGE / upsert (sql_merge=False). Requiring merge fails at planning.

Examples

python examples/sql_to_sql.py
python examples/sql_boundary_hybrid.py
python examples/sql_transactional_write.py
python examples/sql_failure_recovery.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_sql-0.13.0.tar.gz (8.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_sql-0.13.0-py3-none-any.whl (11.9 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_sql-0.13.0.tar.gz.

File metadata

  • Download URL: etlantic_sql-0.13.0.tar.gz
  • Upload date:
  • Size: 8.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_sql-0.13.0.tar.gz
Algorithm Hash digest
SHA256 59f03909336968ba6f16af8e7d13fb8592e62de98f2d26a0530015dfbb2468d1
MD5 820e9c3fddfbed7afd39d2549963a22f
BLAKE2b-256 fb0d926d76b41b1b653142dd499a8b2f4f9ac6be5562f96d5fe34d98417e217b

See more details on using hashes here.

File details

Details for the file etlantic_sql-0.13.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_sql-0.13.0-py3-none-any.whl
  • Upload date:
  • Size: 11.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_sql-0.13.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8488646aa7cc34e89a027d0c6bd0691b65a7240fc4ce1e854f9f747370dd229d
MD5 4ad711f593066fd632bdaaabb69201c0
BLAKE2b-256 f0b52b6398249d31ca73324af714cbfdfe232aa476a244e2b40fc0f493c8ad98

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page