Skip to main content

PostgreSQL reference SQL execution plugin for ETLantic.

Project description

etlantic-sql

PostgreSQL reference SQL execution plugin for ETLantic 0.20.

pip install 'etlantic==0.21.0' 'etlantic-sql==0.21.0'
# or: pip install 'etlantic[sql]'
export ETLANTIC_SQL_URL=postgresql+psycopg://user:pass@localhost:5432/etlantic
# SQLite is fine for demos only:
# export ETLANTIC_SQL_URL=sqlite+pysqlite:///:memory:

Uses SQLAlchemy Core. Driver dependencies stay out of etlantic core.

Wiring

from etlantic import Profile

Profile(name="sql-prod", sql_engine="sql")

The etlantic.sql_plugins entry point named sql registers etlantic_sql:create_plugin. Profiles select it with sql_engine="sql"; keep connection URLs in environment-backed configuration or secret providers, not in plans.

Register @Transformation.implementation("sql") handlers that take RelationRef inputs and return SQL query handles (not fetched rows).

Capabilities

  • SQL→SQL fusion without intermediate Python row fetch
  • Durable run-scoped staging tables (not session TEMP)
  • Insert-select / CTAS-style publication
  • Fail-closed planning when required capabilities are missing

Not included: MERGE / upsert (sql_merge=False). Requiring merge fails at planning.

Examples

python examples/sql_to_sql.py
python examples/sql_boundary_hybrid.py
python examples/sql_transactional_write.py
python examples/sql_failure_recovery.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_sql-0.21.0.tar.gz (20.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_sql-0.21.0-py3-none-any.whl (26.9 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_sql-0.21.0.tar.gz.

File metadata

  • Download URL: etlantic_sql-0.21.0.tar.gz
  • Upload date:
  • Size: 20.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_sql-0.21.0.tar.gz
Algorithm Hash digest
SHA256 843f7e3d9e93a0595cd22c9b4e4a8739e5111d3f87054a72933b261ffc27f966
MD5 ee23c1659628c792f47315c85c79569d
BLAKE2b-256 bf29c2980ce1918bceb05553bca765ab72f41d8d34d4bea6f34e590a4e0debd9

See more details on using hashes here.

File details

Details for the file etlantic_sql-0.21.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_sql-0.21.0-py3-none-any.whl
  • Upload date:
  • Size: 26.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_sql-0.21.0-py3-none-any.whl
Algorithm Hash digest
SHA256 f3d63f158a5b020204018390197afd79203f51274eb07a2b5db754cccd1644cf
MD5 055aab2ed4ab9f81c812d702de05d4c5
BLAKE2b-256 acc0f163025cd2ee14a3a2794b2a28a2fd83bfd40ffc71423df9bda75173b158

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page