Skip to main content

PostgreSQL reference SQL execution plugin for ETLantic.

Project description

etlantic-sql

PostgreSQL reference SQL execution plugin for ETLantic 0.19.

pip install 'etlantic==0.19.0' 'etlantic-sql==0.19.0'
# or: pip install 'etlantic[sql]'
export ETLANTIC_SQL_URL=postgresql+psycopg://user:pass@localhost:5432/etlantic
# SQLite is fine for demos only:
# export ETLANTIC_SQL_URL=sqlite+pysqlite:///:memory:

Uses SQLAlchemy Core. Driver dependencies stay out of etlantic core.

Wiring

from etlantic import Profile

Profile(name="sql-prod", sql_engine="sql")

The etlantic.sql_plugins entry point named sql registers etlantic_sql:create_plugin. Profiles select it with sql_engine="sql"; keep connection URLs in environment-backed configuration or secret providers, not in plans.

Register @Transformation.implementation("sql") handlers that take RelationRef inputs and return SQL query handles (not fetched rows).

Capabilities

  • SQL→SQL fusion without intermediate Python row fetch
  • Durable run-scoped staging tables (not session TEMP)
  • Insert-select / CTAS-style publication
  • Fail-closed planning when required capabilities are missing

Not included: MERGE / upsert (sql_merge=False). Requiring merge fails at planning.

Examples

python examples/sql_to_sql.py
python examples/sql_boundary_hybrid.py
python examples/sql_transactional_write.py
python examples/sql_failure_recovery.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_sql-0.19.0.tar.gz (20.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_sql-0.19.0-py3-none-any.whl (26.3 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_sql-0.19.0.tar.gz.

File metadata

  • Download URL: etlantic_sql-0.19.0.tar.gz
  • Upload date:
  • Size: 20.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_sql-0.19.0.tar.gz
Algorithm Hash digest
SHA256 168514cc13cb892e84199adbe664d681518e1da54a4d33d665bcc8e00a3db905
MD5 5fc3913974a5fee5f7a3375271e37240
BLAKE2b-256 02f52f3c09a12f3868db0e07c18c2346ff72ffb18aad5ac45fe0e88b65921632

See more details on using hashes here.

File details

Details for the file etlantic_sql-0.19.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_sql-0.19.0-py3-none-any.whl
  • Upload date:
  • Size: 26.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_sql-0.19.0-py3-none-any.whl
Algorithm Hash digest
SHA256 64db65053fded6232b27fa63e4cbd4c15aefdb94e766be7671c6b59ec6d46484
MD5 734f589a2f8e3a324623cd5f7ce84af1
BLAKE2b-256 1d6b9378a0eb0a63027a2d98e356af28afb0bed07aabdef0594334400e17dbaf

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page