Skip to main content

PostgreSQL reference SQL execution plugin for ETLantic.

Project description

etlantic-sql

PostgreSQL reference SQL execution plugin for ETLantic.

pip install etlantic-sql
# or: pip install 'etlantic[sql]'
export ETLANTIC_SQL_URL=postgresql+psycopg://user:pass@localhost:5432/etlantic
# SQLite is fine for demos only:
# export ETLANTIC_SQL_URL=sqlite+pysqlite:///:memory:

Uses SQLAlchemy Core. Driver dependencies stay out of etlantic core.

Wiring

from etlantic import Profile

Profile(name="sql-prod", sql_engine="sql")

Register @Transformation.implementation("sql") handlers that take RelationRef inputs and return SQL query handles (not fetched rows).

Capabilities (0.6)

  • SQL→SQL fusion without intermediate Python row fetch
  • Durable run-scoped staging tables (not session TEMP)
  • Insert-select / CTAS-style publication
  • Fail-closed planning when required capabilities are missing

Not included: MERGE / upsert (sql_merge=False). Requiring merge fails at planning.

Examples

python examples/sql_to_sql.py
python examples/sql_boundary_hybrid.py
python examples/sql_transactional_write.py
python examples/sql_failure_recovery.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_sql-0.12.0.tar.gz (8.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_sql-0.12.0-py3-none-any.whl (11.9 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_sql-0.12.0.tar.gz.

File metadata

  • Download URL: etlantic_sql-0.12.0.tar.gz
  • Upload date:
  • Size: 8.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_sql-0.12.0.tar.gz
Algorithm Hash digest
SHA256 1714eca71c5e75d7f70df9022517d3b7d25e98390f89e73a89dabeb00ad13f28
MD5 bb2375484cdc2c1966ec211be4e687a8
BLAKE2b-256 19d3aac9aef3b352f66426a50e0a77f2b430d266a52dea08ce46fb4e5f940b55

See more details on using hashes here.

File details

Details for the file etlantic_sql-0.12.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_sql-0.12.0-py3-none-any.whl
  • Upload date:
  • Size: 11.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_sql-0.12.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3ccf18d35768df142d81b592d887660edc26526374cfae4e9e974bf438273e4d
MD5 dc23088566afec9990b04eff3c3a6160
BLAKE2b-256 8ab72133b8fea9e3bb05ad18cffb47f27d53d7bef82d4a4eca3e225197f9a27a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page