Skip to main content

PostgreSQL reference SQL execution plugin for ETLantic.

Project description

etlantic-sql

PostgreSQL reference SQL execution plugin for ETLantic 0.14.

pip install 'etlantic==0.14.0' 'etlantic-sql==0.14.0'
# or: pip install 'etlantic[sql]'
export ETLANTIC_SQL_URL=postgresql+psycopg://user:pass@localhost:5432/etlantic
# SQLite is fine for demos only:
# export ETLANTIC_SQL_URL=sqlite+pysqlite:///:memory:

Uses SQLAlchemy Core. Driver dependencies stay out of etlantic core.

Wiring

from etlantic import Profile

Profile(name="sql-prod", sql_engine="sql")

The etlantic.sql_plugins entry point named sql registers etlantic_sql:create_plugin. Profiles select it with sql_engine="sql"; keep connection URLs in environment-backed configuration or secret providers, not in plans.

Register @Transformation.implementation("sql") handlers that take RelationRef inputs and return SQL query handles (not fetched rows).

Capabilities (0.14)

  • SQL→SQL fusion without intermediate Python row fetch
  • Durable run-scoped staging tables (not session TEMP)
  • Insert-select / CTAS-style publication
  • Fail-closed planning when required capabilities are missing

Not included: MERGE / upsert (sql_merge=False). Requiring merge fails at planning.

Examples

python examples/sql_to_sql.py
python examples/sql_boundary_hybrid.py
python examples/sql_transactional_write.py
python examples/sql_failure_recovery.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_sql-0.14.0.tar.gz (8.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_sql-0.14.0-py3-none-any.whl (12.2 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_sql-0.14.0.tar.gz.

File metadata

  • Download URL: etlantic_sql-0.14.0.tar.gz
  • Upload date:
  • Size: 8.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_sql-0.14.0.tar.gz
Algorithm Hash digest
SHA256 0583bbc3f8789c7a4e4e5cddcc5898f86c2641313dd707dea2138d9c81299d3e
MD5 30ec29b0069239db2564f5422a52d2ad
BLAKE2b-256 6d7aae07623f0f28a691155a24ede39dd77369427db7afe8949e49358a4fe2e9

See more details on using hashes here.

File details

Details for the file etlantic_sql-0.14.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_sql-0.14.0-py3-none-any.whl
  • Upload date:
  • Size: 12.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_sql-0.14.0-py3-none-any.whl
Algorithm Hash digest
SHA256 624cbaadbd175caa82ed520d56c7aa22fde52da00d5b253a153d453d92f674fd
MD5 4088cb260b78cac0a547b7f895fcc572
BLAKE2b-256 5673870b66d0d88a035498aca087840eeca5dfb2dd76a6a190ff23a5df846512

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page