Skip to main content

Pandas dataframe execution plugin for ETLantic.

Project description

etlantic-pandas

Pandas dataframe plugin and portable transform compiler for ETLantic 0.14.

pip install 'etlantic==0.14.0' 'etlantic-pandas==0.14.0'
pip install 'etlantic-pandas[arrow]==0.14.0'  # optional Arrow interchange

Dataframe plugin

The plugin provides eager, index-neutral DataFrame execution. It copies frames at ownership boundaries so Pandas index state and in-place mutation do not leak into portable pipeline semantics. Planning fails closed when a pipeline requires unsupported lazy or zero-copy behavior.

Select it with Profile(dataframe_engine="pandas"); the etlantic.dataframe_plugins entry point named pandas registers the plugin.

Portable transform compiler

The etlantic.transform_compilers entry point named pandas exposes etlantic_pandas:create_transform_compiler. The eager compiler claims dtcs:profile/portable-relational-kernel/1 and dtcs:profile/portable-relational/1, including joins, unions, grouping, aggregation, ordering, deduplication, and limits without requiring a native @implementation("pandas").

from etlantic import Profile

profile = Profile(
    name="pandas-portable",
    dataframe_engine="pandas",
    portable_transform_policy="require",
)

Plugin authors can verify the advertised portable behavior with the public conformance suite:

from etlantic.testing import run_portable_transform_conformance_suite
from etlantic_pandas import create_transform_compiler

run_portable_transform_conformance_suite(create_transform_compiler())

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_pandas-0.14.0.tar.gz (13.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_pandas-0.14.0-py3-none-any.whl (15.8 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_pandas-0.14.0.tar.gz.

File metadata

  • Download URL: etlantic_pandas-0.14.0.tar.gz
  • Upload date:
  • Size: 13.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_pandas-0.14.0.tar.gz
Algorithm Hash digest
SHA256 32fe9c2794746ae4e1188bc50bbe131469cb59be67e400f1ba4915d9a461c0a8
MD5 323f9c55ccec3ed54200bb1f3e96c05c
BLAKE2b-256 f64f6b709c2ca50a2f9b54832641dd4fc29fc0d8f192926350bd0a3cec2f92e1

See more details on using hashes here.

File details

Details for the file etlantic_pandas-0.14.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_pandas-0.14.0-py3-none-any.whl
  • Upload date:
  • Size: 15.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_pandas-0.14.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a5feaa8e8b59a808b5a88d07acdab5adc5a0d2581375113b9e937d2df0e50db7
MD5 f96f8a2968cc5214d72e72f53bd8cb01
BLAKE2b-256 2617cb5e2a3dea7156b0b4c89ea41bf9f961a75a848c72afa8912797b3d86040

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page