Skip to main content

Polars dataframe execution plugin for ETLantic.

Project description

etlantic-polars

Polars dataframe plugin and Polars portable transform compiler for ETLantic 0.13.

pip install 'etlantic==0.13.0' 'etlantic-polars==0.13.0'
# optional Arrow interchange
pip install 'etlantic-polars[arrow]'

Dataframe plugin

Supports eager DataFrame execution and LazyFrame preservation until an explicit collection boundary declared in the PipelinePlan.

Entry point: etlantic.dataframe_pluginsetlantic_polars:create_plugin.

Portable transform compiler (0.13)

Claims dtcs:profile/portable-relational-kernel/1 and dtcs:profile/portable-relational/1. Executes kernel actions plus join, union, aggregate, sort, distinct, deduplicate, and limit without a native @implementation("polars").

from etlantic import Profile
from etlantic_polars import create_transform_compiler

Profile(
    name="polars-portable",
    dataframe_engine="polars",
    portable_transform_policy="require",  # or prefer / native
)
compiler = create_transform_compiler()
print(compiler.info.name, sorted(compiler.info.capabilities.profiles))

Entry point: etlantic.transform_compilersetlantic_polars:create_transform_compiler.

Runnable example: examples/portable_polars_kernel.py in the ETLantic repo.

Windows, complex-values, conversion, and Rich Portable Analytics compiler claims remain later (0.15+). See the compiler protocol and compatibility matrix.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_polars-0.13.0.tar.gz (11.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_polars-0.13.0-py3-none-any.whl (14.2 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_polars-0.13.0.tar.gz.

File metadata

  • Download URL: etlantic_polars-0.13.0.tar.gz
  • Upload date:
  • Size: 11.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_polars-0.13.0.tar.gz
Algorithm Hash digest
SHA256 0d6a4b17a727ccd50d541e5368d5a48ce230957c7081b70339677665f781587b
MD5 466e56d5878a9ded891c3d60e9be0e9d
BLAKE2b-256 6193e5d7ea1262d50f008cfba6fa7ed25ce1fbc362aed79073489c47da036191

See more details on using hashes here.

File details

Details for the file etlantic_polars-0.13.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_polars-0.13.0-py3-none-any.whl
  • Upload date:
  • Size: 14.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_polars-0.13.0-py3-none-any.whl
Algorithm Hash digest
SHA256 538d46c3c00fb74b21623b41f98fbc28f7358aee0b78b06d14aaa8e11c9531ee
MD5 cd48fe82fc9faaaddff2512e04ac651c
BLAKE2b-256 aa886a4cd1f72343bb12bd9c5b09e2437175772202b50c57f856bb742492de4b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page