Skip to main content

Polars dataframe execution plugin for ETLantic.

Project description

etlantic-polars

Polars dataframe plugin and Polars portable kernel transform compiler for ETLantic 0.12.

pip install 'etlantic==0.12.0' 'etlantic-polars==0.12.0'
# optional Arrow interchange
pip install 'etlantic-polars[arrow]'

Dataframe plugin

Supports eager DataFrame execution and LazyFrame preservation until an explicit collection boundary declared in the PipelinePlan.

Entry point: etlantic.dataframe_pluginsetlantic_polars:create_plugin.

Portable transform compiler (0.12)

Claims dtcs:profile/portable-relational-kernel/1 and executes kernel actions (filter, project, with_fields, drop_fields, rename_fields) plus the kernel function set without a native @implementation("polars").

from etlantic import Profile
from etlantic_polars import create_transform_compiler

Profile(
    name="polars-portable",
    dataframe_engine="polars",
    portable_transform_policy="require",  # or prefer / native
)
compiler = create_transform_compiler()
print(compiler.info.name, sorted(compiler.info.capabilities.actions)[:3])

Entry point: etlantic.transform_compilersetlantic_polars:create_transform_compiler.

Runnable example: examples/portable_polars_kernel.py in the ETLantic repo.

Joins, windows, and conversion-profile functions remain unsupported until later releases (0.13+). See the compiler protocol and compatibility matrix.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_polars-0.12.0.tar.gz (9.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_polars-0.12.0-py3-none-any.whl (11.3 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_polars-0.12.0.tar.gz.

File metadata

  • Download URL: etlantic_polars-0.12.0.tar.gz
  • Upload date:
  • Size: 9.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_polars-0.12.0.tar.gz
Algorithm Hash digest
SHA256 e958af61a32292470d0f3173613f9a3275f6e7bac6b71344ccb72e679fbbf990
MD5 1c9568088dd25d79811e158e5adf6702
BLAKE2b-256 c77cda7411868883f7174562f180e980de2bc6a710b9cb6898d1076c12047b3f

See more details on using hashes here.

File details

Details for the file etlantic_polars-0.12.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_polars-0.12.0-py3-none-any.whl
  • Upload date:
  • Size: 11.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_polars-0.12.0-py3-none-any.whl
Algorithm Hash digest
SHA256 483c8d3e0546fd16af2cc8fb626093c4a9bf0dbc7774e798f2546506c490d14b
MD5 bf0029eb780c29c6b799c8816bee99ee
BLAKE2b-256 92c90530e039ceeff2cebedccca4494b204738ddee5eb5163c0ae279e4e44c5f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page