Skip to main content

Polars dataframe execution plugin for ETLantic.

Project description

etlantic-polars

Polars dataframe plugin and Polars portable transform compiler for ETLantic 0.14.

pip install 'etlantic==0.14.0' 'etlantic-polars==0.14.0'
# optional Arrow interchange
pip install 'etlantic-polars[arrow]==0.14.0'

Dataframe plugin

Supports eager DataFrame execution and LazyFrame preservation until an explicit collection boundary declared in the PipelinePlan.

Entry point: etlantic.dataframe_pluginsetlantic_polars:create_plugin.

Portable transform compiler (0.14)

Claims dtcs:profile/portable-relational-kernel/1 and dtcs:profile/portable-relational/1. Executes kernel actions plus join, union, aggregate, sort, distinct, deduplicate, and limit without a native @implementation("polars").

from etlantic import Profile
from etlantic_polars import create_transform_compiler

Profile(
    name="polars-portable",
    dataframe_engine="polars",
    portable_transform_policy="require",  # or prefer / native
)
compiler = create_transform_compiler()
print(compiler.info.name, sorted(compiler.info.capabilities.profiles))

Entry point: etlantic.transform_compilersetlantic_polars:create_transform_compiler.

Runnable example: examples/portable_polars_kernel.py in the ETLantic repo.

Windows, complex-values, conversion, and Rich Portable Analytics compiler claims remain later (0.15+). See the compiler protocol and compatibility matrix.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etlantic_polars-0.14.0.tar.gz (11.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etlantic_polars-0.14.0-py3-none-any.whl (14.3 kB view details)

Uploaded Python 3

File details

Details for the file etlantic_polars-0.14.0.tar.gz.

File metadata

  • Download URL: etlantic_polars-0.14.0.tar.gz
  • Upload date:
  • Size: 11.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_polars-0.14.0.tar.gz
Algorithm Hash digest
SHA256 d52f872447afbb9669a5abbea770c7388c69462bb5549a50f2f045cc41ca38a8
MD5 7441042d267e82932cbdc4307d2a0287
BLAKE2b-256 539c245c23b8321e0c524f2898bb82838b8829066e2026f1c2d6c785cd836c0f

See more details on using hashes here.

File details

Details for the file etlantic_polars-0.14.0-py3-none-any.whl.

File metadata

  • Download URL: etlantic_polars-0.14.0-py3-none-any.whl
  • Upload date:
  • Size: 14.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for etlantic_polars-0.14.0-py3-none-any.whl
Algorithm Hash digest
SHA256 e5a017edfd27bd3ff018144423d50265a57a5d7c467fa18c12e86e7e42005036
MD5 57a5ac5048807898049eaf738c3bce10
BLAKE2b-256 459c586dad7c40b2810992572b10bd9dc4589fe03afe351758b1d330cd457cd4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page