etlantic-polars
Polars dataframe plugin and Polars portable transform compiler for
ETLantic 0.43. Install when
you select Profile(dataframe_engine="polars") or need portable DTCS
compilation on Polars. Keep the pin matched to core.
Note: This plugin and ETLantic core use Beta classifiers for documented single-tenant pilots. Classifiers are not an enterprise SLA.
Install
pip install 'etlantic-polars==0.54.0'
# Optional Arrow interchange:
pip install 'etlantic-polars[arrow]==0.54.0'
# pip install 'etlantic==0.54.0'
Dataframe plugin
Supports eager DataFrame execution and LazyFrame preservation until an
explicit collection boundary declared in the PipelinePlan.
Entry point: etlantic.dataframe_plugins → etlantic_polars:create_plugin.
Portable transform compiler
Claims dtcs:profile/portable-relational-kernel/1 and
dtcs:profile/portable-relational/1. Executes kernel actions plus join, union,
aggregate, sort, distinct, deduplicate, and limit without a native
@implementation("polars").
This is the recommended transformation path and remains eligible for adaptive
execution; a native Polars body pins its step to Polars.
from etlantic import Profile
from etlantic_polars import create_transform_compiler
Profile(
name="polars-portable",
dataframe_engine="polars",
portable_transform_policy="require", # or prefer / native
)
compiler = create_transform_compiler()
print(compiler.info.name, sorted(compiler.info.capabilities.profiles))
Entry point: etlantic.transform_compilers →
etlantic_polars:create_transform_compiler.
Runnable example: examples/portable_polars_kernel.py in the ETLantic repo.
Window V1, complex-type/value, and conversion profiles are available in the current compiler; explicit window frames and Window V2 remain capability-gated. See the compiler protocol and compatibility matrix.
Bounded Parquet snapshots
create_parquet_storage() reads a single policy-approved source through a
verified handle into bounded immutable bytes. Native scans use those bytes,
so replacing or renaming the source or its parent cannot replace the snapshot.
No filesystem artifact or additional approved root is required. Keep scans
inside open_scan() until all native work has drained; cancellation of an
ordinary read waits for that work.
A bounded Compact-Thrift footer pass removes optional file key/value metadata,
including ARROW:schema, before PyArrow or Polars constructs a reader. Custom
Arrow extension semantics are discarded without invoking deserializers; every
physical column must still pass the primitive int64/boolean gate. PyArrow 14
and later are supported without the newer arrow_extensions_enabled keyword.
The snapshot uses memory proportional to the configured byte budget, including
bounded copies during footer sanitization and native scan construction.
The cleanup inspection methods remain available for compatibility. Buffer snapshots create no disk cleanup obligations; unknown cleanup tokens reject.
Links
1 maintainer
Release files for etlantic-polars 0.54.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| etlantic_polars-0.54.0.tar.gz | 23.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| etlantic_polars-0.54.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 50.2 kB
Release files / etlantic_polars-0.54.0.tar.gz
| Download URL | etlantic_polars-0.54.0.tar.gz |
|---|---|
| Size | 23.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
6a4b8c0bc1885ffcfa48b7abcff42468c89ba2bf5099c30681c762e720e1500f
|
|
BLAKE2b-256 checksum How to use checksums |
833e65f59b663fb0a062353340c3818cbc8e0524c3d05580d7435707baec40da
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / etlantic_polars-0.54.0-py3-none-any.whl
| Download URL | etlantic_polars-0.54.0-py3-none-any.whl |
|---|---|
| Size | 27.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
16fc3906fa1dbbf5d23b3406a45dc4f61f2c2fa5b6b217cbcec0398976656f04
|
|
BLAKE2b-256 checksum How to use checksums |
d9a772ab71958f7906d9b97e708e52aa27b8c6789f115b72ba845c220f1c2bad
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
