Polars Normal Stats
Fast normal distribution functions (CDF, PPF, PDF) for Polars DataFrames, implemented as a Polars plugin in Rust.
This plugin provides highly optimized implementations of the Normal (Gaussian) distribution functions, offering significant speedups over calling SciPy's norm functions within a Polars map_batches or apply (now map_elements).
Features
- normal_cdf(x, mean=0.0, std=1.0): Cumulative Distribution Function.
- normal_ppf(p, mean=0.0, std=1.0): Percent Point Function (Inverse CDF).
- normal_pdf(x, mean=0.0, std=1.0): Probability Density Function.
- Fully compatible with Polars' lazy execution and expression API.
- Optimized using Rust
kwargsfor distribution parameters.
Installation
Install using uv:
uv add polars-normal-stats
Install using pip:
pip install polars-normal-stats
(Note: Ensure you have polars installed as well.)
Usage
The functions are designed to work directly within Polars expressions.
import polars as pl
from polars_normal_stats import normal_cdf, normal_ppf, normal_pdf
df = pl.DataFrame({
"x": [-1.0, 0.0, 1.0],
"p": [0.1, 0.5, 0.9]
})
result = df.select([
normal_cdf(pl.col("x")).alias("cdf"),
normal_ppf(pl.col("p"), mean=10.0, std=2.0).alias("ppf_shifted"),
normal_pdf(pl.col("x"), mean=0.0, std=1.0).alias("pdf")
])
print(result)
Lazy Execution
Since these functions return Polars expressions, they integrate seamlessly into Polars' lazy API. This allows Polars to optimize the entire query plan, including these statistical operations.
lazy_result = (
pl.scan_parquet("data.parquet")
.with_columns(
z_score = normal_cdf(pl.col("value"), mean=100.0, std=15.0)
)
.collect()
)
Benchmarks
The plugin is significantly faster than using SciPy's normal distribution functions via Polars' map_batches. Below are the results comparing the execution time for varying data sizes.
Results averaged over 10 iterations:
| Function | Size | SciPy (s) | Plugin (s) | Speedup |
|---|---|---|---|---|
| CDF | 100,000 | 0.0019 | 0.0014 | 1.40x |
| PPF | 100,000 | 0.0027 | 0.0015 | 1.81x |
| 100,000 | 0.0016 | 0.0004 | 4.12x | |
| CDF | 1,000,000 | 0.0202 | 0.0131 | 1.54x |
| PPF | 1,000,000 | 0.0272 | 0.0137 | 1.99x |
| 1,000,000 | 0.0237 | 0.0043 | 5.58x | |
| CDF | 10,000,000 | 0.2293 | 0.1303 | 1.76x |
| PPF | 10,000,000 | 0.2816 | 0.1317 | 2.14x |
| 10,000,000 | 0.2459 | 0.0389 | 6.33x | |
| CDF | 25,000,000 | 0.5747 | 0.3269 | 1.76x |
| PPF | 25,000,000 | 0.7041 | 0.3291 | 2.14x |
| 25,000,000 | 0.6210 | 0.0985 | 6.30x |
Benchmarks performed on 25,000,000 rows show up to a 6.3x speedup for PDF calculations.
Credits
This plugin was developed using the excellent polars-xdt as a template and acknowledges the work of Marco Gorelli, Ritchie Vink, and the Polars contributors for making Python-Rust plugin development accessible.
It also relies on the statrs crate for statistical computations and PyO3 for Rust-Python bindings.
License
This project is licensed under the MIT License - see the LICENSE file for details.
Metadata
Release files for polars-normal-stats 0.3.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| polars_normal_stats-0.3.0-cp39-abi3-win_amd64.whl | CPython 3.9 | abi3 | Windows x86-64 | Details for polars_normal_stats-0.3.0-cp39-abi3-win_amd64.whl |
| polars_normal_stats-0.3.0-cp39-abi3-manylinux_2_34_x86_64.whl | CPython 3.9 | abi3 | Linux glibc 2.34+ x86-64 | Details for polars_normal_stats-0.3.0-cp39-abi3-manylinux_2_34_x86_64.whl |
Total release size: 10.2 MB
Release files / polars_normal_stats-0.3.0-cp39-abi3-win_amd64.whl
| Download URL | polars_normal_stats-0.3.0-cp39-abi3-win_amd64.whl |
|---|---|
| Size | 4.9 MB |
| Tags | CPython 3.9 Windows x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
f0cef95e5fd8051bf686f8bcda12902a8cb46d227a32f2c890ce8b203e6dd1a8
|
|
BLAKE2b-256 checksum How to use checksums |
da2719b9aba956fc1c8e4b88105eaa7dfc2edb479669cedd6f9342bf197875de
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.14.1
|
Release files / polars_normal_stats-0.3.0-cp39-abi3-manylinux_2_34_x86_64.whl
| Download URL | polars_normal_stats-0.3.0-cp39-abi3-manylinux_2_34_x86_64.whl |
|---|---|
| Size | 5.3 MB |
| Tags | CPython 3.9 Linux glibc 2.34+ x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
2e0f898c783fc4f3c8c47315a4710c6f09e73ee452fec92956ba5fa337733c7e
|
|
BLAKE2b-256 checksum How to use checksums |
fcac53826cdae50285299f64ece873b48486c0e036b1d7f2e3c506183b66438a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.14.1
|
Security for polars-normal-stats 0.3.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.