Documentation: Python - Rust - Node.js - R | StackOverflow: Python - Rust - Node.js - R | User guide | Discord
Polars: Blazingly fast DataFrames in Rust, Python, Node.js, R, and SQL
Polars is a DataFrame interface on top of an OLAP Query Engine implemented in Rust using Apache Arrow Columnar Format as the memory model.
- Lazy | eager execution
- Multi-threaded
- SIMD
- Query optimization
- Powerful expression API
- Hybrid Streaming (larger-than-RAM datasets)
- Rust | Python | NodeJS | R | ...
To learn more, read the user guide.
Python
>>> import polars as pl
>>> df = pl.DataFrame(
... {
... "A": [1, 2, 3, 4, 5],
... "fruits": ["banana", "banana", "apple", "apple", "banana"],
... "B": [5, 4, 3, 2, 1],
... "cars": ["beetle", "audi", "beetle", "beetle", "beetle"],
... }
... )
# embarrassingly parallel execution & very expressive query language
>>> df.sort("fruits").select(
... "fruits",
... "cars",
... pl.lit("fruits").alias("literal_string_fruits"),
... pl.col("B").filter(pl.col("cars") == "beetle").sum(),
... pl.col("A").filter(pl.col("B") > 2).sum().over("cars").alias("sum_A_by_cars"),
... pl.col("A").sum().over("fruits").alias("sum_A_by_fruits"),
... pl.col("A").reverse().over("fruits").alias("rev_A_by_fruits"),
... pl.col("A").sort_by("B").over("fruits").alias("sort_A_by_B_by_fruits"),
... )
shape: (5, 8)
┌──────────┬──────────┬──────────────┬─────┬─────────────┬─────────────┬─────────────┬─────────────┐
│ fruits ┆ cars ┆ literal_stri ┆ B ┆ sum_A_by_ca ┆ sum_A_by_fr ┆ rev_A_by_fr ┆ sort_A_by_B │
│ --- ┆ --- ┆ ng_fruits ┆ --- ┆ rs ┆ uits ┆ uits ┆ _by_fruits │
│ str ┆ str ┆ --- ┆ i64 ┆ --- ┆ --- ┆ --- ┆ --- │
│ ┆ ┆ str ┆ ┆ i64 ┆ i64 ┆ i64 ┆ i64 │
╞══════════╪══════════╪══════════════╪═════╪═════════════╪═════════════╪═════════════╪═════════════╡
│ "apple" ┆ "beetle" ┆ "fruits" ┆ 11 ┆ 4 ┆ 7 ┆ 4 ┆ 4 │
│ "apple" ┆ "beetle" ┆ "fruits" ┆ 11 ┆ 4 ┆ 7 ┆ 3 ┆ 3 │
│ "banana" ┆ "beetle" ┆ "fruits" ┆ 11 ┆ 4 ┆ 8 ┆ 5 ┆ 5 │
│ "banana" ┆ "audi" ┆ "fruits" ┆ 11 ┆ 2 ┆ 8 ┆ 2 ┆ 2 │
│ "banana" ┆ "beetle" ┆ "fruits" ┆ 11 ┆ 4 ┆ 8 ┆ 1 ┆ 1 │
└──────────┴──────────┴──────────────┴─────┴─────────────┴─────────────┴─────────────┴─────────────┘
SQL
>>> df = pl.scan_csv("docs/assets/data/iris.csv")
>>> ## OPTION 1
>>> # run SQL queries on frame-level
>>> df.sql("""
... SELECT species,
... AVG(sepal_length) AS avg_sepal_length
... FROM self
... GROUP BY species
... """).collect()
shape: (3, 2)
┌────────────┬──────────────────┐
│ species ┆ avg_sepal_length │
│ --- ┆ --- │
│ str ┆ f64 │
╞════════════╪══════════════════╡
│ Virginica ┆ 6.588 │
│ Versicolor ┆ 5.936 │
│ Setosa ┆ 5.006 │
└────────────┴──────────────────┘
>>> ## OPTION 2
>>> # use pl.sql() to operate on the global context
>>> df2 = pl.LazyFrame({
... "species": ["Setosa", "Versicolor", "Virginica"],
... "blooming_season": ["Spring", "Summer", "Fall"]
...})
>>> pl.sql("""
... SELECT df.species,
... AVG(df.sepal_length) AS avg_sepal_length,
... df2.blooming_season
... FROM df
... LEFT JOIN df2 ON df.species = df2.species
... GROUP BY df.species, df2.blooming_season
... """).collect()
SQL commands can also be run directly from your terminal using the Polars CLI:
# run an inline SQL query
> polars -c "SELECT species, AVG(sepal_length) AS avg_sepal_length, AVG(sepal_width) AS avg_sepal_width FROM read_csv('docs/assets/data/iris.csv') GROUP BY species;"
# run interactively
> polars
Polars CLI v0.3.0
Type .help for help.
> SELECT species, AVG(sepal_length) AS avg_sepal_length, AVG(sepal_width) AS avg_sepal_width FROM read_csv('docs/assets/data/iris.csv') GROUP BY species;
Refer to the Polars CLI repository for more information.
Performance 🚀🚀
Blazingly fast
Polars is very fast. In fact, it is one of the best performing solutions available. See the PDS-H benchmarks results.
Lightweight
Polars is also very lightweight. It comes with zero required dependencies, and this shows in the import times:
- polars: 70ms
- numpy: 104ms
- pandas: 520ms
Handles larger-than-RAM data
If you have data that does not fit into memory, Polars' query engine is able to process your query
(or parts of your query) in a streaming fashion. This drastically reduces memory requirements, so
you might be able to process your 250GB dataset on your laptop. Collect with
collect(engine='streaming') to run the query streaming. (This might be a little slower, but it is
still very fast!)
Setup
Python
Install the latest Polars version with:
pip install polars
We also have a conda package (conda install -c conda-forge polars), however pip is the preferred
way to install Polars.
Install Polars with all optional dependencies.
pip install 'polars[all]'
You can also install a subset of all optional dependencies.
pip install 'polars[numpy,pandas,pyarrow]'
See the User Guide for more details on optional dependencies
To see the current Polars version and a full list of its optional dependencies, run:
pl.show_versions()
Releases happen quite often (weekly / every few days) at the moment, so updating Polars regularly to get the latest bugfixes / features might not be a bad idea.
Rust
You can take latest release from crates.io, or if you want to use the latest features /
performance improvements point to the main branch of this repo.
polars = { git = "https://github.com/pola-rs/polars", rev = "<optional git tag>" }
Requires Rust version >=1.80.
Contributing
Want to contribute? Read our contributing guide.
Python: compile Polars from source
If you want a bleeding edge release or maximal performance you should compile Polars from source.
This can be done by going through the following steps in sequence:
- Install the latest Rust compiler
- Install maturin:
pip install maturin cd py-polarsand choose one of the following:make build, slow binary with debug assertions and symbols, fast compile timesmake build-release, fast binary without debug assertions, minimal debug symbols, long compile timesmake build-nodebug-release, same as build-release but without any debug symbols, slightly faster to compilemake build-debug-release, same as build-release but with full debug symbols, slightly slower to compilemake build-dist-release, fastest binary, extreme compile times
By default the binary is compiled with optimizations turned on for a modern CPU. Specify LTS_CPU=1
with the command if your CPU is older and does not support e.g. AVX2.
Note that the Rust crate implementing the Python bindings is called py-polars to distinguish from
the wrapped Rust crate polars itself. However, both the Python package and the Python module are
named polars, so you can pip install polars and import polars.
Using custom Rust functions in Python
Extending Polars with UDFs compiled in Rust is easy. We expose PyO3 extensions for DataFrame and
Series data structures. See more in https://github.com/pola-rs/polars/tree/main/pyo3-polars.
Going big...
Do you expect more than 2^32 (~4.2 billion) rows? Compile Polars with the bigidx feature flag or,
for Python users, install pip install polars-u64-idx.
Don't use this unless you hit the row boundary as the default build of Polars is faster and consumes less memory.
Legacy
Do you want Polars to run on an old CPU (e.g. dating from before 2011), or on an x86-64 build of
Python on Apple Silicon under Rosetta? Install pip install polars-lts-cpu. This version of Polars
is compiled without AVX target features.
Sponsors
Release files for polars-lts-cpu 1.33.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| polars_lts_cpu-1.33.1.tar.gz | 4.8 MB | Details |
Built distributions (wheels)
| File | Reset | |||
|---|---|---|---|---|
| polars_lts_cpu-1.33.1-cp39-abi3-win_arm64.whl | CPython 3.9 | abi3 | Windows ARM64 | Details |
| polars_lts_cpu-1.33.1-cp39-abi3-win_amd64.whl | CPython 3.9 | abi3 | Windows x86-64 | Details |
| polars_lts_cpu-1.33.1-cp39-abi3-manylinux_2_24_aarch64.whl | CPython 3.9 | abi3 | Linux glibc 2.24+ ARM64 | Details |
| polars_lts_cpu-1.33.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl | CPython 3.9 | abi3 | Linux glibc 2.17+ x86-64 | Details |
| polars_lts_cpu-1.33.1-cp39-abi3-macosx_11_0_arm64.whl | CPython 3.9 | abi3 | macOS 11.0+ ARM64 | Details |
| polars_lts_cpu-1.33.1-cp39-abi3-macosx_10_12_x86_64.whl | CPython 3.9 | abi3 | macOS 10.12+ x86-64 | Details |
Total release size: 230.3 MB
Release files / polars_lts_cpu-1.33.1.tar.gz
| Download URL | polars_lts_cpu-1.33.1.tar.gz |
|---|---|
| Size | 4.8 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
0a5426d95ec9eec937a56d3e7cf7911a4b5486c42f4dbbcc9512aa706039322c
|
|
BLAKE2b-256 checksum How to use checksums |
f493a0c4200a5e0af2eee31ea79330cb1f5f4c58f604cb3de352f654e2010c81
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 9, 2025.
Transparency logRelease files / polars_lts_cpu-1.33.1-cp39-abi3-win_arm64.whl
| Download URL | polars_lts_cpu-1.33.1-cp39-abi3-win_arm64.whl |
|---|---|
| Size | 35.4 MB |
| Tags | CPython 3.9 Windows ARM64 abi3 |
|
SHA-256 checksum How to use checksums |
c99ab56b059cee6bcabe9fb89e97f5813be1012a2251bf77f76e15c2d1cba934
|
|
BLAKE2b-256 checksum How to use checksums |
ceadbf3db68d30ac798ca31c80624709a0c03aa890e2e20e5ca987d7e55fcfc2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 9, 2025.
Transparency logRelease files / polars_lts_cpu-1.33.1-cp39-abi3-win_amd64.whl
| Download URL | polars_lts_cpu-1.33.1-cp39-abi3-win_amd64.whl |
|---|---|
| Size | 39.2 MB |
| Tags | CPython 3.9 Windows x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
6b849e0e1485acb8ac39bf13356d280ea7c924c2b41cd548ea6e4d102d70be77
|
|
BLAKE2b-256 checksum How to use checksums |
d40a5ebba9b145388ffbbd09fa84ac3cd7d336b922e34256b1417abf0a1c2fb9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 9, 2025.
Transparency logRelease files / polars_lts_cpu-1.33.1-cp39-abi3-manylinux_2_24_aarch64.whl
| Download URL | polars_lts_cpu-1.33.1-cp39-abi3-manylinux_2_24_aarch64.whl |
|---|---|
| Size | 36.7 MB |
| Tags | CPython 3.9 Linux glibc 2.24+ ARM64 abi3 |
|
SHA-256 checksum How to use checksums |
64574c784380b37167b3db3a7cfdb9839cd308e89b8818859d2ffb34a9c896b2
|
|
BLAKE2b-256 checksum How to use checksums |
54310474c14dce2c0507bea40069daafb848980ba7c351ad991908e51ac895fb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 9, 2025.
Transparency logRelease files / polars_lts_cpu-1.33.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | polars_lts_cpu-1.33.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 39.6 MB |
| Tags | CPython 3.9 Linux glibc 2.17+ x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
656b530a672fe8fbd4c212b2a8481099e5cef63e84970975619ea7c25faeb833
|
|
BLAKE2b-256 checksum How to use checksums |
27fb4dcff801d71dfa02ec682d6b32fd0ce5339de48797f663698d5f8348ffe7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 9, 2025.
Transparency logRelease files / polars_lts_cpu-1.33.1-cp39-abi3-macosx_11_0_arm64.whl
| Download URL | polars_lts_cpu-1.33.1-cp39-abi3-macosx_11_0_arm64.whl |
|---|---|
| Size | 35.6 MB |
| Tags | CPython 3.9 abi3 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
37cf3a56cf447c69cfb3f9cd0e714d5b0c754705d7b497b9ab86cbf56e36b3e7
|
|
BLAKE2b-256 checksum How to use checksums |
81e2dc77b81650ba0c631c06f05d8e81faacee87730600fceca372273facf77b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 9, 2025.
Transparency logRelease files / polars_lts_cpu-1.33.1-cp39-abi3-macosx_10_12_x86_64.whl
| Download URL | polars_lts_cpu-1.33.1-cp39-abi3-macosx_10_12_x86_64.whl |
|---|---|
| Size | 38.9 MB |
| Tags | CPython 3.9 abi3 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
5db75d1b424bd8aa34c9a670a901592f1931cc94d9fb32bdd428dbaad8c33761
|
|
BLAKE2b-256 checksum How to use checksums |
f19b75916636b33724afabe820b0993f60dc243793421d6f680d5fcb531fe170
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 9, 2025.
Transparency log
