Dask Expressions
Dask DataFrames with query optimization.
This is a rewrite of Dask DataFrame that includes query optimization and generally improved organization.
More in our blog posts:
Example
import dask_expr as dx
df = dx.datasets.timeseries()
df.head()
df.groupby("name").x.mean().compute()
Query Representation
Dask-expr encodes user code in an expression tree:
>>> df.x.mean().pprint()
Mean:
Projection: columns='x'
Timeseries: seed=1896674884
This expression tree will be optimized and modified before execution:
>>> df.x.mean().optimize().pprint()
Div:
Sum:
Fused(375f9):
| Projection: columns='x'
| Timeseries: dtypes={'x': <class 'float'>} seed=1896674884
Count:
Fused(375f9):
| Projection: columns='x'
| Timeseries: dtypes={'x': <class 'float'>} seed=1896674884
Stability
This is the default backend for dask.DataFrame since version 2024.3.0.
API Coverage
Dask-Expr covers almost everything of the Dask DataFrame API. The only missing features are:
- named GroupBy Aggregations
4 maintainers
Metadata
4 maintainers
Release files for dask-expr 2.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| dask_expr-2.0.0.tar.gz | 3.8 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| dask_expr-2.0.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 7.0 kB
Release files / dask_expr-2.0.0.tar.gz
| Download URL | dask_expr-2.0.0.tar.gz |
|---|---|
| Size | 3.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e6d5a7bdff927aa4a1754a76cad79c5925254c525f568038df7832fcd558fc11
|
|
BLAKE2b-256 checksum How to use checksums |
c2d51c3311f7e0fee2415fe61fdd0c30e88134767cb3b5da8ee653eaf4c052de
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.0 CPython/3.12.4
|
Release files / dask_expr-2.0.0-py3-none-any.whl
| Download URL | dask_expr-2.0.0-py3-none-any.whl |
|---|---|
| Size | 3.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
8840da136aadd2c4d672990744c4b82179b69ecaba991db767c62a855a31852f
|
|
BLAKE2b-256 checksum How to use checksums |
d0f5f0ae5e6b38d3383508b7a6669c90def361a4caa7b8b3b7e673828e34ac2e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.0 CPython/3.12.4
|
Security for dask-expr 2.0.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
