Image showing the Polars Cloud logo

Polars Cloud: Run your queries at scale, anywhere

Built on top of the popular open source project, Polars Cloud enables you to write DataFrame code once and run it anywhere. The distributed engine available with Polars Cloud allows you to scale your Polars queries beyond a single machine.

Key Features of Polars Cloud

  • Unified DataFrame Experience: Run a Polars query seamlessly on your local machine or at scale with our new distributed engine. All from the same API.
  • Serverless Compute: Effortlessly start compute resources without managing infrastructure, with options to run queries on both CPU and GPU.
  • Any Environment: Start a remote query from a notebook on your machine, Airflow DAG, AWS Lambda, or any server. Get the flexibility to embed Polars Cloud in any environment.

Install Polars Cloud

To use Polars cloud simply add it to your existing project

pip install polars_cloud

Then call .remote() on your dataframe and provide a compute context.

import polars as pl
import polars_cloud as pc

ctx = pc.ComputeContext(cpus=16, memory=64)

query = (
    pl.scan_parquet("s3://my-dataset/")
    .group_by("returned", "status")
    .agg(
        avg_price=pl.mean("price"),
        avg_disc=pl.mean("discount"),
        count_order=pl.len(),
    )
)

(
    query.remote(ctx)
    .distributed()
    .sink_parquet("s3://my-destination/")
)

Hit run and your query will be executed in the cloud. You can follow your query's progress on the dashboard. And once your first query is done it's time to increase your dataset size and up the core count.

Sign up today

Sign up here to run Polars Cloud.

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

2 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for c-peters from gravatar.com c-peters Avatar for ritchie46 from gravatar.com ritchie46

Credits

Author: Polars

License

MIT License

Requires

Python >=3.10

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

polars_cloud-0.10.0.tar.gz (165.5 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

polars_cloud-0.10.0-cp310-abi3-win_arm64.whl (5.0 MB view details)

Uploaded CPython 3.10+Windows ARM64

polars_cloud-0.10.0-cp310-abi3-win_amd64.whl (5.1 MB view details)

Uploaded CPython 3.10+Windows x86-64

polars_cloud-0.10.0-cp310-abi3-manylinux_2_28_x86_64.whl (5.7 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.28+ x86-64

polars_cloud-0.10.0-cp310-abi3-manylinux_2_28_aarch64.whl (5.4 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.28+ ARM64

polars_cloud-0.10.0-cp310-abi3-macosx_11_0_arm64.whl (5.2 MB view details)

Uploaded CPython 3.10+macOS 11.0+ ARM64

polars_cloud-0.10.0-cp310-abi3-macosx_10_12_x86_64.whl (5.5 MB view details)

Uploaded CPython 3.10+macOS 10.12+ x86-64

File details

Details for the file polars_cloud-0.10.0.tar.gz.

File metadata

  • Download URL: polars_cloud-0.10.0.tar.gz
  • Upload date:
  • Size: 165.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for polars_cloud-0.10.0.tar.gz
Algorithm Hash digest
SHA256 49438e9d73b1877130a4044647eb410132718bc54530f5d89768cccc5c238685
MD5 e7403804ce439138ca0834c582e2d5d4
BLAKE2b-256 db6c9b40ba54cdf4a0433ec438786c348699ec185c4d942a6afa895847d72e76

See more details on using hashes here.

Provenance

The following attestation bundles were made for polars_cloud-0.10.0.tar.gz:

Publisher: release-python.yml on polars-inc/polars-cloud

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file polars_cloud-0.10.0-cp310-abi3-win_arm64.whl.

File metadata

File hashes

Hashes for polars_cloud-0.10.0-cp310-abi3-win_arm64.whl
Algorithm Hash digest
SHA256 f6044b68d76a2090969d189380adf5705bcad1195506e5efafecd0384af1f48a
MD5 f0614719246ba3f4aea3c84535796e55
BLAKE2b-256 527d633f5a7daf9fc6a56dad2e77c6eac93a88e38c37cb0222edb24d79d9723f

See more details on using hashes here.

Provenance

The following attestation bundles were made for polars_cloud-0.10.0-cp310-abi3-win_arm64.whl:

Publisher: release-python.yml on polars-inc/polars-cloud

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file polars_cloud-0.10.0-cp310-abi3-win_amd64.whl.

File metadata

File hashes

Hashes for polars_cloud-0.10.0-cp310-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 91fc9a1f572c71886f9210735e6fbc2b15823532142dba222ca2bce5ea526e61
MD5 00bf49840dba988aae9c23867f81e7ed
BLAKE2b-256 4a6f5e3b385c627540a90c762c170c2a5ef93f23c5b0fff73576334979083607

See more details on using hashes here.

Provenance

The following attestation bundles were made for polars_cloud-0.10.0-cp310-abi3-win_amd64.whl:

Publisher: release-python.yml on polars-inc/polars-cloud

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file polars_cloud-0.10.0-cp310-abi3-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for polars_cloud-0.10.0-cp310-abi3-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 b9a2a272a31bdc7d97978045355e96ab74763352d32bcfcb26cd4e13da663949
MD5 8da2bb2198c2f9e5b0a8d39172c943ec
BLAKE2b-256 3e2a390be42a7433be3bc3f3cfa01a6d8bfa78be1c0967da412eb278036d2ea6

See more details on using hashes here.

Provenance

The following attestation bundles were made for polars_cloud-0.10.0-cp310-abi3-manylinux_2_28_x86_64.whl:

Publisher: release-python.yml on polars-inc/polars-cloud

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file polars_cloud-0.10.0-cp310-abi3-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for polars_cloud-0.10.0-cp310-abi3-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 2247583461cc85d6b4e4109f3f260bb41f2329c1d07a1b60f0d8649da398252d
MD5 c8cc0c5c87b20ba20fdfbf281aee6cc6
BLAKE2b-256 955bc246ea5724fb2deeb53d3e160efb4a2f40501b9489d0509a16793bde5c39

See more details on using hashes here.

Provenance

The following attestation bundles were made for polars_cloud-0.10.0-cp310-abi3-manylinux_2_28_aarch64.whl:

Publisher: release-python.yml on polars-inc/polars-cloud

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file polars_cloud-0.10.0-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for polars_cloud-0.10.0-cp310-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 83db75b74be0a934fa12dd09ec8f0a41b7609d4713c4a425dd1c9e56770c17e9
MD5 11ab426efd81e33a496e23e4f43e1894
BLAKE2b-256 e4f652f7a4f9d1a7727ef813b9b079d86097f1d529af43774d774a124b9b159a

See more details on using hashes here.

Provenance

The following attestation bundles were made for polars_cloud-0.10.0-cp310-abi3-macosx_11_0_arm64.whl:

Publisher: release-python.yml on polars-inc/polars-cloud

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file polars_cloud-0.10.0-cp310-abi3-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for polars_cloud-0.10.0-cp310-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 8bff0b40583f0328fccf9a9b0d9437a7261485c122687349ebfe59c38e53e2fd
MD5 d0e31b3676b86090acb4b931d3d90a6b
BLAKE2b-256 0af7f14b0a35c72de4b6cc7b305fa141be9f759ffd031d709c7179cec6647260

See more details on using hashes here.

Provenance

The following attestation bundles were made for polars_cloud-0.10.0-cp310-abi3-macosx_10_12_x86_64.whl:

Publisher: release-python.yml on polars-inc/polars-cloud

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page