Sail Python library

Navigation

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for lakesail from gravatar.com lakesail

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: LakeSail
  • Tags data, big data, sql, spark, pyspark, arrow, datafusion
  • Requires: Python <3.12, >=3.8
Classifiers

Project description

Sail

Build Status PyPI Release PyPI Downloads

The mission of Sail is to unify stream processing, batch processing, and compute-intensive (AI) workloads. Currently, Sail features a drop-in replacement for Spark SQL and the Spark DataFrame API in both single-host and distributed settings.

Installation

Sail is available as a Python package on PyPI. You can install it using pip.

pip install pysail

Alternatively, you can install Sail from source for better performance for your hardware architecture. You would need rustup and protoc in your environment for this.

env RUSTFLAGS="-C target-cpu=native" pip install pysail -v --no-binary pysail

You can follow the Getting Started guide to learn more about Sail.

Documentation

The documentation of the latest Sail version can be found here.

Benchmark Results

Check out our blog post, Supercharge Spark: Quadruple Speed, Cut Costs by 94%, for detailed benchmark results comparing Sail with Spark.

Contributing

Contributions are more than welcome!

Please submit GitHub issues for bug reports and feature requests.

Feel free to create a pull request if you would like to make a code change. You can refer to the development guide to get started.

Support

See the Support Options Page for more information.

Project details

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for lakesail from gravatar.com lakesail

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License
  • Author: LakeSail
  • Tags data, big data, sql, spark, pyspark, arrow, datafusion
  • Requires: Python <3.12, >=3.8
Classifiers

Release history Release notifications | RSS feed

This version

0.2.0.dev0 pre-release

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

0.1.0.dev0 pre-release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pysail-0.2.0.dev0.tar.gz (501.6 kB view details)

Uploaded Source

Built Distributions

pysail-0.2.0.dev0-cp38-abi3-win_amd64.whl (30.1 MB view details)

Uploaded CPython 3.8+ Windows x86-64

pysail-0.2.0.dev0-cp38-abi3-manylinux_2_24_aarch64.whl (28.8 MB view details)

Uploaded CPython 3.8+ manylinux: glibc 2.24+ ARM64

pysail-0.2.0.dev0-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (30.4 MB view details)

Uploaded CPython 3.8+ manylinux: glibc 2.17+ x86-64

pysail-0.2.0.dev0-cp38-abi3-macosx_11_0_arm64.whl (26.8 MB view details)

Uploaded CPython 3.8+ macOS 11.0+ ARM64

pysail-0.2.0.dev0-cp38-abi3-macosx_10_12_x86_64.whl (29.1 MB view details)

Uploaded CPython 3.8+ macOS 10.12+ x86-64

File details

Details for the file pysail-0.2.0.dev0.tar.gz.

File metadata

  • Download URL: pysail-0.2.0.dev0.tar.gz
  • Upload date:
  • Size: 501.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: maturin/1.7.4

File hashes

Hashes for pysail-0.2.0.dev0.tar.gz
Algorithm Hash digest
SHA256 f0435c1231b37a2d64faece7186c2d2d255f1b4e4c58cf1f1c3f6c8068fa2b74
MD5 a6ac98c9327eeb4e61847d05aa47bcd5
BLAKE2b-256 701402fac3e82f8234a2c73a8945daceda8b1c1699d2fb3102c4495a0e482510

See more details on using hashes here.

File details

Details for the file pysail-0.2.0.dev0-cp38-abi3-win_amd64.whl.

File metadata

File hashes

Hashes for pysail-0.2.0.dev0-cp38-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 38627f5a7bcf1535aff18d6d20d6fff399259032ca635a95c9a7d94644c8aba1
MD5 f5058f319e0b95f5d150975873e04b10
BLAKE2b-256 08194a7e319f41e262bb08bdbf2d9b6efd26f2777555a5a078e61817dd1281af

See more details on using hashes here.

File details

Details for the file pysail-0.2.0.dev0-cp38-abi3-manylinux_2_24_aarch64.whl.

File metadata

File hashes

Hashes for pysail-0.2.0.dev0-cp38-abi3-manylinux_2_24_aarch64.whl
Algorithm Hash digest
SHA256 e12ac86700c1871eba3ebe46e9deee366e35e0fc0059ae90175964559b367930
MD5 1085f7c5c769e90194b454ebdef185b9
BLAKE2b-256 1c8e399a1f8b53fb91dd7332c67c6a48b4ebadd8bd8c6b4959ba627619be519c

See more details on using hashes here.

File details

Details for the file pysail-0.2.0.dev0-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for pysail-0.2.0.dev0-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 e73a105098ab1adee6e562e95c1b7456f550ce562950d47f7e2d9884058750cb
MD5 b10e5ce1e7c74e3a9345a2f252127151
BLAKE2b-256 02e9482c5ebaa9f9334795df522e38e3d2eea128ababba4d1cb2e666b283af68

See more details on using hashes here.

File details

Details for the file pysail-0.2.0.dev0-cp38-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for pysail-0.2.0.dev0-cp38-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 1bbd37bbfccbd831b715d0bbe9088ba3f3a14e7db96493c7af38a70e82d2fa49
MD5 f5d7aa540ca5286a666fd57db4a60369
BLAKE2b-256 58b4c2ff558efbde423d168b9a4290f90217b1a911140adaad1ba848ca43f48d

See more details on using hashes here.

File details

Details for the file pysail-0.2.0.dev0-cp38-abi3-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for pysail-0.2.0.dev0-cp38-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 dcf8a70575ea577949f82e8b96c6002f5617c4e2c28ef43b2e63e3a2868e17e8
MD5 2059506104d8d5741645948a45ba37a4
BLAKE2b-256 938cbdc7355d0d799ee56cf97dc8791cb37b9fd6ae5e7cb185ef0866f1a5a3ac

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page