Bytewax
Bytewax is an open source Python framework for building highly scalable dataflows.
Bytewax uses PyO3 to provide Python bindings to the Timely Dataflow Rust library.
Usage
Install the latest release with pip:
pip install bytewax
Example
Here is an example of a simple dataflow program using Bytewax:
from bytewax import Executor
ec = Executor()
flow = ec.Dataflow(enumerate(range(10)))
flow.map(lambda x: x * x)
flow.inspect(print)
if __name__ == "__main__":
ec.build_and_run()
Running the program:
python ./pyexamples/wordcount.py
0
1
4
9
16
25
36
49
81
64
For a more complete example, and documentation on the available operators, check out the User Guide.
License
Bytewax is licensed under the Apache-2.0 license.
1 maintainer
Metadata
1 maintainer
Release files for bytewax 0.6.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| bytewax-0.6.1.tar.gz | 27.0 kB | Details |
Built distributions (wheels)
Total release size: 16.5 MB
Release files / bytewax-0.6.1.tar.gz
| Download URL | bytewax-0.6.1.tar.gz |
|---|---|
| Size | 27.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
ce062b1342b6c48cbb0feb45975a7e89feb3ce5577c68f639053e2e8c81a7c89
|
|
BLAKE2b-256 checksum How to use checksums |
3f429786b4f3fecfe701f523504b30fd7a7a40df3c09b4417d486c4199c10345
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-pp37-pypy37_pp73-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
| Download URL | bytewax-0.6.1-pp37-pypy37_pp73-manylinux_2_12_x86_64.manylinux2010_x86_64.whl |
|---|---|
| Size | 1.6 MB |
| Tags | Linux glibc 2.12+ x86-64 PyPy 3.7 PyPy 3.7 7.3 |
|
SHA-256 checksum How to use checksums |
3defd3715eadae5cfe0ec80b7d0a42fbba55a337e8c0836d403e014ae1520dbf
|
|
BLAKE2b-256 checksum How to use checksums |
8a98345e07915eaaf8213626aec464c4b7b028b9aa7eca0fb880c415e82d208f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-cp310-none-win_amd64.whl
| Download URL | bytewax-0.6.1-cp310-none-win_amd64.whl |
|---|---|
| Size | 618.6 kB |
| Tags | CPython 3.10 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
3ceb30df97eea79d912777b054be7a2a140f27f6640057d487c17a0f08950bb9
|
|
BLAKE2b-256 checksum How to use checksums |
0d68935da0b95aef408d818a8e2d74c8079ba6b117d5c9d2cb35c70251793f45
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
| Download URL | bytewax-0.6.1-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl |
|---|---|
| Size | 1.6 MB |
| Tags | CPython 3.10 Linux glibc 2.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
3f467769f5fba8b4a8fb8e13343150aa0c48261d95d6f4cdc7f4353d7a718215
|
|
BLAKE2b-256 checksum How to use checksums |
805058389e58269caa24ef0d2e178e8fec0eb58709ffdf5c25bd8a715bf5094e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-cp310-cp310-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
| Download URL | bytewax-0.6.1-cp310-cp310-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl |
|---|---|
| Size | 1.5 MB |
| Tags | CPython 3.10 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
4f4f983bb5b36f4901bc54e216561cdf8d25f3ead895607ee3db51a560de2af2
|
|
BLAKE2b-256 checksum How to use checksums |
47a4f1e5f7a17d2199c7fce5126303a422ec1e1f734b5ecf3a023f0ad0db089a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-cp39-none-win_amd64.whl
| Download URL | bytewax-0.6.1-cp39-none-win_amd64.whl |
|---|---|
| Size | 618.4 kB |
| Tags | CPython 3.9 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
d9650ea9dd1c84bafb963a018d43249e245a221e9425f6fa844adc443c9ea594
|
|
BLAKE2b-256 checksum How to use checksums |
4a3768420e39a8b0f7b0cba2e0788b83ab71d8f3de287ce518c145b47f5c3fc9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
| Download URL | bytewax-0.6.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl |
|---|---|
| Size | 1.6 MB |
| Tags | CPython 3.9 Linux glibc 2.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
d0cb7f514d72364c96751452cbb1eb3412799e201de8987256c3d5627a2070b6
|
|
BLAKE2b-256 checksum How to use checksums |
52bf6c9a7868f4416a20d0b058b380e9c5dacc0745156db85cbf58cda19de3a4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-cp39-cp39-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
| Download URL | bytewax-0.6.1-cp39-cp39-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl |
|---|---|
| Size | 1.5 MB |
| Tags | CPython 3.9 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
ee2055d1b384eaee61f5e4222afb2030fb6df4cc1f1b7f9957057108f46b5ec4
|
|
BLAKE2b-256 checksum How to use checksums |
98a57584dcf2f0382feb8cdfef287903c93ebb24793572db0a9e860ddedd9a36
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-cp38-none-win_amd64.whl
| Download URL | bytewax-0.6.1-cp38-none-win_amd64.whl |
|---|---|
| Size | 618.5 kB |
| Tags | CPython 3.8 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
fd6dc3f8b53cc6c605ff9e1333d8704b2761455043a0cfc30892b09c6c40c780
|
|
BLAKE2b-256 checksum How to use checksums |
4cb0eae590729b290a0d20e6e8d98d76dd7f5ad80ab459ab8fad28e502830fd2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
| Download URL | bytewax-0.6.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl |
|---|---|
| Size | 1.6 MB |
| Tags | CPython 3.8 Linux glibc 2.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
856d49140dc846341ab8f9c614890514bf78785329d521e481b1ce736d0553d4
|
|
BLAKE2b-256 checksum How to use checksums |
992ca042668fdb732380dd31f5df0fa1a5c12a55b0f50d710f0eb73591557fe3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-cp38-cp38-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
| Download URL | bytewax-0.6.1-cp38-cp38-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl |
|---|---|
| Size | 1.5 MB |
| Tags | CPython 3.8 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
b0e05c92953380269ee43162332b7fef93da7d893ad355b767aaaadd8be5da58
|
|
BLAKE2b-256 checksum How to use checksums |
76e56b10c35318d77a7a1211d917c5ae9c3ddd00ccf2c4b5677dba1c6e5498da
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-cp37-none-win_amd64.whl
| Download URL | bytewax-0.6.1-cp37-none-win_amd64.whl |
|---|---|
| Size | 618.8 kB |
| Tags | CPython 3.7 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
633b8ac93a40d3024a14fddd2e0afe5a6c030efbc0df9f69e08d866acef865c3
|
|
BLAKE2b-256 checksum How to use checksums |
f061d43ef8c66898d83f65c2e97fb7cebcc1f5d2dffe36406366a2217388d87e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
| Download URL | bytewax-0.6.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl |
|---|---|
| Size | 1.6 MB |
| Tags | CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
79c0d92cd789ce15ffcda97576840f268588b4b71d55d0ba828b1c1dd4c606b0
|
|
BLAKE2b-256 checksum How to use checksums |
5505377946c5de78aa7a4a21f46739f6365d45652d5096b556403b2ab3411283
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
Release files / bytewax-0.6.1-cp37-cp37m-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
| Download URL | bytewax-0.6.1-cp37-cp37m-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl |
|---|---|
| Size | 1.5 MB |
| Tags | CPython 3.7 CPython 3.7 pymalloc macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
8b2127c3eddc685980fc14cd693a56dfabb077290cf0dc85c4a471a4c0299a8b
|
|
BLAKE2b-256 checksum How to use checksums |
c5d8f735b9ece92fc9d124434fbdcb994b6233c55e37cb8f2ae8b99ec1388297
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.10.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
|
