bytewax 0.6.1

No project description provided

Bytewax

Bytewax is an open source Python framework for building highly scalable dataflows.

Bytewax uses PyO3 to provide Python bindings to the Timely Dataflow Rust library.

Usage

Install the latest release with pip:

pip install bytewax

Example

Here is an example of a simple dataflow program using Bytewax:

from bytewax import Executor

ec = Executor()
flow = ec.Dataflow(enumerate(range(10)))
flow.map(lambda x: x * x)
flow.inspect(print)


if __name__ == "__main__":
    ec.build_and_run()

Running the program:

python ./pyexamples/wordcount.py
0
1
4
9
16
25
36
49
81
64

For a more complete example, and documentation on the available operators, check out the User Guide.

License

Bytewax is licensed under the Apache-2.0 license.