Stream Processing Library using Polars
Project description
polars-streaming
This library helps to process streaming data using Polars.
Installation
pip install polars-streaming
Install from sources
Alternatively, you can also clone the latest version from the repository and install it directly from the source code:
pip install -e .
Quick tour
>>> from polars_streaming import StreamProcessor
>>> s = StreamProcessor()
>>> s.readStream.format('socket').options({'host':'localhost','port':12345}).load()
>>> def transformation(df):
>>> # Add your transformation code here
>>> df = df.sum() # For example purpose, I am calculating the sum.
>>> return df # Return the transformed dataframe
>>> s.add_transform(transformation)
>>> s.writeStream.format('console').trigger('3 seconds')
>>> s.start()
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
polars-streaming-0.2.0.tar.gz
(14.5 kB
view hashes)
Built Distribution
Close
Hashes for polars_streaming-0.2.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b1bd8155bcd046a640a30b4f871c707475518eac0efeb795aace09bc7d9d5bd9 |
|
MD5 | 9ae93ef2c736169f7111514342cc0d24 |
|
BLAKE2b-256 | 275d3a6210e850013d8082a905a7b5c00b1c53be7e3a61bad86ccb57fa178f91 |