Embeddable stream processing engine
Project description
Denormalized Python
Python bindings for denormalized
Denormalized is a single node stream processing engine written in Rust. This directory contains the bindings for building pipelines using python.
Getting Started
- Install denormalized
pip install denormalized - Start the custom docker image that contains an instance of kafka along with with a script that emits some sample data to kafka
docker run --rm -p 9092:9092 emgeee/kafka_emit_measurements:latest - Copy the stream_aggregate.py example
This script will connect to the kafka instance running in docker and aggregate the metrics in realtime.
There are several other examples in the examples folder that demonstrate other capabilities including stream joins and UDAFs.
Development
Make sure you're in the py-denormalized/ directory.
We use uv to manage python dependencies.
uv sync to create/update the virtual environment
We use maturin for developing and building:
maturin develop- build and install the python bindings into the current venv- Run
ipython, then import the library:from denormalized import * maturin build- compile the library
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file denormalized-0.0.13.tar.gz.
File metadata
- Download URL: denormalized-0.0.13.tar.gz
- Upload date:
- Size: 247.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.7.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a95a8b8f967acbd7697ae16be75d777466a93f4d7069beaba08eec1435646059
|
|
| MD5 |
11147743c38c0bbdba703e05da296df9
|
|
| BLAKE2b-256 |
3f824a6509846d231ccb4a11fe565ec49d0065f1962c22877b8d71c218a4f79f
|
File details
Details for the file denormalized-0.0.13-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.
File metadata
- Download URL: denormalized-0.0.13-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 27.5 MB
- Tags: CPython 3.8+, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.7.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3f709712809b3b2bebe291182ca9aa3978cda483d9d020a1d7592c2a89864811
|
|
| MD5 |
f7a1d93cc832f85ee7b3d7f0a2ce1702
|
|
| BLAKE2b-256 |
e229b8b1afd24d3447849bbee2f590bd56c8edd1a17792e260ce9e0a4c2508f7
|
File details
Details for the file denormalized-0.0.13-cp38-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.
File metadata
- Download URL: denormalized-0.0.13-cp38-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
- Upload date:
- Size: 25.1 MB
- Tags: CPython 3.8+, manylinux: glibc 2.17+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.7.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c2fb052058bc018f39ccdcea0f05459717b5ed2b5f3fbb87c9d95415d3e90f49
|
|
| MD5 |
58940a7f503eeca7fff14c083e20d5e1
|
|
| BLAKE2b-256 |
6fd8a16aeddfccb8643dab437b3175ec78ca29c0ef5c886e4f3425eb6c79491a
|
File details
Details for the file denormalized-0.0.13-cp38-abi3-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl.
File metadata
- Download URL: denormalized-0.0.13-cp38-abi3-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl
- Upload date:
- Size: 67.1 MB
- Tags: CPython 3.8+, macOS 10.12+ universal2 (ARM64, x86-64), macOS 10.12+ x86-64, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: maturin/1.7.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
19ad8b865ff4199bdbcfa074befb3c5f48c02fff1b28f02341d59a755e31fbca
|
|
| MD5 |
14ee4d92db6d4640d59011c0315a8d3d
|
|
| BLAKE2b-256 |
619ef65fb846052e6fce85af1b40e210043aaa9c13573603c5de543325afe85e
|
