Storey
Storey is an asynchronous streaming library for real-time event processing and feature extraction. It is part of the MLRun ecosystem.
Features
- Async event processing with backpressure
- Rich set of built-in transformations: Map, Filter, FlatMap, Batch, Choice, JoinWithTable, and more
- Time-window aggregations with pluggable storage (V3IO, Redis, SQL)
- Sources and targets for files (CSV, Parquet), streams (Kafka, V3IO), and databases (Redis, TimescaleDB)
- Streaming (generator) support in Map steps
Installation
pip install storey
Optional extras:
pip install storey[kafka] # Kafka support
pip install storey[redis] # Redis support
pip install storey[psycopg] # TimescaleDB support
Quick Example
from storey import build_flow, SyncEmitSource, Map, Filter, ParquetTarget
controller = build_flow([
SyncEmitSource(),
Filter(lambda event: event["amount"] > 0),
Map(lambda event: {**event, "amount_cents": int(event["amount"] * 100)}),
ParquetTarget("output.parquet", columns=["user", "amount", "amount_cents"]),
]).run()
controller.emit({"user": "alice", "amount": 9.99})
controller.emit({"user": "bob", "amount": -1.00})
controller.emit({"user": "carol", "amount": 24.50})
controller.terminate()
controller.await_termination()
# output.parquet now contains the two events with positive amounts,
# each enriched with amount_cents.
Documentation
See the MLRun documentation and the storey transformations API reference.
Contributing
See CONTRIBUTING.md for development setup, testing, and coding conventions.
License
Apache License 2.0
Metadata
Release files for storey 1.14.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| storey-1.14.0-py3-none-any.whl | Python 3 | none | any | Details for storey-1.14.0-py3-none-any.whl |
Release files / storey-1.14.0-py3-none-any.whl
| Download URL | storey-1.14.0-py3-none-any.whl |
|---|---|
| Size | 120.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b2d33bd06f87babf164603ef5d03eb42f716f2aa202c77760f3a47a972e24a72
|
|
BLAKE2b-256 checksum How to use checksums |
4ce8a58071789fc0c2371f49bd66deb70bc797b62382b94c6dd560a1e9e0746f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.17
|
Security for storey 1.14.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.