Streamparse lets you run Python code against real-time streams of data via Apache Storm. With streamparse you can create Storm bolts and spouts in Python without having to write a single line of Java. It also provides handy CLI utilities for managing Storm clusters and projects.
The Storm/streamparse combo can be viewed as a more robust alternative to Python worker-and-queue systems, as might be built atop frameworks like Celery and RQ. It offers a way to do “real-time map/reduce style computation” against live streams of data. It can also be a powerful way to scale long-running, highly parallel Python processes in production.
Documentation
User Group
Follow the project’s progress, get involved, submit ideas and ask for help via our Google Group, streamparse@googlegroups.com.
Contributors
Alphabetical, by last name:
Dan Blanchard (@dsblanch)
Keith Bourgoin (@kbourgoin)
Arturo Filastò (@hellais)
Jeffrey Godwyll (@rey12rey)
Daniel Hodges (@hodgesds)
Wieland Hoffmann (@mineo)
Tim Hopper (@tdhopper)
Omer Katz (@thedrow)
Aiyesha Ma (@Aiyesha)
Andrew Montalenti (@amontalenti)
Rohit Sankaran (@roadhead)
Viktor Shlapakov (@vshlapakov)
Mike Sukmanowsky (@msukmanowsky)
Cody Wilbourn (@codywilbourn)
Curtis Vogt (@omus)
Changelog
See the releases page on GitHub.
Roadmap
See the Roadmap.
Release files for streamparse 3.5.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| streamparse-3.5.0.tar.gz | 154.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| streamparse-3.5.0-py2.py3-none-any.whl | Python 2, Python 3 | none | any | Details |
Total release size: 437.2 kB
Release files / streamparse-3.5.0.tar.gz
| Download URL | streamparse-3.5.0.tar.gz |
|---|---|
| Size | 154.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
1a0a2c8f7592e64e04c8829af78b8b3f9badecd3cc88d7b1fffaafb0fdcd7a58
|
|
BLAKE2b-256 checksum How to use checksums |
70586bf074b296419ab42d1c8af0da77e2c969fd4fc0a09786a845fb08ef1802
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / streamparse-3.5.0-py2.py3-none-any.whl
| Download URL | streamparse-3.5.0-py2.py3-none-any.whl |
|---|---|
| Size | 282.8 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
6f25cd963c38d6433f72bc704696ac6dd4e043af62340136bedde9e1b334a15d
|
|
BLAKE2b-256 checksum How to use checksums |
86102136a8610089785d57bd30b0cc0336ad60c612187abf75f71bf126a05ad2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |