Skip to main content

streamparse lets you run Python code against real-time streams of data. Integrates with Apache Storm.

Project description

logo

Build Status

Streamparse lets you run Python code against real-time streams of data via Apache Storm. With streamparse you can create Storm bolts and spouts in Python without having to write a single line of Java. It also provides handy CLI utilities for managing Storm clusters and projects.

The Storm/streamparse combo can be viewed as a more robust alternative to Python worker-and-queue systems, as might be built atop frameworks like Celery and RQ. It offers a way to do “real-time map/reduce style computation” against live streams of data. It can also be a powerful way to scale long-running, highly parallel Python processes in production.

Demo

Documentation

User Group

Follow the project’s progress, get involved, submit ideas and ask for help via our Google Group, streamparse@googlegroups.com.

Contributors

Alphabetical, by last name:

Changelog

See the releases page on GitHub.

Roadmap

See the Roadmap.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

streamparse-3.13.1.tar.gz (54.3 kB view details)

Uploaded Source

Built Distribution

streamparse-3.13.1-py2.py3-none-any.whl (77.6 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file streamparse-3.13.1.tar.gz.

File metadata

File hashes

Hashes for streamparse-3.13.1.tar.gz
Algorithm Hash digest
SHA256 d7f409536f313f0373f51af11ff941e43bd8da6960147141f7a0dafe75e8c771
MD5 c8de622a29405690a230226ac7c8a876
BLAKE2b-256 994c8ff80cffea5ccfb3b1395d56804cb9e559d7970bbe91e79abcbbb10b97a0

See more details on using hashes here.

File details

Details for the file streamparse-3.13.1-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for streamparse-3.13.1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 a9cb9bc3fe086ad18e10a46cf2aa492c2e24cbd431bc84ae7a59cf14bbd480c8
MD5 4de2b7a1e8502e9ac271a2c312e59c17
BLAKE2b-256 04ed85df3c85c86f67abe42b01ec5fda14a010d14371f3f623d79dda2b43394b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page