Skip to main content

streamparse lets you run Python code against real-time streams of data. Integrates with Apache Storm.

Project description

logo

Build Status

Streamparse lets you run Python code against real-time streams of data via Apache Storm. With streamparse you can create Storm bolts and spouts in Python without having to write a single line of Java. It also provides handy CLI utilities for managing Storm clusters and projects.

The Storm/streamparse combo can be viewed as a more robust alternative to Python worker-and-queue systems, as might be built atop frameworks like Celery and RQ. It offers a way to do “real-time map/reduce style computation” against live streams of data. It can also be a powerful way to scale long-running, highly parallel Python processes in production.

Demo

Documentation

User Group

Follow the project’s progress, get involved, submit ideas and ask for help via our Google Group, streamparse@googlegroups.com.

Contributors

Alphabetical, by last name:

Changelog

See the releases page on GitHub.

Roadmap

See the Roadmap.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

streamparse-3.4.0.tar.gz (152.7 kB view details)

Uploaded Source

Built Distribution

streamparse-3.4.0-py2.py3-none-any.whl (280.6 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file streamparse-3.4.0.tar.gz.

File metadata

  • Download URL: streamparse-3.4.0.tar.gz
  • Upload date:
  • Size: 152.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for streamparse-3.4.0.tar.gz
Algorithm Hash digest
SHA256 095581f81b524ab6cced96ca778df46babb289132ce3d2a1e1bad9c99b43cd98
MD5 d2ccf9bfec7bd2b2011667c42af18042
BLAKE2b-256 9e33c373b5f8e560fd6d97d70ca700bb71ef0c96907b64769f5ae860f29dc50f

See more details on using hashes here.

File details

Details for the file streamparse-3.4.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for streamparse-3.4.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 2e7d725fef6ec57cc1eb6cb4502fc22fcd7577da4dec9c3446db67b1415b6287
MD5 77bc2fe431d13c73ae02096abc9f13e5
BLAKE2b-256 323aff23bdc59faedc7dd75ab1ff332e29fbec912a46414058768b85ce08e146

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page