Skip to main content

streamparse lets you run Python code against real-time streams of data. Integrates with Apache Storm.

Project description

logo

Build Status

Streamparse lets you run Python code against real-time streams of data via Apache Storm. With streamparse you can create Storm bolts and spouts in Python without having to write a single line of Java. It also provides handy CLI utilities for managing Storm clusters and projects.

The Storm/streamparse combo can be viewed as a more robust alternative to Python worker-and-queue systems, as might be built atop frameworks like Celery and RQ. It offers a way to do “real-time map/reduce style computation” against live streams of data. It can also be a powerful way to scale long-running, highly parallel Python processes in production.

Demo

Documentation

User Group

Follow the project’s progress, get involved, submit ideas and ask for help via our Google Group, streamparse@googlegroups.com.

Contributors

Alphabetical, by last name:

Changelog

See the releases page on GitHub.

Roadmap

See the Roadmap.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

streamparse-4.0.0.tar.gz (54.3 kB view details)

Uploaded Source

Built Distribution

streamparse-4.0.0-py2.py3-none-any.whl (78.2 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file streamparse-4.0.0.tar.gz.

File metadata

  • Download URL: streamparse-4.0.0.tar.gz
  • Upload date:
  • Size: 54.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.50.1 CPython/3.7.5

File hashes

Hashes for streamparse-4.0.0.tar.gz
Algorithm Hash digest
SHA256 c1db519d83ab6f942cbc0cbd4cbdc8ef2c1a876a8c5cfa5d496f89b940953459
MD5 b018d53b315c05ec33f20c1e3074fdb3
BLAKE2b-256 424c82c23d129bc29a9db55f09b8e2b7a3ec5a4df30adf03fe78e23a1f276a4a

See more details on using hashes here.

File details

Details for the file streamparse-4.0.0-py2.py3-none-any.whl.

File metadata

  • Download URL: streamparse-4.0.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 78.2 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.50.1 CPython/3.7.5

File hashes

Hashes for streamparse-4.0.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 9a84b661ed0215388a4c9168e089312086ed6fa2810741609d8e02edcf335d3c
MD5 7dbd035417de118e1c37983cb4dd2966
BLAKE2b-256 541b74b3d8fd2e8c5c26fd6fd70d3dad750d78b6fe04f5fe4332c1d10374bdfa

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page