This is a pre-production deployment of Warehouse. Changes made here affect the production instance of PyPI (pypi.python.org).
Help us improve Python packaging - Donate today!

Build a graph to process streams

Project Description

Emit is a Python library for realtime data processing. It can distribute work with Celery or RQ, coordinate execution in other languages, and let you swing from the trees of your graph with Tarzan-like precision.

A taste:

from emit import router

router = Router()

@router.node(['word'], entry_point=True)
def parse_document(msg):
    for word in msg.document.strip().split(' '):
        yield word

@router.node(['word', 'count'], 'parse_document')
def count_word(msg):
    return msg.word, redis.zincrby('word_counts', msg.word, 1)

import random
document = 'the words in this document will be counted and emitted by count_word'.split(' ')
router(document=' '.join(random.choice(document) for i in range(20)))

So how do you get it? On PyPI!

pip install emit

Some Links:

Supported Pythons:

  • CPython 2.6
  • CPython 2.7
  • CPython 3.2
  • CPython 3.3 (except for Celery, currently)
  • PyPy 1.9

Installing from source/development branch:

Emit’s releases are fairly frequent, so you should be good to use a released version. However, if you need something currently not in a version, try the develop branch:

pip install git+git://github.com/BrianHicks/emit.git@develop

Just do be warned that things will break. And be sure to check Travis to see if the platform you want is currently passing. It should be, but maybe not.

Release History

Release History

This version
History Node

0.4.0

History Node

0.3.0

History Node

0.2.0

History Node

0.1.1

Download Files

Download Files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

File Name & Checksum SHA256 Checksum Help Version File Type Upload Date
emit-0.4.0.tar.gz (13.5 kB) Copy SHA256 Checksum SHA256 Source Jan 31, 2013

Supported By

WebFaction WebFaction Technical Writing Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Rackspace Rackspace Cloud Servers DreamHost DreamHost Log Hosting