Kafka Client with smarter protocol described and adapter for Gevent
Project description
a Kafka client which using easy described protocol tool - bstruct, also be able to be used with Gevent.
WARNING: Under development, Now only support simple send method. Not support Python3.
USAGE
Install using pypi:
pip install kafkaka
Install from source:
git clone https://github.com/wesdu/kafkaka.git cd kafkaka python setup.py install
EXAMPLE
simple block mode:
from kafkaka.client import KafkaClient import time if __name__ == "__main__": c = KafkaClient("tx-storm1:9092") c.send_message('im-msg', 'hi', str(time.time())) c.send_message('im-msg', u'你好', str(time.time())) print 'this will block'
using with Gevent:
from kafkaka.gevent_patch import KafkaClient from gevent import spawn from gevent import sleep import time if __name__ == "__main__": c = KafkaClient("t-storm1:9092", topic_names=['im-msg']) print '' for i in xrange(50): c.send_message('im-msg', u'你好', str(time.time()), i) c.send_message('im-msg', 'hi', str(time.time()), i) print 'this will not block' for i in xrange(50): c.send_message('im-msg', u'你好', str(time.time()), i) c.send_message('im-msg', 'hi', str(time.time()), i) sleep(0.1) print 'but this will block' sleep(30)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kafkaka-0.2.3.tar.gz
(23.5 kB
view hashes)