Skip to main content

Kafka Client with smarter protocol described and adapter for Gevent

Project description

## kafkaka
### INTRODUCE
a Kafka client which using easy described protocol tool - bstruct, also be able to be used with Gevent.

WARNNING: Under development, Now only support simple send method. Not support Python3.

### EXAMPLE
#### simple block mode
from kafkaka.client import KafkaClient
import time

if __name__ == "__main__":
c = KafkaClient("tx-storm1:9092")
c.send_message('im-msg', 'hi', str(time.time()))
c.send_message('im-msg', u'你好', str(time.time()))
print 'this will block'

#### using with Gevent
from kafkaka.gevent_patch import KafkaClient
from gevent import spawn
from gevent import sleep
import time

if __name__ == "__main__":
c = KafkaClient("t-storm1:9092", topic_names=['im-msg'])
print ''
for i in xrange(50):
c.send_message('im-msg', u'你好', str(time.time()), i)
c.send_message('im-msg', 'hi', str(time.time()), i)
print 'this will not block'
for i in xrange(50):
c.send_message('im-msg', u'你好', str(time.time()), i)
c.send_message('im-msg', 'hi', str(time.time()), i)
sleep(0.1)
print 'but this will block'
sleep(30)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kafkaka-0.1.tar.gz (23.5 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page