Decorator interface to pykafka
Project description
This module is based on pykafka project (https://github.com/Parsely/pykafka.git) and define a class KafkaDecorator and its 4 decorators
@KafkaDecorator.host The first defines the connection parameters its parameters are the same of pykafka.KafkaClient
@KafkaDecorator.balanced_consumer its parameters are the same of pykafka.topic.get_balanced_consumer function
@KafkaDecorator.simple_consumer its parameters are the same of pykafka.topic.get_simple_consumer function
its parameters are the same of pykafka.topic.get_producer function @KafkaDecorator.producer
Install
pip install kafka-client-decorators
How to use
from kafka_client_decorators import KafkaDecorator
from kafka_client_decorators.kafka.logging_helper import setDebugLevel
import logging
kc = KafkaDecorator( )
#@kc.host(zookeeper_hosts='localhost:2181' )
@kc.host(hosts='localhost:9092' )
class A:
def __init__(self, testA, cls):
self.a = testA
self.cls = cls
pass
@kc.balanced_consumer('test1', consumer_group='testgroup3', auto_commit_enable=True, managed=True, consumer_timeout_ms=1000)
def get(self, msg):
print ( f'{self.a} Receive offset {msg.offset} key {msg.partition_key} message: { msg.value }' )
self.send( msg.value )
@kc.simple_consumer('test2', consumer_group='testgroup4', auto_commit_enable=True, consumer_timeout_ms=1000)
def get2(self, msg):
print ( f'{self.a} Receive offset {msg.offset}, message: { msg.value }' )
self.cls.stop(self)
@kc.producer('test2')
def send(self, msg):
pass
@kc.producer('test1')
def sendKey(self, msg, key ):
pass
class B:
def __init__(self):
pass
def stop(self, conn):
conn.stop()
a = A('Example', B())
a.start()
a.sendKey( 'Hello'.encode('utf-8'), partition_key='world'.encode('utf-8') )
a.wait()
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for kafka_client_decorators-0.9.5.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 993e6e89da88874c7f202857dd36d3ffb0b42e8ff89d4a829aa82f77c80dfd56 |
|
MD5 | db9ecd841910f56fb3c42e0d642420a3 |
|
BLAKE2b-256 | 9842250875e8896d86c336c7f5bcfdf4d85ee4a49d1b55ccb4a29dd4aedb40a2 |
Close
Hashes for kafka_client_decorators-0.9.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e6409bbe6bbe11130ab6dda676d7d3d5dd2895e774e3a97bd1c7ee8833a3f759 |
|
MD5 | 8e0b26dd4beaf342c46b9d8f9101290a |
|
BLAKE2b-256 | 3d1157251f79c0f060428e2837a012415d18b22a97ac33de6b4799cc1a9c4e12 |