A wrapper for kafka-python
Project description
A wrapper for kafka-python
Installation
Install using pip:
pip install kafkaPythonWrapper
Install from Github:
git clone https://github.com/Weizhang2017/pythonKakfaWrapper
cd pythonKakfaWrapper
python setup.py install
CLI
Usage
usage: kafkaPython [-h] --type type --topic topic [--group_id group_id]
--bootstrap_server bootstrap_server [--value value]
[--key key]
Required arguments:
--type type of kafka client, consumer or producer
--topic specify a topic for Kafka
--bootstrap_server specify a bootstrap server for Kafka
Optional arguments:
--group_id specify a group ID for Kafka consumer
--value specify a value to send to Kafka
--key specify a key to send to Kafka
The client type is either producer or consumer. If the type is producer, the flag value is required while key is optional. If the type is consumer, the flag group_id is required.
Simple Examples:
Send a message to Kafka
kafkaPython --type producer --topic test --bootstrap_server 'localhost:9092' --key test_key --value test_value
Print messages from Kafka
kafkaPython --type consumer --bootstrap_server 'localhost:9092' --topic test --group_id 1
API
Usage
Send the output of a function to Kafka
from kafkaPythonWrapper import MessageSender
message_sender = MessageSender(topic='test')
@message_sender.send_sync()
def produce_message():
key, value = 'email_address', 'wzhang@leadbook.com'
print(f'{key}: {value}')
yield key, value
Receive and print messages from Kafka
from kafkaPythonWrapper import MessageCollector
message_collector = MessageCollector(topic='test', group_id='1')
@message_collector.consume
def print_message(**kwargs):
print(kwargs)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for kafkaPythonWrapper-0.1.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e24765f1b9d8e56fdc70f90adff4e4a6f6849dece19a059680d32670882db4b0 |
|
MD5 | f53a9cf2d3658fa729909fd06485d103 |
|
BLAKE2b-256 | f5b245f605a062996642f987059b8f573eb38ab58a1b3215016d97c57314e95f |