nsq2kafka

Reads from NSQ, Publishes to Kafka

Project description

Reads from NSQ, Publishes to Kafka

Installation

pip install nsq2kafka

Examples

Basic example

nsq2kafka --nsq-topic=test --nsq-nsqd-tcp-addresses=localhost:4150

Realistic example

nsq2kafka --nsq-topic=json_clicks \
          --nsq-lookupd-http-addresses=lookupd1.example.com:4161,lookupd2.example.com:4161 \
          --nsq-max-in-flight=5000 \
          --nsq-channel=nsq2Kafka \
          --kafka-bootstrap-servers=kafka1.example.com:9092,kafka2.exampkel.com:9092 \
          --kafka-topic=click_stream_json \
          --kafka-message-key=user_id

Project details

Release history Release notifications | RSS feed

This version

0.0.2

Aug 4, 2016

0.0.1

Aug 4, 2016

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nsq2kafka-0.0.2.tar.gz (3.3 kB view hashes)

Uploaded Aug 4, 2016 source

Built Distribution

nsq2kafka-0.0.2-py2.7.egg (6.9 kB view hashes)

Uploaded Aug 4, 2016 2 7

Hashes for nsq2kafka-0.0.2.tar.gz

Hashes for nsq2kafka-0.0.2.tar.gz
Algorithm	Hash digest
SHA256	`ab9da9bc375f9f5c461d5f85e6e16c8e5dab3f125dde7dfd388a48a8da114fd4`
MD5	`34bb18a9051deb0505063afc1cdc08b0`
BLAKE2-256	`557f87232cf8b16aa803406225e98d8d6301b2d8eab52fb31c5303d58928f098`

Hashes for nsq2kafka-0.0.2-py2.7.egg

Hashes for nsq2kafka-0.0.2-py2.7.egg
Algorithm	Hash digest
SHA256	`0a106a0749841239c4baccf751c856322423380b3d8ac141ac99914c1405b200`
MD5	`d0ac5564488ea7a6bcf9a757fbecfdd6`
BLAKE2-256	`66c9821bc2d45f8a5af5f8ce46b30c4f6962549d67a67a3585bb5f48e0b90cd9`