onestep-kafka
Kafka connector plugin for onestep.
pip install onestep-kafka
The package registers these YAML resource types through the onestep.resources
entry point:
kafkakafka_topic
Python usage:
from onestep_kafka import KafkaConnector
YAML usage:
resources:
kafka_main:
type: kafka
bootstrap_servers: "${KAFKA_BOOTSTRAP_SERVERS}"
orders:
type: kafka_topic
connector: kafka_main
topic: orders.events
group_id: onestep-orders
batch_size: 100
poll_timeout_ms: 1000
Delivery semantics
The plugin disables Kafka auto commit and follows onestep's at-least-once
contract. Offsets are committed only after processing reaches ack() or a
terminal fail().
If a worker sends output to a sink and exits before the Kafka offset commit succeeds, downstream output can be duplicated. Handlers and downstream sinks should be idempotent when duplicates matter.
Metadata
Release files for onestep-kafka 0.1.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| onestep_kafka-0.1.3.tar.gz | 12.7 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| onestep_kafka-0.1.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 21.6 kB
Release files / onestep_kafka-0.1.3.tar.gz
| Download URL | onestep_kafka-0.1.3.tar.gz |
|---|---|
| Size | 12.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
2a87b06036b119fe5e480dc43a6532cae6772c44a9b927cb319b782ff9c5aa04
|
|
BLAKE2b-256 checksum How to use checksums |
e14e58872af47ca9a8f730c9a6d3c7d7992fea1c07aa1a48d979b186a0509108
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Release files / onestep_kafka-0.1.3-py3-none-any.whl
| Download URL | onestep_kafka-0.1.3-py3-none-any.whl |
|---|---|
| Size | 8.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
1db3c44700369caf4f6a647ee1513513665284a2aef41b69d805d499d8435f3c
|
|
BLAKE2b-256 checksum How to use checksums |
7b3b56260fbcd4dcd5b177f61cd8078093e469caa741ecb415d6a52212cb43a0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Security for onestep-kafka 0.1.3
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.