NAAS-PYTHON-KAFKA
This is the Kafka adapter for Python: it allows you to easily connect Python services to Apache Kafka via Python.
The implementation is a wrapper around Confluent-Kafka-Python:
- AVRO schema's and messages: both key's and values should have a schema. as explained here.
- Kafka consumer and producer for the test-bed topics.
- Management
- Heartbeat (topic: system-heartbeat), so you know which clients are online. Each time the test-bed-adapter is executed, it starts a heartbeat process to notify the its activity to other clients.
Installation
You need to install Python 3+.
To run the examples you will need to install the dependencies specified on the file requirements.txt.
For that, run
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt # Or instead of `pip`, use `pip3`
from the project folder.
Examples and usage
url_producer: Creates a message with 4 URLs to RSS feeds on the topic ('system_rss_urls')rss_producer: Listens to url messages ('system_rss_urls') and produces RSS messages ('system_rss_urls')rss_consumer: Listens to RSS messages ('system_rss_urls') and prints them to console.
Uploading to PyPi
-
Ensure you have the necessary tools installed: Make sure you have
setuptoolsandwheelinstalled. You can install them usingpip:# Build the distribution files: In the root directory of your project, run the following command to build the distribution files (wheel and source distribution): pip install setuptools wheel
-
Build the distribution files: In the root directory of your project, run the following command to build the distribution files (wheel and source distribution):
# This command will generate the distribution files inside the dist directory. python setup.py sdist bdist_wheel
This command will generate the distribution files inside the dist directory.
-
Register an account on PyPI: If you haven't done so already, create an account on PyPI and verify your email address.
-
Install and configure
twine: Installtwine, a tool used to upload packages to PyPI, usingpip:# Upload the package to PyPI: Use twine to upload the distribution files to PyPI: pip install twine
-
Upload the package to PyPI: Use twine to upload the distribution files to PyPI:
# This command will prompt you to enter your PyPI username and password. Once provided, twine will upload the distribution files to PyPI. # Use $HOME/.pypirc if you want to use a different configuration file. twine upload --repository osint-python-test-bed-adapter dist/*
This command will prompt you to enter your PyPI username and password. Once provided, twine will upload the distribution files to PyPI.
-
Verify the package on PyPI: Visit your package page on PyPI to ensure that the package has been successfully uploaded and published.
Remember to update the version number in your
setup.pyfile for each new release to avoid conflicts.
In short:
# Install dependencies
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
# Create a new release after updating the setup.py package version number
rm -rf dist
python setup.py sdist bdist_wheel
twine upload --repository osint-python-test-bed-adapter dist/*
1 maintainer
Metadata
1 maintainer
Release files for osint-python-test-bed-adapter 2.6.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| osint_python_test_bed_adapter-2.6.3.tar.gz | 14.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| osint_python_test_bed_adapter-2.6.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 32.1 kB
Release files / osint_python_test_bed_adapter-2.6.3.tar.gz
| Download URL | osint_python_test_bed_adapter-2.6.3.tar.gz |
|---|---|
| Size | 14.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
fbf4873bf360814ef71da49010c082a6a6fef7ce939903f9bd150d37dd590041
|
|
BLAKE2b-256 checksum How to use checksums |
8bc39958e9b00e25da1c611b811503138dc97ffdd020c2c7edefbbd785e2b418
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.3
|
Release files / osint_python_test_bed_adapter-2.6.3-py3-none-any.whl
| Download URL | osint_python_test_bed_adapter-2.6.3-py3-none-any.whl |
|---|---|
| Size | 17.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
414ac1edb5acbc47a06c84e308e0e5223fff88cba2bd806d4987f96af8619834
|
|
BLAKE2b-256 checksum How to use checksums |
1de11b4b57b60948ae2fe279bf4b526921362d5b2ca5e7d067685fa47e6816b1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.3
|
