Skip to main content

Producer–bus–consumer reference data stream library (Finnhub + Kafka) for Trade_service.

Project description

dangdatastream

dangdatastream is a small reference implementation of a producer → bus → consumer streaming architecture for market data, designed to plug into the Trade_service codebase.

Features (current)

  • Finnhub real-time SOURCE adapter (WS + polling)
  • Kafka bus abstraction (high-throughput producer tuning + at-least-once consumer + DLQ)
  • Minimal producer (SOURCE → Kafka)
  • Minimal consumer (Kafka → stdout)

Install (editable dev)

From this folder:

pip install -e ".[dotenv,providers,dev]"

Configure

Copy .env.example to .env and fill FINNHUB_API_KEY.

Run

Interactive CLI:

dangdatastream

Producer:

dangdatastream-producer-finnhub

Consumer:

dangdatastream-consumer-print

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dangdatastream-0.1.0.tar.gz (120.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dangdatastream-0.1.0-py3-none-any.whl (186.6 kB view details)

Uploaded Python 3

File details

Details for the file dangdatastream-0.1.0.tar.gz.

File metadata

  • Download URL: dangdatastream-0.1.0.tar.gz
  • Upload date:
  • Size: 120.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.8

File hashes

Hashes for dangdatastream-0.1.0.tar.gz
Algorithm Hash digest
SHA256 9a72747c50a7090f58f4bdbb47f4480bfe15c523ce4f7f516404c01e7313206c
MD5 5a95a6b89edd810b1432b73d4fd25890
BLAKE2b-256 5e7d3277924bcf044920b12c3a61fc9da5ee55bb93ee262d82219ec3b81d5bf2

See more details on using hashes here.

File details

Details for the file dangdatastream-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: dangdatastream-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 186.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.8

File hashes

Hashes for dangdatastream-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 83d473f665f697802c4e106f06cb82425d8ff2ebb2d879c939c309bba89ab3a1
MD5 89409f2ed362357f52e829fb004a812b
BLAKE2b-256 ff77af67724c3ce5213c12f4bac5143986d8feae60b068a9e2ba9959ec263f1c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page