Skip to main content

Market data processing pipeline for stock market scanner

Project description

License PyPI Downloads Build Status CodeQL Advanced codecov GitHub issues GitHub pull requests Documentation

kuhl-haus-mdp

Market data processing library.

Overview

The Kuhl Haus Market Data Platform (MDP) is a distributed system for collecting, processing, and serving real-time market data. Built on Kubernetes and leveraging microservices architecture, MDP provides scalable infrastructure for financial data analysis and visualization.

Key Features

  • Real-time market data ingestion and processing

  • Scalable microservices architecture

  • Automated deployment with Ansible and Kubernetes

  • Multi-environment support (development, staging, production)

  • OAuth integration for secure authentication

  • Redis-based caching layer for performance

Code Organization

The platform consists of four main packages:

  • Market data processing library (kuhl-haus-mdp) - Core library with shared data processing logic

  • Backend Services (kuhl-haus-mdp-servers) - Market data listener, processor, and widget service

  • Frontend Application (kuhl-haus-mdp-app) - Web-based user interface and API

  • Deployment Automation (kuhl-haus-mdp-deployment) - Docker Compose, Ansible playbooks and Kubernetes manifests for environment provisioning

Documentation

For architecture details, component descriptions, and API reference, see the full documentation on Read the Docs.

Configuration

Finlight Data Listener (FDL)

The FinlightDataListener component reads the following environment variables when constructing configuration at the application layer:

Variable

Required

Description

FINLIGHT_API_KEY

Yes

Finlight API key for authenticating WebSocket connections

FINLIGHT_QUERY

No

Boolean search query for filtering articles (e.g. "earnings AND revenue")

FINLIGHT_TICKERS

No

Comma-separated list of ticker symbols to filter (e.g. "AAPL,MSFT,GOOG")

FINLIGHT_SOURCES

No

Comma-separated list of news source domains (e.g. "reuters.com,bloomberg.com")

FINLIGHT_LANGUAGE

No

ISO 639-1 language code for filtering articles (e.g. "en")

FINLIGHT_RAW

No

Set to "true" to use the raw WebSocket stream (no AI enrichment; faster delivery)

Additional Resources

📖 Blog Series:

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kuhl_haus_mdp-0.3.0.tar.gz (100.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

kuhl_haus_mdp-0.3.0-py3-none-any.whl (72.7 kB view details)

Uploaded Python 3

File details

Details for the file kuhl_haus_mdp-0.3.0.tar.gz.

File metadata

  • Download URL: kuhl_haus_mdp-0.3.0.tar.gz
  • Upload date:
  • Size: 100.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for kuhl_haus_mdp-0.3.0.tar.gz
Algorithm Hash digest
SHA256 d398f5822fccd6531b05eff9ff7d5c3b45c101740d83f85908a91ec82088322f
MD5 1c602621a1c98c07edeb0a8a0be77e55
BLAKE2b-256 abec49996b38a3df59eb3e87ce6667bf87d40df977ad67956e65ce7794e47f57

See more details on using hashes here.

Provenance

The following attestation bundles were made for kuhl_haus_mdp-0.3.0.tar.gz:

Publisher: publish-to-pypi.yml on kuhl-haus/kuhl-haus-mdp

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kuhl_haus_mdp-0.3.0-py3-none-any.whl.

File metadata

  • Download URL: kuhl_haus_mdp-0.3.0-py3-none-any.whl
  • Upload date:
  • Size: 72.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for kuhl_haus_mdp-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0f3d5d00f5f0a30404a20d6682617c92499c73d6589b1a5754949897bbde6289
MD5 202d65f60885d3e53a655ba0d3ffec2a
BLAKE2b-256 0fd5932cbd7695bcd56e1af7a6db7c4eba6986b53a343b7398d82ac39c244575

See more details on using hashes here.

Provenance

The following attestation bundles were made for kuhl_haus_mdp-0.3.0-py3-none-any.whl:

Publisher: publish-to-pypi.yml on kuhl-haus/kuhl-haus-mdp

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page