Skip to main content

A modular data pipeline for efficient data processing.

Project description

🌌 CosmicLode

Python License: MIT Build Poetry

CosmicLode is a modular data pipeline framework designed for efficient, scalable, and transparent data processing. It supports database-agnostic connections, column-level profiling, and metadata visualization — all in a Pythonic package built for modern data engineers.


🚀 Features

  • 🔌 Pluggable database connectors returning pandas DataFrames
  • 📊 Column-level profiling with historical snapshot support
  • 📈 Data quality dashboards using lightweight visualizations
  • ⚙️ Modular design for reuse across workflows
  • 🧪 Built-in unit testing with pytest

📦 Work in Progress Modules

Module Description
cosmic-nexus Unified interface to connect and query any database
cosmic-probe Generate & store profiling snapshots over time
stellar-map Streamlit or Dash-based UI for data quality monitoring

📌 Tech Stack

  • Python 3.10+
  • SQLAlchemy, Pandas
  • Poetry for dependency management
  • Pytest for testing
  • Streamlit/Dash for visualizations (planned)

📝 License

This project is licensed under the MIT License.


✨ Author

Vinod Yerrapureddy
📧 yerrapureddyvinodreddy@gmail.com
🌐 vinodreddy.netlify.app
🔗 LinkedIn
🍥 Anime fan | 💻 Data engineer | 🛠️ Systems hacker

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cosmiclode-0.1.6.tar.gz (9.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cosmiclode-0.1.6-py3-none-any.whl (18.9 kB view details)

Uploaded Python 3

File details

Details for the file cosmiclode-0.1.6.tar.gz.

File metadata

  • Download URL: cosmiclode-0.1.6.tar.gz
  • Upload date:
  • Size: 9.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.12

File hashes

Hashes for cosmiclode-0.1.6.tar.gz
Algorithm Hash digest
SHA256 b6bc7ec4c2f1ca1e198033f9f4b0dbd39478681b6741bf30aac234a82b9300ab
MD5 7f091d1a3113143507b1fd2bc73fc254
BLAKE2b-256 f5117430cfd20ecac8dbb03ac4c0e5b6834cb5738f1b34fbd65834a513ee7986

See more details on using hashes here.

File details

Details for the file cosmiclode-0.1.6-py3-none-any.whl.

File metadata

  • Download URL: cosmiclode-0.1.6-py3-none-any.whl
  • Upload date:
  • Size: 18.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.12

File hashes

Hashes for cosmiclode-0.1.6-py3-none-any.whl
Algorithm Hash digest
SHA256 8d7692e5a70e54b46382ac6e0d3915d1c47315ed3cee47dcb810e1c92d1b7fd9
MD5 757e47190e462e5b0d1b96c771f20959
BLAKE2b-256 682c9774b8c62b47367be4c92bbb018b6acab053b2d59ba1b1a12330738ade2c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page