quantum-pipeline 1.4.3

Framework for running, monitoring and analysing quantum algorithms.

Repository: GitHub (primary) · Codeberg (mirror)

Documentation · Quick Start · Examples

---

A framework for running quantum algorithms, with optional Kafka streaming, Spark processing, Iceberg storage, and Airflow orchestration. Currently implements the Variational Quantum Eigensolver (VQE) for ground-state energy estimation.

Quick Start

pip install quantum-pipeline
quantum-pipeline -f molecules.json -b sto-3g --max-iterations 100 --optimizer L-BFGS-B

Or with Docker:

docker pull straightchlorine/quantum-pipeline:latest
docker run --rm straightchlorine/quantum-pipeline:latest -f /app/data/molecule.json -b sto-3g

See the installation guide for detailed setup, including GPU acceleration and full platform deployment.

Features

Quantum Computing — VQE execution with multiple optimizers (L-BFGS-B tested extensively, 15+ others available), configurable ansatz circuits, multiple basis sets (sto-3g, 6-31g, cc-pVDZ), and GPU acceleration via CUDA. Learn more

Data Platform — Real-time Kafka streaming with Avro serialization, Spark-based ML feature engineering, Iceberg data lake with time-travel, Airflow workflow orchestration. Architecture overview

Deployment — Multi-service Docker Compose stack with GPU support. Deployment guide

Monitoring — Prometheus metrics, Grafana dashboards, energy convergence tracking, reference validation against literature values for 9 molecules. Monitoring setup

Python API

from quantum_pipeline.runners.vqe_runner import VQERunner

runner = VQERunner(
    filepath='data/molecules.json',
    basis_set='sto3g',
    max_iterations=100,
    convergence_threshold=1e-6,
    optimizer='L-BFGS-B',
    ansatz_reps=3,
)
runner.run()

Architecture

┌─────────────────┐    ┌──────────────┐    ┌───────────────┐
│  Quantum        │───>│ Apache Kafka │───>│ Apache Spark  │
│  Pipeline (VQE) │    │ (Streaming)  │    │ (Processing)  │
└─────────────────┘    └──────────────┘    └───────────────┘
                              │                     │
                              v                     v
┌─────────────────┐    ┌──────────────┐    ┌───────────────┐
│ Apache Airflow  │    │   Schema     │    │    Apache     │
│ (Orchestration) │    │   Registry   │    │    Iceberg    │
└─────────────────┘    └──────────────┘    └───────────────┘
         │                    │                     │
         └────────────────────┼─────────────────────┘
                              v
                    ┌──────────────────┐
                    │  MinIO Storage   │
                    └──────────────────┘

For detailed architecture documentation, see the system design and data flow pages.

Contributing

This project is not currently open for contributions as it is a university project. Feel free to fork it and make your own version.

License

MIT License. See LICENSE for details.

Contact

• Email: [e-mail]
• GitHub: straightchlorine
• Codeberg: piotrkrzysztof