llm-observer-sdk 0.1.0

One-import LLM Observability SDK — traces, metrics and cost tracking via OpenTelemetry

Public Grafana Dashboard (No VPN Required)

https://snapshots.raintank.io/dashboard/snapshot/Ax95UdqheWbXk12bX0eQCHQug45boDNL

LLM Observability Platform

A full-stack LLM observability platform with OpenTelemetry, Prometheus, and Grafana.

Quick Start

docker-compose up -d

That is it. All services start automatically.

Public Grafana Dashboard (no VPN required)

https://snapshots.raintank.io/dashboard/snapshot/U9wwoSC5nXvSub5VNHdob7FNTsqn5f2R

Services

Service	URL	Description
Grafana	http://localhost:3001	Dashboards (admin/admin123)
Prometheus	http://localhost:9090	Metrics storage (30-day retention)
OTel Self-Metrics	http://localhost:8888/metrics	Meta-observability
Backend API	http://localhost:8000	LLM backend
Target App	http://localhost:8001	Instrumented app

Requirements Fulfilled

• Meta-observability: OTel collector monitors itself on port 8888
• OTel handles 10,000+ spans/min with batch processor and 2 replicas
• Prometheus 30-day local retention + remote write ready
• Grafana single pane of glass across all backends
• Horizontal scaling: 2x OTel replicas behind nginx load balancer
• Single docker-compose up deploys entire stack
• Kubernetes Helm charts in helm/observability-stack/
• GitHub Actions pipeline in .github/workflows/publish-sdk.yml
• Public Grafana dashboard (no VPN): https://snapshots.raintank.io/dashboard/snapshot/U9wwoSC5nXvSub5VNHdob7FNTsqn5f2R

Helm Deployment

helm install observability-stack helm/observability-stack/