observicia 0.1.1

Cloud Native Observability SDK for LLM applications

Observicia SDK

Observicia is a Cloud Native observability and policy control SDK for LLM applications. It provides seamless integration with CNCF native observability stack while offering comprehensive token tracking, policy enforcement, and PII protection capabilities.

Features

• Comprehensive Token Tracking

  • Real-time token usage monitoring
  • Provider-specific accounting
  • Usage trend analysis

• Cloud Native Policy Enforcement

  • PII detection and protection
  • Custom policy definition support

• Cloud Native Observability

  • OpenTelemetry integration
  • Jaeger distributed tracing
  • Custom monitoring dashboards

• Multi-Provider Support

  • OpenAI
  • Anthropic
  • LiteLLM
  • WatsonX

Architecture

Observicia SDK integrates with your OpenShift environment using native components:

flowchart TB
    App[Application] --> SDK[Observicia SDK]
    SDK --> LLM[LLM Providers]
    SDK --> OPA[Open Policy Agent]
    SDK --> OTEL[OpenTelemetry Collector]
    OTEL --> Prom[Prometheus]
    OTEL --> Jaeger[Jaeger]
    OPA --> PII[PII Detection Service]

Deployment

Prerequisites

• Kubernetes/OpenShift cluster
• OpenTelemetry Collector
• Open Policy Agent
• Prometheus (optional)
• Jaeger (optional)

Configuration

Configure the SDK through environment variables or direct initialization:

from observicia import init
from observicia.core.policy_engine import Policy
# Initialize Observicia with policy
policies = [
    Policy(name="pii_check",
           path="policies/pii",
           description="Check for PII in responses",
           required_trace_level="enhanced",
           risk_level="high")
]

init(service_name="patient-rag-app",
     trace_console=False,
     opa_endpoint="http://opa-server:8181/",
     policies=policies)

See example usages in the examples directory.

Policy Definition

Define custom policies using OPA's Rego language

Trace spans include:

• Token usage per request
• Policy evaluation results
• Error information
• Request/response content

License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.