Skip to main content

Universal observability SDK for GenAI/LLM applications - supports Splunk, Elasticsearch, OpenTelemetry, Datadog, Prometheus, and more

Project description

GenAI Telemetry

Observability SDK for GenAI/LLM applications.

Supported Platforms

  • Splunk
  • Elasticsearch
  • OpenTelemetry (Jaeger, Tempo, etc.)
  • Datadog
  • Prometheus
  • Grafana Loki
  • AWS CloudWatch
  • Console
  • File

Installation

pip install genai-telemetry

Quick Start

from genai_telemetry import setup_telemetry, trace_llm

# Splunk
setup_telemetry(
    workflow_name="my-app",
    exporter="splunk",
    splunk_url="https://splunk:8088",
    splunk_token="your-token"
)

# Elasticsearch
setup_telemetry(
    workflow_name="my-app",
    exporter="elasticsearch",
    es_hosts=["http://localhost:9200"]
)

@trace_llm(model_name="gpt-4o", model_provider="openai")
def chat(message):
    # Your LLM code here
    pass

License

MIT


---

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

genai_telemetry-1.0.0.tar.gz (13.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

genai_telemetry-1.0.0-py3-none-any.whl (13.5 kB view details)

Uploaded Python 3

File details

Details for the file genai_telemetry-1.0.0.tar.gz.

File metadata

  • Download URL: genai_telemetry-1.0.0.tar.gz
  • Upload date:
  • Size: 13.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for genai_telemetry-1.0.0.tar.gz
Algorithm Hash digest
SHA256 3279d1e5a0c9f42a6042e1e67334f25cd845f06dadd8e5b6c8fad0fc38626447
MD5 360297791c82c49281bf901ce41a8038
BLAKE2b-256 b93daa3418376e2f2fe9ee443664ac7fa62f2330a91ea4aefc50f412ca65d4f3

See more details on using hashes here.

File details

Details for the file genai_telemetry-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for genai_telemetry-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 f404b4d3b52874a13f8379f199747fbc8a23db624b370704396dfd706625acb7
MD5 8f8b8ec4c733085f9205041d183ceaa8
BLAKE2b-256 3e0d181c4268b718cfbee3ef86e31fc25883fbb80c4eb337e9260d7183df192c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page