Skip to main content

End-to-end observability with built-in security guardrails.

Project description

llm-traceguard

llm-traceguard is an open-source Python library that provides Open Telemetry integration with Large Language Models (LLMs). It is designed to facilitate tracing and safeguarding applications that leverage LLMs, ensuring better monitoring and reliability.

Features

  • Easy integration with Open Telemetry for LLM applications.
  • Real-time tracing and monitoring of LLM-based systems.
  • Enhanced safeguards and insights for your LLM applications.

Installation

To install llm-traceguard, simply use pip:

pip install llm-traceguard

Usage 🚀

Here's a basic example of how to use llm-traceguard in your project:

import llm_traceguard

llm_traceguard.instrument()

Requirements 📋

  • Python 3.8 or higher
  • opentelemetry-api
  • opentelemetry-sdk

Contributing 👐

Contributions are welcome! For major changes, please open an issue first to discuss what you would like to change. Please make sure to update tests as appropriate.

License 📄

llm-traceguard is licensed under the Apache-2.0 License. See LICENSE for more details.

Contact 📧

For support or any questions, feel free to contact us at support@whylabs.ai.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

openllmtelemetry-0.0.1.dev1.tar.gz (10.1 kB view hashes)

Uploaded Source

Built Distribution

openllmtelemetry-0.0.1.dev1-py3-none-any.whl (11.4 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page