Skip to main content

Library to systematically track and evaluate LLM based applications.

Project description

PyPI - Version Azure Build Status GitHub PyPI - Downloads Slack Docs Open In Colab

🦑 Welcome to TruLens!

TruLens

Don't just vibe-check your llm app! Systematically evaluate and track your LLM experiments with TruLens. As you develop your app including prompts, models, retrievers, knowledge sources and more, TruLens is the tool you need to understand its performance.

Fine-grained, stack-agnostic instrumentation and comprehensive evaluations help you to identify failure modes & systematically iterate to improve your application.

Read more about the core concepts behind TruLens including Feedback Functions, The RAG Triad, and Honest, Harmless and Helpful Evals.

TruLens in the development workflow

Build your first prototype then connect instrumentation and logging with TruLens. Decide what feedbacks you need, and specify them with TruLens to run alongside your app. Then iterate and compare versions of your app in an easy-to-use user interface 👇

Architecture Diagram

Installation and Setup

Install the trulens pip package from PyPI.

    pip install trulens

Quick Usage

Walk through how to instrument and evaluate a RAG built from scratch with TruLens.

Open In Colab

💡 Contributing & Community

Interested in contributing? See our contributing guide for more details.

The best way to support TruLens is to give us a ⭐ on GitHub and join our slack community!

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

trulens-1.3.1.tar.gz (4.2 kB view details)

Uploaded Source

Built Distribution

trulens-1.3.1-py3-none-any.whl (3.6 kB view details)

Uploaded Python 3

File details

Details for the file trulens-1.3.1.tar.gz.

File metadata

  • Download URL: trulens-1.3.1.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.11

File hashes

Hashes for trulens-1.3.1.tar.gz
Algorithm Hash digest
SHA256 803f113470fb63ccb4f9d43eaf26905874c7bf8867722cbd5cdb198984734038
MD5 ff4a6591d1f9d301a2ab83e554ffdda1
BLAKE2b-256 91b26a252763523ad96315cfbb7cee467707f2aff58638d1d2c4419fe40e905e

See more details on using hashes here.

File details

Details for the file trulens-1.3.1-py3-none-any.whl.

File metadata

  • Download URL: trulens-1.3.1-py3-none-any.whl
  • Upload date:
  • Size: 3.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.11

File hashes

Hashes for trulens-1.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 23bfdb12c14e0d4aabe6a6844b7efab223fb34c41ae51c5d99a7fffffe7d5721
MD5 8f6d5b4d01e3e36c5518630e957e59b7
BLAKE2b-256 488e1d95945e6b334c7835c14b241988c6af2d2addb40d1276524f807b2b788a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page