Skip to main content

Library to systematically track and evaluate LLM based applications.

Project description

PyPI - Version Azure Build Status GitHub PyPI - Downloads Discourse Docs Open In Colab Ask DeepWiki

🦑 Welcome to TruLens!

TruLens

Don't just vibe-check your LLM app! Systematically evaluate and track your LLM experiments with TruLens. As you develop your app including prompts, models, retrievers, knowledge sources and more, TruLens is the tool you need to understand its performance.

Fine-grained, stack-agnostic instrumentation and comprehensive evaluations help you to identify failure modes & systematically iterate to improve your application.

Read more about the core concepts behind TruLens including Feedback Functions, The RAG Triad, and Honest, Harmless and Helpful Evals.

TruLens in the development workflow

Build your first prototype then connect instrumentation and logging with TruLens. Decide what feedbacks you need, and specify them with TruLens to run alongside your app. Then iterate and compare versions of your app in an easy-to-use user interface 👇

Architecture Diagram

Installation and Setup

Install the trulens pip package from PyPI.

    pip install trulens

Quick Usage

Walk through how to instrument and evaluate a RAG built from scratch with TruLens.

Open In Colab

💡 Contributing & Community

Interested in contributing? See our contributing guide for more details.

The best way to support TruLens is to give us a ⭐ on GitHub and join our discourse community!

Project details


Release history Release notifications | RSS feed

This version

1.5.3

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

trulens-1.5.3.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

trulens-1.5.3-py3-none-any.whl (3.7 kB view details)

Uploaded Python 3

File details

Details for the file trulens-1.5.3.tar.gz.

File metadata

  • Download URL: trulens-1.5.3.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.9

File hashes

Hashes for trulens-1.5.3.tar.gz
Algorithm Hash digest
SHA256 281d4f931dfc6327249779886d006f591889465e42ed72783297f89bb7e7fd9a
MD5 f288e2ca35421fd3fdd0683b6091113c
BLAKE2b-256 e1cc60fcd7c08dad5e97dc5c353af4f22ebcbb874dfa6cf3b6f7bd77e2f4758a

See more details on using hashes here.

File details

Details for the file trulens-1.5.3-py3-none-any.whl.

File metadata

  • Download URL: trulens-1.5.3-py3-none-any.whl
  • Upload date:
  • Size: 3.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.9

File hashes

Hashes for trulens-1.5.3-py3-none-any.whl
Algorithm Hash digest
SHA256 b73dfc6f58f4281f504b0bd9d62d8184e566c171752d964e020d405402334dbe
MD5 4326fa809381e07937e0b1673a32564c
BLAKE2b-256 ba467ca7ca771007753c4434d16e6e01fddb3ecd4029e6e5ad720dca30e188a6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page