Skip to main content

Library to systematically track and evaluate LLM based applications.

Project description

PyPI - Version Azure Build Status GitHub PyPI - Downloads Slack Docs Open In Colab

🦑 Welcome to TruLens!

TruLens

Don't just vibe-check your llm app! Systematically evaluate and track your LLM experiments with TruLens. As you develop your app including prompts, models, retrievers, knowledge sources and more, TruLens is the tool you need to understand its performance.

Fine-grained, stack-agnostic instrumentation and comprehensive evaluations help you to identify failure modes & systematically iterate to improve your application.

Read more about the core concepts behind TruLens including Feedback Functions, The RAG Triad, and Honest, Harmless and Helpful Evals.

TruLens in the development workflow

Build your first prototype then connect instrumentation and logging with TruLens. Decide what feedbacks you need, and specify them with TruLens to run alongside your app. Then iterate and compare versions of your app in an easy-to-use user interface 👇

Architecture Diagram

Installation and Setup

Install the trulens pip package from PyPI.

    pip install trulens

Quick Usage

Walk through how to instrument and evaluate a RAG built from scratch with TruLens.

Open In Colab

💡 Contributing & Community

Interested in contributing? See our contributing guide for more details.

The best way to support TruLens is to give us a ⭐ on GitHub and join our slack community!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

trulens-1.2.8.tar.gz (4.0 kB view details)

Uploaded Source

Built Distribution

trulens-1.2.8-py3-none-any.whl (3.6 kB view details)

Uploaded Python 3

File details

Details for the file trulens-1.2.8.tar.gz.

File metadata

  • Download URL: trulens-1.2.8.tar.gz
  • Upload date:
  • Size: 4.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.9

File hashes

Hashes for trulens-1.2.8.tar.gz
Algorithm Hash digest
SHA256 9b39355ca7ccb2c49caf2dcf5113a2d25002033c071fde55e37fcaf08311f503
MD5 887a14fde3ed8c82f9e3f2541195aeff
BLAKE2b-256 25971e180c4513a08fa109245d4ad88e30a02b6287ac670e003f626694b8cddf

See more details on using hashes here.

File details

Details for the file trulens-1.2.8-py3-none-any.whl.

File metadata

  • Download URL: trulens-1.2.8-py3-none-any.whl
  • Upload date:
  • Size: 3.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.9

File hashes

Hashes for trulens-1.2.8-py3-none-any.whl
Algorithm Hash digest
SHA256 52b78819f6f390e06849e0061a09f6458d626c072f695dd7ae33f6e8dec1a149
MD5 bbebdd98cdb37764968355371df10445
BLAKE2b-256 47f7c269e1082f0ee2d63375dc476628cb9573c291494b1c5f1d6e23106c1edb

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page