Library to systematically track and evaluate LLM based applications.
Project description
🦑 Welcome to TruLens!
Don't just vibe-check your llm app! Systematically evaluate and track your LLM experiments with TruLens. As you develop your app including prompts, models, retrievers, knowledge sources and more, TruLens is the tool you need to understand its performance.
Fine-grained, stack-agnostic instrumentation and comprehensive evaluations help you to identify failure modes & systematically iterate to improve your application.
Read more about the core concepts behind TruLens including Feedback Functions, The RAG Triad, and Honest, Harmless and Helpful Evals.
TruLens in the development workflow
Build your first prototype then connect instrumentation and logging with TruLens. Decide what feedbacks you need, and specify them with TruLens to run alongside your app. Then iterate and compare versions of your app in an easy-to-use user interface 👇
Installation and Setup
Install the trulens pip package from PyPI.
pip install trulens
Quick Usage
Walk through how to instrument and evaluate a RAG built from scratch with TruLens.
💡 Contributing & Community
Interested in contributing? See our contributing guide for more details.
The best way to support TruLens is to give us a ⭐ on GitHub and join our slack community!
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file trulens-1.4.0a0.tar.gz.
File metadata
- Download URL: trulens-1.4.0a0.tar.gz
- Upload date:
- Size: 4.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.11.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e6a0ffcab420582ae122dff2be9fdbe122510602c8fd84510368f0ba77cf972c
|
|
| MD5 |
aceb27baf9ee39cb297e55dcefb6d195
|
|
| BLAKE2b-256 |
f05057c3cab5758be69534fc0a0d2d83e06db1a925954cd93566c0d766d0b048
|
File details
Details for the file trulens-1.4.0a0-py3-none-any.whl.
File metadata
- Download URL: trulens-1.4.0a0-py3-none-any.whl
- Upload date:
- Size: 3.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.11.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c0d3dd7174391b8f91f2aa3d9bf3368e02dd90242780e38286a9ab687a4635ea
|
|
| MD5 |
d50802f518883e0da117d395ba2534e3
|
|
| BLAKE2b-256 |
42a1ba363b412493908f655aeff19d98a0b94e7319c1b4a6622d0385fb0a796b
|
