SDK for integrating Braintrust
Project description
Braintrust
A Python library for logging data to Braintrust. braintrust
is distributed as
a library on PyPI. It is open source and
available on GitHub.
Quickstart
Install the library with pip.
pip install braintrust
Then, run a simple experiment with the following code (replace YOUR_API_KEY
with
your Braintrust API key):
from braintrust import Eval
def is_equal(expected, output):
return expected == output
Eval(
"Say Hi Bot",
data=lambda: [
{
"input": "Foo",
"expected": "Hi Foo",
},
{
"input": "Bar",
"expected": "Hello Bar",
},
], # Replace with your eval dataset
task=lambda input: "Hi " + input, # Replace with your LLM call
scores=[is_equal],
)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
braintrust-0.0.132.tar.gz
(53.3 kB
view hashes)
Built Distribution
Close
Hashes for braintrust-0.0.132-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e8f1d9b1806b7f9dc4d5bf5e3e447dd919680c1304e0c6a8031a5d4873bce01b |
|
MD5 | 8063c1181901f6f7a9a4614d9ff7c051 |
|
BLAKE2b-256 | d0f835bb4b14baf3a98d6b28b1171d877fb6e4b36dfd56ab0b6c1c82218e64c0 |