Tools for testing, debugging, and evaluating LLM features.
Project description
Baserun
Baserun is the testing and observability platform for LLM apps.
Quick Start
1. Install Baserun
pip install baserun
2. Generate an API key
Create an account at https://baserun.ai. Then generate an API key for your project in the settings tab. Set it as an environment variable:
export BASERUN_API_KEY="your_api_key_here"
Or set baserun.api_key
to its value:
baserun.api_key = "br-..."
3. Start testing
Use our pytest plugin and start immediately testing with Baserun. By default all OpenAI and Anthropic requests will be automatically logged.
# test_module.py
import openai
def test_paris_trip():
response = openai.ChatCompletion.create(
model="gpt-3.5-turbo",
temperature=0.7,
messages=[
{
"role": "user",
"content": "What are three activities to do in Paris?"
}
],
)
assert "Eiffel Tower" in response['choices'][0]['message']['content']
To run the test and log to baserun:
pytest --baserun test_module.py
...
========================Baserun========================
Test results available at: https://baserun.ai/runs/<id>
=======================================================
Documentation
For a deeper dive on all capabilities and more advanced usage, please refer to our Documentation.
License
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
baserun-0.5.6.tar.gz
(15.1 kB
view hashes)
Built Distribution
baserun-0.5.6-py3-none-any.whl
(15.1 kB
view hashes)