Archived

This project has been archived by its maintainers, and is no longer receiving any updates.

TrainLoop Evals SDK (Python)

Automatically capture LLM calls from Python apps so they can be graded later.

Install

pip install trainloop-evals-sdk

from trainloop_evals import collect, trainloop_tag
collect()  # patch HTTP clients
openai.chat.completions.create(..., trainloop_tag("my-tag"))

Set TRAINLOOP_DATA_FOLDER to choose where event files are written.

See the project README for more details.

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution for trainloop-evals-sdk 0.4.0
File	Size	Uploaded
trainloop_evals_sdk-0.4.0.tar.gz	10.4 kB	May 22, 2025	Details

Table of built distributions (wheels) for trainloop-evals-sdk 0.4.0
File	Interpreter	ABI	Platform	Reset
trainloop_evals_sdk-0.4.0-py3-none-any.whl 15.7 kB May 22, 2025	Python 3	none	any	Details

Total release size: 26.2 kB

Download URL	trainloop_evals_sdk-0.4.0.tar.gz
Size	10.4 kB
Tags	Source
SHA-256 checksum How to use checksums	`61972f96b2e842cbeab70b069d2a985d1c56a2d909fb4b39d690ca49d356978d`
BLAKE2b-256 checksum How to use checksums	`24ea19abdb42bd6e796bec81bdcb1c9fe613ed49e6e8d7aeab20e76f979ea19a`
Upload date	May 22, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`poetry/2.1.3 CPython/3.13.2 Darwin/24.2.0`

Download URL	trainloop_evals_sdk-0.4.0-py3-none-any.whl
Size	15.7 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`eb8a17e0419ef7f0867e836825a69ff09f49009188cc5169f58747ef87c4e170`
BLAKE2b-256 checksum How to use checksums	`a98b7abf3b2bb993ec48b8fc85a14c64c75ab20677121b6b7126622f1ebecb71`
Upload date	May 22, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`poetry/2.1.3 CPython/3.13.2 Darwin/24.2.0`