Skip to main content

TrainLoop Evaluations SDK for data collection and evaluation

This project has been archived.

The maintainers of this project have marked this project as archived. No new releases are expected.

Project description

TrainLoop Evals SDK (Python)

Automatically capture LLM calls from Python apps so they can be graded later.

Install

pip install trainloop-evals-sdk

Quick example

from trainloop_evals import collect, trainloop_tag
collect()  # patch HTTP clients
openai.chat.completions.create(..., trainloop_tag("my-tag"))

Set TRAINLOOP_DATA_FOLDER to choose where event files are written.

See the project README for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

trainloop_evals_sdk-0.3.16.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

trainloop_evals_sdk-0.3.16-py3-none-any.whl (15.7 kB view details)

Uploaded Python 3

File details

Details for the file trainloop_evals_sdk-0.3.16.tar.gz.

File metadata

  • Download URL: trainloop_evals_sdk-0.3.16.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.13.2 Darwin/24.2.0

File hashes

Hashes for trainloop_evals_sdk-0.3.16.tar.gz
Algorithm Hash digest
SHA256 58e2b5d1edb8aed968da03ed45a50f5ce016c3718914364e690ecbf330955211
MD5 354a71a9850bc90dcdf5fef61a3dc995
BLAKE2b-256 158a69b792f8ff5c91a20f6e496f80fc37ab52c947bfe7bbad7d55770e8e5851

See more details on using hashes here.

File details

Details for the file trainloop_evals_sdk-0.3.16-py3-none-any.whl.

File metadata

File hashes

Hashes for trainloop_evals_sdk-0.3.16-py3-none-any.whl
Algorithm Hash digest
SHA256 b935816ec6b2e3d845fb58bd34da623de971116d935fb3719b375188b3fcb699
MD5 3c34acf5df57822d7bc970c140b674c6
BLAKE2b-256 ee523b5601f3fa790d29e7be3a69352919f238739a7e2a0d004aed71ae2cd094

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page