Skip to main content

TrainLoop Evaluations SDK for data collection and evaluation

This project has been archived.

The maintainers of this project have marked this project as archived. No new releases are expected.

Project description

TrainLoop Evals SDK (Python)

Automatically capture LLM calls from Python apps so they can be graded later.

Install

pip install trainloop-evals-sdk

Quick example

from trainloop_evals import collect, trainloop_tag
collect()  # patch HTTP clients
openai.chat.completions.create(..., trainloop_tag("my-tag"))

Set TRAINLOOP_DATA_FOLDER to choose where event files are written.

See the project README for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

trainloop_evals_sdk-0.4.0.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

trainloop_evals_sdk-0.4.0-py3-none-any.whl (15.7 kB view details)

Uploaded Python 3

File details

Details for the file trainloop_evals_sdk-0.4.0.tar.gz.

File metadata

  • Download URL: trainloop_evals_sdk-0.4.0.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.13.2 Darwin/24.2.0

File hashes

Hashes for trainloop_evals_sdk-0.4.0.tar.gz
Algorithm Hash digest
SHA256 61972f96b2e842cbeab70b069d2a985d1c56a2d909fb4b39d690ca49d356978d
MD5 0b90730efc873b5a8863caec80a6f0b2
BLAKE2b-256 24ea19abdb42bd6e796bec81bdcb1c9fe613ed49e6e8d7aeab20e76f979ea19a

See more details on using hashes here.

File details

Details for the file trainloop_evals_sdk-0.4.0-py3-none-any.whl.

File metadata

File hashes

Hashes for trainloop_evals_sdk-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 eb8a17e0419ef7f0867e836825a69ff09f49009188cc5169f58747ef87c4e170
MD5 efe2c4fabea8488f3a64d9d95e7bf1a4
BLAKE2b-256 a98b7abf3b2bb993ec48b8fc85a14c64c75ab20677121b6b7126622f1ebecb71

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page