Skip to main content

TrainLoop Evaluations SDK for data collection and evaluation

This project has been archived.

The maintainers of this project have marked this project as archived. No new releases are expected.

Project description

TrainLoop Evals SDK (Python)

Automatically capture LLM calls from Python apps so they can be graded later.

Install

pip install trainloop-evals-sdk

Quick example

from trainloop_evals import collect, trainloop_tag
collect()  # patch HTTP clients
openai.chat.completions.create(..., trainloop_tag("my-tag"))

Set TRAINLOOP_DATA_FOLDER to choose where event files are written.

See the project README for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

trainloop_evals_sdk-0.3.15.tar.gz (10.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

trainloop_evals_sdk-0.3.15-py3-none-any.whl (15.5 kB view details)

Uploaded Python 3

File details

Details for the file trainloop_evals_sdk-0.3.15.tar.gz.

File metadata

  • Download URL: trainloop_evals_sdk-0.3.15.tar.gz
  • Upload date:
  • Size: 10.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.13.2 Darwin/24.2.0

File hashes

Hashes for trainloop_evals_sdk-0.3.15.tar.gz
Algorithm Hash digest
SHA256 6b8ed55f4052495961942d36b2aab7a473804bf039fc05baa76a790158ff32d2
MD5 f988ffbffe9a8fe2449edbfb7c2d2b9a
BLAKE2b-256 5d03efb9529e24c7d224de238c4a183a1a5f528520f96a4c214eb091cfc1eeda

See more details on using hashes here.

File details

Details for the file trainloop_evals_sdk-0.3.15-py3-none-any.whl.

File metadata

File hashes

Hashes for trainloop_evals_sdk-0.3.15-py3-none-any.whl
Algorithm Hash digest
SHA256 dae1814fab73840ef466a54fc9a8c867c33562a8fe64d25a43d4249abd0133f4
MD5 86a7543e64ffc08ac3be2028e5a006fc
BLAKE2b-256 b7be7f0b1edf7f32065f5f30c3722f2d7b083db24b62f9ef91e5613474682cf6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page