Skip to main content

TrainLoop LLM Logging SDK for data collection

Project description

TrainLoop Evals SDK (Python)

Automatically capture LLM calls from Python apps so they can be graded later.

Install

pip install trainloop-llm-logging

Quick example

from trainloop_llm_logging import collect, trainloop_tag
collect()  # patch HTTP clients
openai.chat.completions.create(..., trainloop_tag("my-tag"))

Set TRAINLOOP_DATA_FOLDER to choose where event files are written or set data_folder in your trainloop.config.yaml file.

See the project README for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

trainloop_llm_logging-0.7.3.tar.gz (11.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

trainloop_llm_logging-0.7.3-py3-none-any.whl (16.9 kB view details)

Uploaded Python 3

File details

Details for the file trainloop_llm_logging-0.7.3.tar.gz.

File metadata

  • Download URL: trainloop_llm_logging-0.7.3.tar.gz
  • Upload date:
  • Size: 11.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.11.13 Linux/6.11.0-1015-azure

File hashes

Hashes for trainloop_llm_logging-0.7.3.tar.gz
Algorithm Hash digest
SHA256 6afad4a113d0067b7f9ec928f4c9385b931a13afe462acf850082d826fe48505
MD5 9603d0993da45c260d454651d6e81ac5
BLAKE2b-256 2928ac0c9b1a5e757a02c3babeb7c919ceb52446cff321ad693d51a17e25447a

See more details on using hashes here.

File details

Details for the file trainloop_llm_logging-0.7.3-py3-none-any.whl.

File metadata

  • Download URL: trainloop_llm_logging-0.7.3-py3-none-any.whl
  • Upload date:
  • Size: 16.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.11.13 Linux/6.11.0-1015-azure

File hashes

Hashes for trainloop_llm_logging-0.7.3-py3-none-any.whl
Algorithm Hash digest
SHA256 1e703f77f0ed19e2e0e24f7cee69d43993e7f50237ec3540a5b14d43b42048c5
MD5 63fa73a5feaddf1de79842e240bf275c
BLAKE2b-256 d7e790bbe2c322da98f44bac0fa5ffdc6ea6569b143e9307d6a86623345f2108

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page