Skip to main content
Archived

This project has been archived by its maintainers, and is no longer receiving any updates.

llmeval

LLM evaluation and test framework to build internal test harnesses and automate reliable deployment workflows

Prerequisite Software

  • pdm - pip install pdm

Development

  1. Run pdm sync to install all dependencies managed by pdm tool.
    • If you need to add new dependency, run pdm add [dependency-name].
  2. Run python llmeval/main.py for the cli.
  3. Run python llmeval/main.py eval hydra.mode=MULTIRUN for evaluation.

Format files

  1. Run black llmeval to format all the py files.

Build & Publish

  1. Run pdm build
  2. Run pdm publish

Metadata

Release files for llmeval 0.3.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for llmeval 0.3.0
File Size Uploaded Provenance Actions
llmeval-0.3.0.tar.gz 10.2 kB Without provenance Details for llmeval-0.3.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for llmeval 0.3.0
File Interpreter ABI Platform Actions
llmeval-0.3.0-py3-none-any.whl Python 3 none any Details for llmeval-0.3.0-py3-none-any.whl

Total release size: 26.3 kB

Release files / llmeval-0.3.0.tar.gz

Download URL llmeval-0.3.0.tar.gz
Size 10.2 kB
Tags Source
SHA-256 checksum
How to use checksums
dfb373b223ad5c5971407cb324dedb351bdab1123b311b69a6b50f0bddd412ac
BLAKE2b-256 checksum
How to use checksums
edf693965fd9c8a37b3dd8c345aec9e0a53a3e94b74e7427e7b5e8eeb77647ae
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via pdm/2.9.2 CPython/3.10.12

Release files / llmeval-0.3.0-py3-none-any.whl

Download URL llmeval-0.3.0-py3-none-any.whl
Size 16.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
6bff52b2e2f3df2521323b42d350eef610cefa0fb0b14c6cf305b49263b8154b
BLAKE2b-256 checksum
How to use checksums
159c434b003f98b198847938572581429fb9c5daed867628ef0602354efbc1db
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via pdm/2.9.2 CPython/3.10.12

Security for llmeval 0.3.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page