Skip to main content
Archived

This project has been archived by its maintainers, and is no longer receiving any updates.

llmeval

LLM evaluation and test framework to build internal test harnesses and automate reliable deployment workflows

Prerequisite Software

  • pdm - pip install pdm

Development

  1. Run pdm sync to install all dependencies managed by pdm tool.
    • If you need to add new dependency, run pdm add [dependency-name].
  2. Run python llmeval/main.py for the cli.
  3. Run python llmeval/main.py eval hydra.mode=MULTIRUN for evaluation.

Format files

  1. Run black llmeval to format all the py files.

Build & Publish

  1. Run pdm build
  2. Run pdm publish

Metadata

Release files for llmeval 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for llmeval 0.2.1
File Size Uploaded Provenance Actions
llmeval-0.2.1.tar.gz 7.3 kB Without provenance Details for llmeval-0.2.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for llmeval 0.2.1
File Interpreter ABI Platform Actions
llmeval-0.2.1-py3-none-any.whl Python 3 none any Details for llmeval-0.2.1-py3-none-any.whl

Total release size: 17.8 kB

Release files / llmeval-0.2.1.tar.gz

Download URL llmeval-0.2.1.tar.gz
Size 7.3 kB
Tags Source
SHA-256 checksum
How to use checksums
274088b40de94de81a1ec00a12c423e4cd250b79656cf0b84df46aaf533e7def
BLAKE2b-256 checksum
How to use checksums
a8946390daa83a940b1f332489f6112f66454647f9017d894cbce712ed97b6f6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via pdm/2.8.2 CPython/3.10.12

Release files / llmeval-0.2.1-py3-none-any.whl

Download URL llmeval-0.2.1-py3-none-any.whl
Size 10.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
95b33e47ac6b69afd203fbc4f7312bc5b602e53ef71f4fc9f85c73534bb81d1a
BLAKE2b-256 checksum
How to use checksums
0d8dd0274203c95c508ad7bd336919fd4b3a54e6d85788a6ff7f9930d4389eeb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via pdm/2.8.2 CPython/3.10.12

Security for llmeval 0.2.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page