No project description provided
Project description
llmeval
LLM evaluation and test framework to build internal test harnesses and automate reliable deployment workflows
Prerequisite Software
pdm-pip install pdm
Development
- Run
pdm syncto install all dependencies managed by pdm tool.- If you need to add new dependency, run
pdm add [dependency-name].
- If you need to add new dependency, run
- Run
python llmeval/main.pyfor the cli. - Run
python llmeval/main.py eval hydra.mode=MULTIRUNfor evaluation.
Format files
- Run
black llmevalto format all the py files.
Build & Publish
- Run
pdm build - Run
pdm publish
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llmeval-0.4.1.tar.gz
(11.0 kB
view details)
Built Distribution
llmeval-0.4.1-py3-none-any.whl
(17.0 kB
view details)
File details
Details for the file llmeval-0.4.1.tar.gz.
File metadata
- Download URL: llmeval-0.4.1.tar.gz
- Upload date:
- Size: 11.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: pdm/2.9.3 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | fde0890cdfa663597da0988fd406c8fc51ed39697c671cf00239bdac1e3035f8 |
|
| MD5 | e09ebc40be6f70c57ef863ff39733537 |
|
| BLAKE2b-256 | f59b54a92e0fd56e7f521c9ebd6dd938e06eb0b501077609cc59846110aa720a |
File details
Details for the file llmeval-0.4.1-py3-none-any.whl.
File metadata
- Download URL: llmeval-0.4.1-py3-none-any.whl
- Upload date:
- Size: 17.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: pdm/2.9.3 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 7586e349754a93567e3fb95759c77669c3be49572fc63c42c52f9d367d767d5d |
|
| MD5 | ef15b74f0db354b6cdac54568090a836 |
|
| BLAKE2b-256 | cb74f1d20bc97b7516b0110e5e33b0b1f65edecee6bc193cf8fe292b2eb69e63 |
