No project description provided
Project description
llmeval
LLM evaluation and test framework to build internal test harnesses and automate reliable deployment workflows
Prerequisite Software
pdm
-pip install pdm
Development
- Run
pdm sync
to install all dependencies managed by pdm tool.- If you need to add new dependency, run
pdm add [dependency-name]
.
- If you need to add new dependency, run
- Run
python llmeval/main.py
for the cli. - Run
python llmeval/main.py eval hydra.mode=MULTIRUN
for evaluation.
Format files
- Run
black llmeval
to format all the py files.
Build & Publish
- Run
pdm build
- Run
pdm publish
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llmeval-0.4.1.tar.gz
(11.0 kB
view hashes)
Built Distribution
llmeval-0.4.1-py3-none-any.whl
(17.0 kB
view hashes)