Evaluation for AI apps and agent.
Project description
LangEval
Evaluation for AI apps and agent
▄▄▌ ▄▄▄· ▐ ▄ ▄▄ • ▄▄▄ . ▌ ▐· ▄▄▄· ▄▄▌
██• ▐█ ▀█ •█▌▐█▐█ ▀ ▪▀▄.▀·▪█·█▌▐█ ▀█ ██•
██▪ ▄█▀▀█ ▐█▐▐▌▄█ ▀█▄▐▀▀▪▄▐█▐█•▄█▀▀█ ██▪
▐█▌▐▌▐█ ▪▐▌██▐█▌▐█▄▪▐█▐█▄▄▌ ███ ▐█ ▪▐▌▐█▌▐▌
.▀▀▀ ▀ ▀ ▀▀ █▪·▀▀▀▀ ▀▀▀ . ▀ ▀ ▀ .▀▀▀
Table of Contents
Installation
pip install langeval-cli
Documents
TODO
How to use
see ./examples/ceval/ceval-zh.ipynb
Development
# Create virtual environment
hatch env create
# Activate virtual environment
hatch shell
# Run test
hatch run test
# Run lint
hatch run lint:style
# Version dump
hatch version patch/minor/major
# Build
hatch build
# Upload to pypi
hatch publish
License
LangEval is distributed under the terms of the MIT license.
TODO
- more eval metrics
- support openai function
- docs
- test
- multi-eval
- run retry
- rerun failed task
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
langeval_cli-0.1.1.tar.gz
(26.4 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file langeval_cli-0.1.1.tar.gz.
File metadata
- Download URL: langeval_cli-0.1.1.tar.gz
- Upload date:
- Size: 26.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.24.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
caa7e4e86146e0bd1c8ae93bb3acbc9b3546ec6df3541da18b23c4062ad7e2c2
|
|
| MD5 |
ca8c9494b07b1cef9d15913280cfe46a
|
|
| BLAKE2b-256 |
83a3e4b1b26e7d9b8626afefce82c9f1fb8428b35f26ef561b648d519d07086f
|
File details
Details for the file langeval_cli-0.1.1-py3-none-any.whl.
File metadata
- Download URL: langeval_cli-0.1.1-py3-none-any.whl
- Upload date:
- Size: 28.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.24.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3800598f48db6f902d3cc3c5ba6cfee283fc75f6a92c6009b0278fd769624c73
|
|
| MD5 |
1dc09cc76e94ef33a6fbf56684523085
|
|
| BLAKE2b-256 |
0cce9339c12f7e0606157e0c636c43dcab1004de3fdd7591c70157e6278f6cd3
|
