Evaluation for AI apps and agent.
Project description
LangEval
Evaluation for AI apps and agent
▄▄▌ ▄▄▄· ▐ ▄ ▄▄ • ▄▄▄ . ▌ ▐· ▄▄▄· ▄▄▌
██• ▐█ ▀█ •█▌▐█▐█ ▀ ▪▀▄.▀·▪█·█▌▐█ ▀█ ██•
██▪ ▄█▀▀█ ▐█▐▐▌▄█ ▀█▄▐▀▀▪▄▐█▐█•▄█▀▀█ ██▪
▐█▌▐▌▐█ ▪▐▌██▐█▌▐█▄▪▐█▐█▄▄▌ ███ ▐█ ▪▐▌▐█▌▐▌
.▀▀▀ ▀ ▀ ▀▀ █▪·▀▀▀▀ ▀▀▀ . ▀ ▀ ▀ .▀▀▀
Table of Contents
Installation
pip install langeval-cli
Documents
TODOs:
- merge uncommit changes in wsl
- support openai 2.0
- both support pydantic v1 & v2
- support qianfan the latest version
- total re-write examples
- support re-run
How to use
see ./examples for more details.
Development
# Create virtual environment
hatch env create
# Activate virtual environment
hatch shell
# Run test
hatch run test
# Run lint
hatch run lint:style
# Version dump
hatch version patch/minor/major
# Build
hatch build
# Upload to pypi
hatch publish
License
LangEval is distributed under the terms of the MIT license.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
langeval_cli-0.2.2.tar.gz
(60.0 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file langeval_cli-0.2.2.tar.gz.
File metadata
- Download URL: langeval_cli-0.2.2.tar.gz
- Upload date:
- Size: 60.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.24.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
361d3255756dbe559895212d973d3bb78cbb512c209b574ab95de9843cb976b1
|
|
| MD5 |
2e783cbc24ed799f530eeacc40ebbb14
|
|
| BLAKE2b-256 |
f5196f3df89f2181ad1f70adf82f045888e187c66b8f0398fe635a1d31e09e9b
|
File details
Details for the file langeval_cli-0.2.2-py3-none-any.whl.
File metadata
- Download URL: langeval_cli-0.2.2-py3-none-any.whl
- Upload date:
- Size: 38.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.24.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e7284423093931b69b8843f8b487e1b898573c6ceb9728144589dc51a3034641
|
|
| MD5 |
dd85ac0a92de4faa2d75d863214c312e
|
|
| BLAKE2b-256 |
90d0c1b3fc840340a06a8460018ff6bb4cee2c4435f69fcbe21eb30709d0da7e
|