Evaluation for AI apps and agent.
Project description
LangEval
Evaluation for AI apps and agent
▄▄▌ ▄▄▄· ▐ ▄ ▄▄ • ▄▄▄ . ▌ ▐· ▄▄▄· ▄▄▌
██• ▐█ ▀█ •█▌▐█▐█ ▀ ▪▀▄.▀·▪█·█▌▐█ ▀█ ██•
██▪ ▄█▀▀█ ▐█▐▐▌▄█ ▀█▄▐▀▀▪▄▐█▐█•▄█▀▀█ ██▪
▐█▌▐▌▐█ ▪▐▌██▐█▌▐█▄▪▐█▐█▄▄▌ ███ ▐█ ▪▐▌▐█▌▐▌
.▀▀▀ ▀ ▀ ▀▀ █▪·▀▀▀▀ ▀▀▀ . ▀ ▀ ▀ .▀▀▀
Table of Contents
Installation
pip install langeval-cli
Documents
TODOs:
- merge uncommit changes in wsl
- support openai 2.0
- both support pydantic v1 & v2
- support qianfan the latest version
- total re-write examples
- support re-run
How to use
see ./examples for more details.
Development
# Create virtual environment
hatch env create
# Activate virtual environment
hatch shell
# Run test
hatch run test
# Run lint
hatch run lint:style
# Version dump
hatch version patch/minor/major
# Build
hatch build
# Upload to pypi
hatch publish
License
LangEval is distributed under the terms of the MIT license.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
langeval_cli-0.3.3.tar.gz
(60.5 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file langeval_cli-0.3.3.tar.gz.
File metadata
- Download URL: langeval_cli-0.3.3.tar.gz
- Upload date:
- Size: 60.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.24.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ee5e5f0a62b024b4606ce17aba59ddefa946d7be8188622ca59d85bbf418bcb4
|
|
| MD5 |
f006d71e6c8ab763b9ffbab5637c7166
|
|
| BLAKE2b-256 |
f4dbeafc70355a67aea16dfe7475d42e00b538e17772e9ecb4443ae44172599b
|
File details
Details for the file langeval_cli-0.3.3-py3-none-any.whl.
File metadata
- Download URL: langeval_cli-0.3.3-py3-none-any.whl
- Upload date:
- Size: 39.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.24.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9d1d2957dc17b5e3e403cd960561a675c73b02fbf2a273092d15921239ca3321
|
|
| MD5 |
073bb23dc6d92c8ae0c0d136c86b8153
|
|
| BLAKE2b-256 |
a3b40c306b9cd7c9345cea002e075deaa7fe78ee88737a644b71eddab0b80469
|