Evaluation for AI apps and agent.
Project description
LangEval
Evaluation for AI apps and agent
▄▄▌ ▄▄▄· ▐ ▄ ▄▄ • ▄▄▄ . ▌ ▐· ▄▄▄· ▄▄▌
██• ▐█ ▀█ •█▌▐█▐█ ▀ ▪▀▄.▀·▪█·█▌▐█ ▀█ ██•
██▪ ▄█▀▀█ ▐█▐▐▌▄█ ▀█▄▐▀▀▪▄▐█▐█•▄█▀▀█ ██▪
▐█▌▐▌▐█ ▪▐▌██▐█▌▐█▄▪▐█▐█▄▄▌ ███ ▐█ ▪▐▌▐█▌▐▌
.▀▀▀ ▀ ▀ ▀▀ █▪·▀▀▀▀ ▀▀▀ . ▀ ▀ ▀ .▀▀▀
Table of Contents
Installation
pip install langeval-cli
Documents
TODO
How to use
see ./examples for more details.
Development
# Create virtual environment
hatch env create
# Activate virtual environment
hatch shell
# Run test
hatch run test
# Run lint
hatch run lint:style
# Version dump
hatch version patch/minor/major
# Build
hatch build
# Upload to pypi
hatch publish
License
LangEval is distributed under the terms of the MIT license.
TODO
- more eval metrics
- support openai function
- docs
- test
- multi-eval
- run retry
- rerun failed task
- refactor task run for lib call
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
langeval_cli-0.1.2.tar.gz
(72.8 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file langeval_cli-0.1.2.tar.gz.
File metadata
- Download URL: langeval_cli-0.1.2.tar.gz
- Upload date:
- Size: 72.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.24.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7bf04bc743a23a440553718b4af0cbf3b8cb090ec692ab758231af60410b2f5f
|
|
| MD5 |
3495b3c45619b33068feb4d060630f0c
|
|
| BLAKE2b-256 |
15028a3c5cd864698d35921683ddc8e81f37a692215f56eb463f6ec81ec96374
|
File details
Details for the file langeval_cli-0.1.2-py3-none-any.whl.
File metadata
- Download URL: langeval_cli-0.1.2-py3-none-any.whl
- Upload date:
- Size: 28.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.24.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f365376fb4ace268b89e4fae02b9d42061247e1c4584c1a43ec0f87cb9946c32
|
|
| MD5 |
2427e6703c0699eb73dc4106dbc7f1a5
|
|
| BLAKE2b-256 |
c3286f993852ee92bbd96d588907aad21e141256cb3d53dac0e2b13db7b2dd2a
|
