Evaluation for AI apps and agent.
Project description
LangEval
Evaluation for AI apps and agent
▄▄▌ ▄▄▄· ▐ ▄ ▄▄ • ▄▄▄ . ▌ ▐· ▄▄▄· ▄▄▌
██• ▐█ ▀█ •█▌▐█▐█ ▀ ▪▀▄.▀·▪█·█▌▐█ ▀█ ██•
██▪ ▄█▀▀█ ▐█▐▐▌▄█ ▀█▄▐▀▀▪▄▐█▐█•▄█▀▀█ ██▪
▐█▌▐▌▐█ ▪▐▌██▐█▌▐█▄▪▐█▐█▄▄▌ ███ ▐█ ▪▐▌▐█▌▐▌
.▀▀▀ ▀ ▀ ▀▀ █▪·▀▀▀▀ ▀▀▀ . ▀ ▀ ▀ .▀▀▀
Table of Contents
Installation
pip install langeval-cli
Documents
TODO
How to use
see ./examples for more details.
Development
# Create virtual environment
hatch env create
# Activate virtual environment
hatch shell
# Run test
hatch run test
# Run lint
hatch run lint:style
# Version dump
hatch version patch/minor/major
# Build
hatch build
# Upload to pypi
hatch publish
License
LangEval is distributed under the terms of the MIT license.
TODO
| Priority | Description |
|---|---|
| High | Re-run failed task. |
| High | Better Custom Provider. |
| Medium | Documents |
| Medium | Test |
| Low | Support multi evaluator in one task. |
| Low | Support run task from Python code. |
| Low | Display task status in web. |
| Low | Support OpenAI function calling. |
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
langeval_cli-0.1.4.tar.gz
(1.7 MB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file langeval_cli-0.1.4.tar.gz.
File metadata
- Download URL: langeval_cli-0.1.4.tar.gz
- Upload date:
- Size: 1.7 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.25.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7dc13c647df9f974f8f202f143957253daced7b560c88a12a2aa58e13702954a
|
|
| MD5 |
b6e8368e972a7987d93f6709d7b37348
|
|
| BLAKE2b-256 |
052fe3505d2984605f7a2cc8fdd9711efc8a13fb6c4194c4320af43a7ac32263
|
File details
Details for the file langeval_cli-0.1.4-py3-none-any.whl.
File metadata
- Download URL: langeval_cli-0.1.4-py3-none-any.whl
- Upload date:
- Size: 32.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.25.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
aa606d7f1c657383e207eecd75685d734be29e911f9ab82ca0ed64a606d1582c
|
|
| MD5 |
27dab2556260550493bbd17580bc802a
|
|
| BLAKE2b-256 |
ed9d5512002fcfe7d1b6b6363c7be2c6dea4b85906a1590687d6507be6515736
|
