Evaluation for AI apps and agent.
Project description
LangEval
Evaluation for AI apps and agent
▄▄▌ ▄▄▄· ▐ ▄ ▄▄ • ▄▄▄ . ▌ ▐· ▄▄▄· ▄▄▌
██• ▐█ ▀█ •█▌▐█▐█ ▀ ▪▀▄.▀·▪█·█▌▐█ ▀█ ██•
██▪ ▄█▀▀█ ▐█▐▐▌▄█ ▀█▄▐▀▀▪▄▐█▐█•▄█▀▀█ ██▪
▐█▌▐▌▐█ ▪▐▌██▐█▌▐█▄▪▐█▐█▄▄▌ ███ ▐█ ▪▐▌▐█▌▐▌
.▀▀▀ ▀ ▀ ▀▀ █▪·▀▀▀▀ ▀▀▀ . ▀ ▀ ▀ .▀▀▀
Table of Contents
Installation
pip install langeval-cli
Documents
TODOs:
- merge uncommit changes in wsl
- support openai 2.0
- both support pydantic v1 & v2
- support qianfan the latest version
- total re-write examples
- support re-run
How to use
see ./examples for more details.
Development
# Create virtual environment
hatch env create
# Activate virtual environment
hatch shell
# Run test
hatch run test
# Run lint
hatch run lint:style
# Version dump
hatch version patch/minor/major
# Build
hatch build
# Upload to pypi
hatch publish
License
LangEval is distributed under the terms of the MIT license.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
langeval_cli-0.3.1.tar.gz
(60.4 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file langeval_cli-0.3.1.tar.gz.
File metadata
- Download URL: langeval_cli-0.3.1.tar.gz
- Upload date:
- Size: 60.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.24.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0a30265af9b817169ac6956c4a99857915d78d3d988be3d3fdeab324f2aae91d
|
|
| MD5 |
c537d85cf11f562742351ebed8c9f23a
|
|
| BLAKE2b-256 |
6d6726e3edd209b1dce99b461ab0d799fe0c21815d62d38ad939efe0773802c7
|
File details
Details for the file langeval_cli-0.3.1-py3-none-any.whl.
File metadata
- Download URL: langeval_cli-0.3.1-py3-none-any.whl
- Upload date:
- Size: 39.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.24.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c8bf6d5c37016acb3989cedd0468e945054b636659cce0ace21de827149006a5
|
|
| MD5 |
fbc4ea5186c97e4ed3bf8c4b8659054e
|
|
| BLAKE2b-256 |
e863f6d2fb65cb584d0041d8962a4e4c9f4cd823be823a6279d94700c2af1642
|