Skip to main content

LangEval

Evaluation for AI apps and agent

PyPI - Version PyPI - Python Version

▄▄▌   ▄▄▄·  ▐ ▄  ▄▄ • ▄▄▄ . ▌ ▐· ▄▄▄· ▄▄▌
██•  ▐█ ▀█ •█▌▐█▐█ ▀ ▪▀▄.▀·▪█·█▌▐█ ▀█ ██•
██▪  ▄█▀▀█ ▐█▐▐▌▄█ ▀█▄▐▀▀▪▄▐█▐█•▄█▀▀█ ██▪
▐█▌▐▌▐█ ▪▐▌██▐█▌▐█▄▪▐█▐█▄▄▌ ███ ▐█ ▪▐▌▐█▌▐▌
.▀▀▀  ▀  ▀ ▀▀ █▪·▀▀▀▀  ▀▀▀ . ▀   ▀  ▀ .▀▀▀

Table of Contents

Installation

pip install langeval-cli

Documents

TODOs:

  • Refactor RAG Eval
  • Support custom output parser
  • Support more provider.

How to use

see ./examples for more details.

Development

# Create virtual environment
hatch env create
# Activate virtual environment
hatch shell
# Run test
hatch run test
# Run lint
hatch run lint:style

# Version dump
hatch version patch/minor/major
# Build
hatch build
# Upload to pypi
hatch publish

License

LangEval is distributed under the terms of the MIT license.

Metadata

Release files for langeval-cli 0.4.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for langeval-cli 0.4.0
File Size Uploaded
langeval_cli-0.4.0.tar.gz 1.7 MB Details

Built distribution (wheel)

Table of built distributions (wheels) for langeval-cli 0.4.0
File Interpreter ABI Platform
langeval_cli-0.4.0-py3-none-any.whl Python 3 none any Details

Total release size: 1.7 MB

Release files / langeval_cli-0.4.0.tar.gz

Download URL langeval_cli-0.4.0.tar.gz
Size 1.7 MB
Tags Source
SHA-256 checksum
How to use checksums
3b902fde72e235388ea9733ef38050ee820afe71ead5e06dfe3d8d8651421fbb
BLAKE2b-256 checksum
How to use checksums
ce1f4023b2ff8afaed91d67c89f4c8dd8dfdbd8a4b95b8cc7ad10ba49945342b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via python-httpx/0.24.1

Release files / langeval_cli-0.4.0-py3-none-any.whl

Download URL langeval_cli-0.4.0-py3-none-any.whl
Size 42.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e5a5c37e2d849659e4d77d7ccadb15e57558ec60eda68336f20eeb95b498f147
BLAKE2b-256 checksum
How to use checksums
cb795cf371e0aeb6ccf11e770970f99d7e119afcd7954bcb1d48fbe33c224bf3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via python-httpx/0.24.1

Release history Release notifications | RSS feed

This release

0.4.0 This release

2 release files

0.3.12

2 release files

0.3.11

2 release files

0.3.10

2 release files

0.3.9

2 release files

0.3.8

2 release files

0.3.7

2 release files

0.3.6

2 release files

0.3.5

2 release files

0.3.4

2 release files

0.3.3

2 release files

0.3.2

2 release files

0.3.1

2 release files

0.3.0

2 release files

0.2.2

2 release files

0.2.0

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page