Simple LLM Evaluation
Welcome to the simple LLM evaluation framework—simpleval, for short.
simpleval is a Python package designed to make evaluating Large Language Models (LLMs) easier, using the "LLM as a Judge" technique.
It supports a variety of LLM providers, including OpenAI, Google (Gemini API, Vertex), AWS Bedrock, Anthropic, Azure, and more (via LiteLLM).
simpleval also includes several reports to help you analyze, compare, and summarize your evaluation results. See the available reports for more details.
Getting Started
See the 📚 Quickstart Guide 📚
Documentation
Contributing
We appreciate your help in making this project better! ✨
If you would like to contribute to this project, please follow the guidelines outlined in the CONTRIBUTING.md file.
License
simpleval is released under the Apache License. See the LICENSE file for more details.
Contact
If you have any questions or suggestions, feel free to join our GitHub discussions forum 💬
If you want to report a bug or request a feature, please open an issue in the GitHub issues tracker 🐛
Release files for simpleval 1.1.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| simpleval-1.1.3-py3-none-any.whl | Python 3 | none | any | Details |
Release files / simpleval-1.1.3-py3-none-any.whl
| Download URL | simpleval-1.1.3-py3-none-any.whl |
|---|---|
| Size | 3.1 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
82480ac30c23f7d61a4452afddc6ea9938f01e22212f795ea96748fcbee6554f
|
|
BLAKE2b-256 checksum How to use checksums |
c0b89ad827db3b401d98b412521c2ab82eb4dda5fbb92946f990c04f6b1edbcf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.13.3
|
