Simple Evaluation Framework for LLM use cases
Project description
Simple LLM Evaluation
Welcome to the simple LLM evaluation framework—simpleval, for short.
simpleval is a Python package designed to make evaluating Large Language Models (LLMs) easier, using the "LLM as a Judge" technique.
It supports a variety of LLM providers, including OpenAI, Google (Gemini API, Vertex), AWS Bedrock, Anthropic, Azure, and more (via LiteLLM).
simpleval also includes several reports to help you analyze, compare, and summarize your evaluation results. See the available reports for more details.
Getting Started
See the 📚 Quickstart Guide 📚
Documentation
Contributing
We appreciate your help in making this project better! ✨
If you would like to contribute to this project, please follow the guidelines outlined in the CONTRIBUTING.md file.
License
simpleval is released under the Apache License. See the LICENSE file for more details.
Contact
If you have any questions or suggestions, feel free to join our GitHub discussions forum 💬
If you want to report a bug or request a feature, please open an issue in the GitHub issues tracker 🐛
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file simpleval-1.1.0-py3-none-any.whl.
File metadata
- Download URL: simpleval-1.1.0-py3-none-any.whl
- Upload date:
- Size: 3.1 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
54e27381393408cc76a268ebf0b57186cab10ff9fcb87f1c8fd6a930e6cfdf20
|
|
| MD5 |
baf09241b4c10561a9e21c4e56496e70
|
|
| BLAKE2b-256 |
bfd1659361917ea149590e28ab64e89fef5e80c07d54d2e752430de94425aff7
|
