Agent Evaluation
Agent Evaluation is a generative AI-powered framework for testing virtual agents.
Internally, Agent Evaluation implements an LLM agent (evaluator) that will orchestrate conversations with your own agent (target) and evaluate the responses during the conversation.
✨ Key features
- Built-in support for popular AWS services including Amazon Bedrock, Amazon Q Business, and Amazon SageMaker. You can also bring your own agent to test using Agent Evaluation.
- Orchestrate concurrent, multi-turn conversations with your agent while evaluating its responses.
- Define hooks to perform additional tasks such as integration testing.
- Can be incorporated into CI/CD pipelines to expedite the time to delivery while maintaining the stability of agents in production environments.
📚 Documentation
To get started, please visit the full documentation here. To contribute, please refer to CONTRIBUTING.md
👏 Contributors
Shout out to these awesome contributors:
1 maintainer
Release files for agent-evaluation 0.4.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| agent_evaluation-0.4.1.tar.gz | 28.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| agent_evaluation-0.4.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 74.5 kB
Release files / agent_evaluation-0.4.1.tar.gz
| Download URL | agent_evaluation-0.4.1.tar.gz |
|---|---|
| Size | 28.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
279412bd2074540818e7785c1969b17770bf71c67760c2dc51bcfac6d699fe5b
|
|
BLAKE2b-256 checksum How to use checksums |
09975b31e0125b8dbc86cca20e4d668ce67713728900312beea04acdb652a234
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.11
|
Release files / agent_evaluation-0.4.1-py3-none-any.whl
| Download URL | agent_evaluation-0.4.1-py3-none-any.whl |
|---|---|
| Size | 46.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
62665e60358f62637876821565a7c19254953860cbf052b4ada29840675ea303
|
|
BLAKE2b-256 checksum How to use checksums |
5d8178aa63d8c9982cb2a99470fb26f3a3a7b81334306591169f3f6425cf7378
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.11
|
