Unified rubric and run adapter for common eval frameworks.
Verified details
These details have been verified by PyPIProject links
GitHub Statistics
Maintainers
Project description
eval-adapter
eval-adapter lets one rubric-spec v1 rubric and run config drive synthetic-compatible runs across Inspect AI, LM Eval Harness, OpenAI Evals, PromptFoo, DeepEval, LangSmith exports, and Phoenix exports.
Quickstart
pip install eval-adapter
eval-adapter run --config examples/unified_config_sample.yaml --runner all
The runner modules normalize each framework shape into one EvalRunResult containing
item_count, per-criterion scores, weights, weighted scores, and source metadata.
LangSmith and Phoenix exports can be imported from their feedback/trace shapes; see
examples/sample_exports.json.
What This Is Not
This is not a hosted eval platform and includes no paid or customer data.
Project details
Verified details
These details have been verified by PyPIProject links
GitHub Statistics
Maintainers
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file eval_adapter-0.1.1.tar.gz.
File metadata
- Download URL: eval_adapter-0.1.1.tar.gz
- Upload date:
- Size: 6.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1a3262c4fccd164942a9a455a5d8f6fe0c3d58dc93224ee72ccbcdfdfe695cbf
|
|
| MD5 |
0f4d94d863883adb7e9d2a62212bdbcb
|
|
| BLAKE2b-256 |
ae73a79a0c7ab952f5002b46f370cb946efb48f9eb872cd69f47773e23daf87c
|
Provenance
The following attestation bundles were made for eval_adapter-0.1.1.tar.gz:
Publisher:
release-python.yml on auraoneai/eval-adapter
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
eval_adapter-0.1.1.tar.gz -
Subject digest:
1a3262c4fccd164942a9a455a5d8f6fe0c3d58dc93224ee72ccbcdfdfe695cbf - Sigstore transparency entry: 1519865702
- Sigstore integration time:
-
Permalink:
auraoneai/eval-adapter@6124febaee1fff50cd502055ae954e443207e0ba -
Branch / Tag:
refs/heads/main - Owner: https://github.com/auraoneai
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release-python.yml@6124febaee1fff50cd502055ae954e443207e0ba -
Trigger Event:
workflow_dispatch
-
Statement type:
File details
Details for the file eval_adapter-0.1.1-py3-none-any.whl.
File metadata
- Download URL: eval_adapter-0.1.1-py3-none-any.whl
- Upload date:
- Size: 8.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3f404433f9fc358ed8580e4b637ad29be3dfdd82557fe95fdfdbf560581919bb
|
|
| MD5 |
4e9e53a36e7c0babffe665731baf4df0
|
|
| BLAKE2b-256 |
20356b98c54b68ea46a1dce3b82e07198fa451327b8026ea81a71c62013d9d5e
|
Provenance
The following attestation bundles were made for eval_adapter-0.1.1-py3-none-any.whl:
Publisher:
release-python.yml on auraoneai/eval-adapter
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
eval_adapter-0.1.1-py3-none-any.whl -
Subject digest:
3f404433f9fc358ed8580e4b637ad29be3dfdd82557fe95fdfdbf560581919bb - Sigstore transparency entry: 1519865716
- Sigstore integration time:
-
Permalink:
auraoneai/eval-adapter@6124febaee1fff50cd502055ae954e443207e0ba -
Branch / Tag:
refs/heads/main - Owner: https://github.com/auraoneai
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release-python.yml@6124febaee1fff50cd502055ae954e443207e0ba -
Trigger Event:
workflow_dispatch
-
Statement type:
