coreason-assay
The Scientific Testing Engine for AI Agents.
coreason-assay is the Quality Control (QC) laboratory of the CoReason platform. It provides a rigorous framework for evaluating the performance, safety, and alignment of AI agents before they are deployed to production.
Features
- Benchmark Evaluation Corpus (BEC) Management: Easily ingest test cases from CSV, JSONL, or ZIP archives.
- Simulation: Run agents in a controlled sandbox with mocked tools and injected context.
- Glass Box Grading: Evaluate not just the answer, but the reasoning process (Faithfulness, Alignment, Tone).
- Report Cards: Generate detailed reports with drift detection and pass/fail metrics.
Quick Start
Installation
poetry install
Usage
Run the CLI to upload a test corpus:
poetry run coreason-assay upload path/to/bec_archive.zip
Server Mode (Service C)
coreason-assay can also be run as a containerized microservice exposing a REST API.
# Start the server (requires Docker)
docker build -t coreason-assay:0.4.0 .
docker run -p 8000:8000 coreason-assay:0.4.0
The service exposes endpoints for uploading corpora (POST /upload) and running assays (POST /run). See docs/usage.md for details.
Documentation
For full documentation, including architecture details, usage guides, and examples, please visit the docs folder.
License
This software is proprietary and dual-licensed. See LICENSE for details.
1 maintainer
Metadata
1 maintainer
Release files for coreason-assay 0.4.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| coreason_assay-0.4.0.tar.gz | 25.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| coreason_assay-0.4.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 59.5 kB
Release files / coreason_assay-0.4.0.tar.gz
| Download URL | coreason_assay-0.4.0.tar.gz |
|---|---|
| Size | 25.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
769cc5b10b3d39cc1e9aa3d53de33512c567b73538d1d39f009c393682432d1f
|
|
BLAKE2b-256 checksum How to use checksums |
e8b37e4c82bd48dd260793629bac503637df3cd9c75e084c555b1676f298929a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Jan 29, 2026.
Transparency logRelease files / coreason_assay-0.4.0-py3-none-any.whl
| Download URL | coreason_assay-0.4.0-py3-none-any.whl |
|---|---|
| Size | 34.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
74c7fedeb10290dc346579de0cc9944ab1e7eed16d790abe65ea8f03c319be79
|
|
BLAKE2b-256 checksum How to use checksums |
9c4094d305aab2420fb26904323e4d8b6cc092c9d2bf5c0a3582f908a80e7684
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Jan 29, 2026.
Transparency log
