27 projects
saiddone
When a coding agent says done, fixed or tests pass, check what its own commands showed. Offline, no model.
rankcheck
How many real ranks does a leaderboard carry, and how many independent signals does a model panel carry?
agent-evidence-vectors
Conformance corpora and reference verifiers for agent evidence records
agent-evidence-mcp
Offline, read-only MCP server that verifies agent evidence claims and replays the agent-evidence conformance vectors
probity-verify
Moved to agent-evidence-verify; this release installs it and keeps the old imports working
agent-evidence-replay
Replay a lab-produced agent action record: recompute its digest chain and flag tamper or a gap
agent-evidence-verify
Check claims against pinned evidence offline, with replayable decisions
agent-evidence-observer
Check retained agent-evidence packets, histories and native reports offline
agent-evidence-vocabulary
Versioned terms for claims about agent execution evidence
probity-ratchet
An agent harness that turns each failure into a proven guard or procedure, with every version and proof kept in MongoDB Atlas.
probity-effects
Keep one effect per agent tool call when its reply is lost: reconcile before resend, record the trail, test it in CI
jcs-admit
Admission control and RFC 8785 canonicalization for JSON about to be signed, plus DSSE signing, from the jcs-admit and dsse Rust crates
probityai
The probityai command: verify agent evidence offline, one entry point for the evidence tools
agent-evidence-admission
Check that an artifact has the digest its compliance document, SBOM or attestation names.
poc-evidence-vectors
Conformance vectors and an independent twin verifier for Proof-of-Control evidence tokens, Merkle proofs, chains and canonical form
probity-ratchet-cases
Agent cases graded on final state: a simulated company, deterministic tool faults, exact graders and scripted solvers.
ratchet-cases
Agent cases graded on final state: a simulated company, deterministic tool faults, exact graders and scripted solvers.
tsbootstrap
Fast, dependence-aware resampling and uncertainty for time series and panels
probity-cli
Reserved for Probity, open-source testing and evaluation for MCP servers, A2A agents and agent skills.
probity-evals
Reserved for Probity, open-source testing and evaluation for MCP servers, A2A agents and agent skills.
probity-skills
Reserved for Probity, open-source testing and evaluation for MCP servers, A2A agents and agent skills.
probity-a2a
Reserved for Probity, open-source testing and evaluation for MCP servers, A2A agents and agent skills.
probity-mcp
Reserved for Probity, open-source testing and evaluation for MCP servers, A2A agents and agent skills.
pytest-probity
Reserved for Probity, open-source testing and evaluation for MCP servers, A2A agents and agent skills.
probity-pro
Reserved for Probity, open-source testing and evaluation for MCP servers, A2A agents and agent skills.
probityai-pro
Reserved for Probity, open-source testing and evaluation for MCP servers, A2A agents and agent skills.
waitbus
Workstation-local event bus and blocking wait/emit primitive: let any agent or script wait on or emit CI, pytest, Docker, and filesystem events without polling. GitHub Actions is source #1.