Audit train/test leakage within and across ML benchmark datasets: overlap matrices, label conflicts, near-duplicates, and clean test splits.
Acceptance criteria that must be proven to fail on the unfixed code before they may count as passing.
Measure the real cost structure of multi-agent / multi-model LLM systems from request logs.
Anthropic, PBC
Visionary sponsor
Bloomberg
Visionary sponsor
Hudson River Trading
Visionary sponsor
Meta
Visionary sponsor
NVIDIA
Visionary sponsor
Microsoft
Sustainability sponsor
Depot
Continuous Integration
AWS
Cloud computing and Security Sponsor
Datadog
Monitoring
Fastly
CDN
Google
Download Analytics
Sentry
Error logging
StatusPage
Status page