vlabs-sdk

Verifiable Labs builds clean feedback and promotion gates for increasingly general AI agents.

SDK contracts for the Verifiable Labs platform: run configuration, the model-provider interface, and the typed schemas that evaluation contracts, score sets, gate outcomes, and assurance cards are built from.

• pip package: vlabs-sdk
• import package: vlabs_sdk
• CLI: vlabs (clean promotion gate)

Install

pip install vlabs-sdk        # once published; until then:
pip install "vlabs-sdk @ git+https://github.com/verifiablelabs/vlabs-sdk@main"

from vlabs_sdk.providers.dummy_provider import DummyProvider
from vlabs_sdk.providers.base import ModelRequest
from vlabs_sdk.schemas import AssuranceCardV2, ScoreSet, TransferMetrics
from vlabs_sdk.run_config import default_config
from vlabs_sdk.formal_spec.clean_promotion_gate import accept_clean_update

Migrating from the legacy verifiable-labs-envs package? See MIGRATION.md.

clean-gate CLI

The vlabs CLI ships with the vlabs-sdk distribution — no extra install:

pip install vlabs-sdk
vlabs --help
vlabs clean-gate --old baseline.json --new candidate.json
# exit 0 = ACCEPT, exit 1 = REJECT (reasons printed)

The CLI is implemented in the bundled vlabs_prm_eval package (depends only on vlabs_sdk + typer); both import packages are included in the wheel.

What ships here

This repository is a mirror of the canonical monorepo with the import namespace remapped (see PROVENANCE.md); it becomes canonical at split-flip time.

Formal scope

Selected mathematical properties behind the contamination-resistant promotion gate are machine-verified in Lean 4. The implementation is property-tested against the formal specification.

License

Apache-2.0.