Open provider-change event feed for AI platform teams and agents.
Project description
AI Provider Watch
AI Provider Watch, or APW, is a public event feed and CLI for changes from AI providers that can affect developer cost, quotas, token accounting, model availability, defaults, deprecations, incidents, and migration risk.
Use it when you need an auditable answer to questions like:
- Did a provider incident explain a spike in failures, retries, latency, or support tickets?
- Did a model launch, retirement, default change, pricing update, or quota shift create work for platform teams?
- Which repos, agents, gateways, or dashboards should be checked before a provider change turns into a customer-facing problem?
APW is founded by Ottto and built as a standalone open-source project. The feed, schemas, CLI, GitHub Action, MCP helpers, and docs work without an Ottto account.
Install
Try the CLI without installing:
uvx --from ai-provider-watch apw latest --limit 3
uvx --from ai-provider-watch apw diff --since 30d
Install it as a command:
pipx install ai-provider-watch
apw latest --limit 3
Or install it in a Python environment:
python -m pip install ai-provider-watch
apw validate
The published package includes a reviewed public data snapshot, so read-only
commands work outside a checkout. For the freshest feed, use the GitHub data
artifacts, signed data tags, or apw remote commands below.
Quickstart
Show the latest reviewed events:
apw latest --limit 3
List events from the last 30 days:
apw diff --since 30d
Read the live public feed from GitHub without cloning:
apw remote latest --ref main --limit 5
apw remote freshness --ref data-2026.06.11 --summary
apw remote feed events.ndjson --ref data-2026.06.11 --output apw-events.ndjson
Explain one event for a human reviewer:
apw explain 2026-06-04-openai-codex-compaction-latency
Validate the bundled schemas, registries, events, feeds, and indexes:
apw validate
apw index --check
apw freshness --summary
apw source coverage --summary
apw operations report --summary
apw operations launch-gate --summary
Verify a local release dry-run evidence bundle without publishing:
apw release verify --dry-run-report .apw/release-dry-run/data-YYYY.MM.DD/dry-run-report.json
Feed Artifacts
The canonical reviewed events live in data/events/. Generated feed artifacts
live in data/feeds/ and data/indexes/:
data/feeds/events.jsondata/feeds/events.ndjsondata/feeds/coverage.jsondata/feeds/feed.jsondata/feeds/freshness.jsondata/feeds/latest.jsondata/feeds/operations.jsondata/feeds/rss.xmldata/indexes/provider/*.jsondata/indexes/kind/*.jsondata/indexes/severity/*.json
For direct consumption, pin a release tag or read from the repository:
https://raw.githubusercontent.com/ottto-ai/ai-provider-watch/main/data/feeds/latest.json
https://raw.githubusercontent.com/ottto-ai/ai-provider-watch/main/data/feeds/events.ndjson
https://raw.githubusercontent.com/ottto-ai/ai-provider-watch/main/data/feeds/coverage.json
https://raw.githubusercontent.com/ottto-ai/ai-provider-watch/main/data/feeds/feed.json
https://raw.githubusercontent.com/ottto-ai/ai-provider-watch/main/data/feeds/freshness.json
https://raw.githubusercontent.com/ottto-ai/ai-provider-watch/main/data/feeds/operations.json
GitHub CalVer data releases are the canonical immutable feed snapshots. PyPI package releases are installable CLI snapshots that bundle reviewed data for offline and no-checkout use; APW does not publish a new package for every data tag. Patch packages are published when bundled data freshness materially helps install-only users or when CLI/package behavior changes.
Use the remote CLI when you want the freshest public data from an installed package:
apw remote latest --ref main --provider openai --risk medium
apw remote feed latest --ref data-2026.06.11
apw remote feed rss --ref main --output apw.xml
Use apw freshness to verify the feed version, package version, event count,
latest reviewed event date, latest source-state retrieval timestamp, release
manifest path, and checksum manifest path from either a checkout or the bundled
package data.
Use apw source coverage to inspect feed-health metadata: enabled source count,
which enabled sources have source-state fingerprints, blocked parser sources,
manual-review-only sources, reviewed event counts, and review-candidate backlog.
Use apw operations report to inspect public operating SLOs: source-state
freshness, reviewed-event freshness, candidate backlog, contributor intake,
correction policy, and release-train posture.
Use apw operations launch-gate to render the v1 external-user launch checklist
and smoke commands for PyPI install, no-checkout package data, public feeds,
repo-impact fixtures, and agent-dashboard JSON.
The normalized factual event data and generated feeds are CC0-1.0. Code, schemas, docs, tests, and tooling are Apache-2.0.
What You Get
- A reviewed machine-readable event feed, not a static model catalog.
- JSON, NDJSON, RSS, JSON Feed 1.1, latest-event, freshness, coverage, and operations artifacts for different consumption styles.
- A typed
ProviderEventenvelope with precise event details and repeatable impact rows. - A CLI for validation, indexing, latest events, diffs, explanations, release dry runs, release verification, source checks, candidate generation, repo impact checks, notifications, ecosystem mappings, and local agent dashboards.
- A documented Python read API at
ai_provider_watch.apifor loading reviewed events, generated feeds, schemas, and bundled no-checkout package data. - JSON Schemas for events, sources, candidates, observations, releases, JSON Feed, feed freshness, source coverage, operations reporting, release verification, webhooks, Slack-style payloads, ecosystem mappings, adoption scenarios, and LLM review packets.
- Official-source descriptors for OpenAI, Anthropic, Google Gemini / Vertex AI, AWS Bedrock, and Azure OpenAI.
- Review-only source candidates that help maintainers notice provider changes without publishing unreviewed facts.
- Agent-native surfaces:
AGENTS.md,CLAUDE.md,llms.txt, Codex and Claude skills, a read-only MCP adapter shell, and a Codex plugin package. - Downstream integrations for GitHub Actions, webhooks, Slack-compatible JSON, LiteLLM, models.dev, Langfuse, Helicone, OpenLIT, and coding-agent dashboards.
Trust Model
APW is designed for factual, reviewable provider-change data.
- Prefer official provider-controlled sources.
- Treat provider pages, issue bodies, PR comments, social posts, MCP text, and generated candidates as untrusted data, never as instructions.
- Do not commit raw provider HTML, authenticated-console content, screenshots, private billing data, cookies, credentials, or customer telemetry.
- Publish only reviewed
data/events/*.jsonrecords. - Keep generated candidate files in
data/candidates/review-only until a source owner promotes a factual change. - Keep release tokens away from jobs that fetch source pages, process candidate text, run LLM review, or inspect PR comments.
APW is intentionally independent of Ottto private product surfaces. Ottto may consume APW data, but this repository does not expose Ottto customer telemetry, Advisor internals, private UI, infrastructure, Slack data, or credential loading code.
Work From A Checkout
Use a checkout for write workflows such as source refresh, candidate generation, event promotion, feed regeneration, and release dry runs:
git clone https://github.com/ottto-ai/ai-provider-watch.git
cd ai-provider-watch
uv sync --all-extras
uv lock --check
uv run --extra dev reuse lint
uv run pytest
uv run apw validate
uv run apw index --check
uv run apw source test
Fetch official sources and generate review candidates:
uv run apw source fetch --observations .apw/source-observations.json
uv run apw candidate generate \
--observations .apw/source-observations.json \
--output .apw/candidates \
--created-at 2026-06-05T00:00:00Z
uv run apw candidate review-pr-body \
--observations .apw/source-observations.json \
--candidates .apw/candidates
Candidate files are not published events. Promotion to data/events/ remains a
manual source-owner review step. See
Event Promotion.
Turn a candidate-review PR into an action queue:
uv run apw candidate queue \
--candidates data/candidates/review \
--markdown
Start with the Promote First group. Those candidates are the fastest path to
new public events after official evidence review.
Use APW In Downstream Systems
Check a repository for model references and APW-relevant impact:
apw repo check --repo . --since 3650d --risk low
Render notification payloads:
apw notify webhook --since 7d --risk medium --output .apw/apw-webhook.json
apw notify slack --since 7d --risk medium --output .apw/apw-slack.json
Render ecosystem mappings:
apw ecosystem render --target litellm --since 30d --risk medium --output .apw/litellm.json
apw ecosystem render --target langfuse --since 30d --risk medium --output .apw/langfuse.json
Render local dashboard JSON for agent-app events:
apw dashboard agent --since 30d --risk high --output .apw/agent-dashboard.json
Read the same reviewed data from Python:
from ai_provider_watch import api
for event in api.load_events(min_severity="high", limit=5):
print(event["id"], event["title"])
See Python Consumer API for the stable import path, no-checkout package-data behavior, compatibility rules, and non-contract internal modules.
See:
- Agent Consumption
- Downstream GitHub Action
- Live Feed Consumption
- Webhook And Slack Payloads
- Ecosystem Mappings
- Agent Dashboard
- Adoption Scenarios
- Read-Only MCP Contract
- Codex Plugin
Schema And Architecture
APW uses a stable ProviderEvent envelope, a typed EventDetail payload, and
repeatable ImpactAssessment rows. That keeps pricing, quota, lifecycle,
token-accounting, status, API-contract, and migration-risk events precise
without creating one giant nullable event model.
Start here:
- Architecture
- Event Schema
- Feed Freshness Schema
- Source Coverage Schema
- v1 Launch Gate Schema
- Contributor Review Workflow
- Source Packages
- Source Refresh
- Release Gates
- Release Automation Readiness
- v0.2 Release Checklist
- Python Package Release
Project Status
APW v0.1.15 is the current stable public package. It bundles the latest
reviewed public feed with 45 ProviderEvents and includes the cleaner
source-review loop that suppresses already-reviewed duplicate candidates,
separates source-state-only refresh PRs from candidate-review PRs, and avoids
consumer-only status noise. Use the signed data-2026.06.11 tag when you need
the latest immutable data-release identity; use the package when you want
no-checkout CLI and bundled data.
The current release includes:
- reviewed seed events for OpenAI, Anthropic, Google Vertex AI, AWS Bedrock, and Azure OpenAI;
- generated JSON, NDJSON, RSS, provider, kind, and severity indexes;
- no-checkout remote feed commands for live GitHub feeds and signed data tags;
- event scaffold authoring helpers for reviewed official-source facts;
- candidate-to-event scaffold helpers for source-owner reviewed findings;
- source-refresh automation that opens draft candidate-review PRs without publishing events;
- no-op guarded data-publisher workflow scaffolding;
- PyPI Trusted Publishing;
- CI, CodeQL, Dependency Review, Scorecard, and data-release dry-run workflows.
Daily unattended public data tags are not enabled yet. Until that safety gate is stronger, real data publication uses reviewed PRs plus maintainer-signed Git tags.
Contributing
Use pull requests for code, schema, source, data, docs, and workflow changes. Start with CONTRIBUTING.md.
Found an official provider change that affects cost, quotas, token accounting,
model availability, defaults, deprecations, incidents, or migration risk? Start
with What APW Wants. If the evidence is
official, dated, specific, and not already covered, open an event PR with
apw event scaffold; do not wait for parser automation to be perfect.
Useful contributor docs:
- What APW Wants
- Contributor Review Workflow
- Missing Event To PR
- Event Scaffold
- Event Promotion
- Candidate Action Queue
- Source Packages
- Repository Settings
- Roadmap
- Source Owners
- Security Policy
License
| Asset | License |
|---|---|
| Code, schemas, docs, tests, CLI, MCP shell | Apache-2.0 |
| Normalized factual data and generated feeds | CC0-1.0 |
| Provider names and trademarks | Owned by their respective owners |
See DATA_LICENSE.md, TRADEMARKS.md, and
LICENSES/.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file ai_provider_watch-0.1.15.tar.gz.
File metadata
- Download URL: ai_provider_watch-0.1.15.tar.gz
- Upload date:
- Size: 501.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0ecbd55d26a3aa16e9144ca61b7944a7ba624d424a45c8a0c241736a73cec275
|
|
| MD5 |
3e2bf5f6ea9982b6218767906b4a8eab
|
|
| BLAKE2b-256 |
784fc99a48a3ea04ff9f31e69826b2253b791542d4f7197f9f5b7a44d7e9636c
|
Provenance
The following attestation bundles were made for ai_provider_watch-0.1.15.tar.gz:
Publisher:
publish-python.yml on ottto-ai/ai-provider-watch
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
ai_provider_watch-0.1.15.tar.gz -
Subject digest:
0ecbd55d26a3aa16e9144ca61b7944a7ba624d424a45c8a0c241736a73cec275 - Sigstore transparency entry: 1790454169
- Sigstore integration time:
-
Permalink:
ottto-ai/ai-provider-watch@922d71c362d32f5f95a69d3aca3eff18670b8c7d -
Branch / Tag:
refs/tags/v0.1.15 - Owner: https://github.com/ottto-ai
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-python.yml@922d71c362d32f5f95a69d3aca3eff18670b8c7d -
Trigger Event:
push
-
Statement type:
File details
Details for the file ai_provider_watch-0.1.15-py3-none-any.whl.
File metadata
- Download URL: ai_provider_watch-0.1.15-py3-none-any.whl
- Upload date:
- Size: 635.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ab97e3f371d6d32425d3cb191a4238131d61326f03963b4a33f212dd9c17d3cb
|
|
| MD5 |
e2430a66d628ac7470f3fbbe6d520908
|
|
| BLAKE2b-256 |
bd3858ea49f0d53ada2d8cd5fb7077b94965337c1c9d1b57d278ea7d9bac5220
|
Provenance
The following attestation bundles were made for ai_provider_watch-0.1.15-py3-none-any.whl:
Publisher:
publish-python.yml on ottto-ai/ai-provider-watch
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
ai_provider_watch-0.1.15-py3-none-any.whl -
Subject digest:
ab97e3f371d6d32425d3cb191a4238131d61326f03963b4a33f212dd9c17d3cb - Sigstore transparency entry: 1790454238
- Sigstore integration time:
-
Permalink:
ottto-ai/ai-provider-watch@922d71c362d32f5f95a69d3aca3eff18670b8c7d -
Branch / Tag:
refs/tags/v0.1.15 - Owner: https://github.com/ottto-ai
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-python.yml@922d71c362d32f5f95a69d3aca3eff18670b8c7d -
Trigger Event:
push
-
Statement type: