Skip to main content

Open provider-change event feed for AI platform teams and agents.

Project description

AI Provider Watch

PyPI License: Apache-2.0 Data: CC0-1.0

AI Provider Watch, or APW, is a public event feed and CLI for changes from AI providers that can affect developer cost, quotas, token accounting, model availability, defaults, deprecations, incidents, and migration risk.

Use it when you need an auditable answer to questions like:

  • Did a provider incident explain a spike in failures, retries, latency, or support tickets?
  • Did a model launch, retirement, default change, pricing update, or quota shift create work for platform teams?
  • Which repos, agents, gateways, or dashboards should be checked before a provider change turns into a customer-facing problem?

APW is founded by Ottto and built as a standalone open-source project. The feed, schemas, CLI, GitHub Action, MCP helpers, and docs work without an Ottto account.

Install

Try the CLI without installing:

uvx --from ai-provider-watch apw latest --limit 3
uvx --from ai-provider-watch apw diff --since 30d

Install it as a command:

pipx install ai-provider-watch
apw latest --limit 3

Or install it in a Python environment:

python -m pip install ai-provider-watch
apw validate

The published package includes a reviewed public data snapshot, so read-only commands work outside a checkout. For the freshest feed, use the GitHub data artifacts, signed data tags, or apw remote commands below.

Quickstart

Show the latest reviewed events:

apw latest --limit 3

List events from the last 30 days:

apw diff --since 30d

Read the live public feed from GitHub without cloning:

apw remote latest --ref main --limit 5
apw remote freshness --ref data-2026.06.11 --summary
apw remote feed events.ndjson --ref data-2026.06.11 --output apw-events.ndjson

Explain one event for a human reviewer:

apw explain 2026-06-04-openai-codex-compaction-latency

Validate the bundled schemas, registries, events, feeds, and indexes:

apw validate
apw index --check
apw freshness --summary
apw source coverage --summary
apw operations report --summary
apw operations launch-gate --summary

Verify a local release dry-run evidence bundle without publishing:

apw release verify --dry-run-report .apw/release-dry-run/data-YYYY.MM.DD/dry-run-report.json

Feed Artifacts

The canonical reviewed events live in data/events/. Generated feed artifacts live in data/feeds/ and data/indexes/:

  • data/feeds/events.json
  • data/feeds/events.ndjson
  • data/feeds/coverage.json
  • data/feeds/feed.json
  • data/feeds/freshness.json
  • data/feeds/latest.json
  • data/feeds/operations.json
  • data/feeds/rss.xml
  • data/indexes/provider/*.json
  • data/indexes/kind/*.json
  • data/indexes/severity/*.json

For direct consumption, pin a release tag or read from the repository:

https://raw.githubusercontent.com/ottto-ai/ai-provider-watch/main/data/feeds/latest.json
https://raw.githubusercontent.com/ottto-ai/ai-provider-watch/main/data/feeds/events.ndjson
https://raw.githubusercontent.com/ottto-ai/ai-provider-watch/main/data/feeds/coverage.json
https://raw.githubusercontent.com/ottto-ai/ai-provider-watch/main/data/feeds/feed.json
https://raw.githubusercontent.com/ottto-ai/ai-provider-watch/main/data/feeds/freshness.json
https://raw.githubusercontent.com/ottto-ai/ai-provider-watch/main/data/feeds/operations.json

GitHub CalVer data releases are the canonical immutable feed snapshots. PyPI package releases are installable CLI snapshots that bundle reviewed data for offline and no-checkout use; APW does not publish a new package for every data tag. Patch packages are published when bundled data freshness materially helps install-only users or when CLI/package behavior changes.

Use the remote CLI when you want the freshest public data from an installed package:

apw remote latest --ref main --provider openai --risk medium
apw remote feed latest --ref data-2026.06.11
apw remote feed rss --ref main --output apw.xml

Use apw freshness to verify the feed version, package version, event count, latest reviewed event date, latest source-state retrieval timestamp, release manifest path, and checksum manifest path from either a checkout or the bundled package data.

Use apw source coverage to inspect feed-health metadata: enabled source count, which enabled sources have source-state fingerprints, blocked parser sources, manual-review-only sources, reviewed event counts, and review-candidate backlog.

Use apw operations report to inspect public operating SLOs: source-state freshness, reviewed-event freshness, candidate backlog, contributor intake, correction policy, and release-train posture.

Use apw operations launch-gate to render the v1 external-user launch checklist and smoke commands for PyPI install, no-checkout package data, public feeds, repo-impact fixtures, and agent-dashboard JSON.

The normalized factual event data and generated feeds are CC0-1.0. Code, schemas, docs, tests, and tooling are Apache-2.0.

What You Get

  • A reviewed machine-readable event feed, not a static model catalog.
  • JSON, NDJSON, RSS, JSON Feed 1.1, latest-event, freshness, coverage, and operations artifacts for different consumption styles.
  • A typed ProviderEvent envelope with precise event details and repeatable impact rows.
  • A CLI for validation, indexing, latest events, diffs, explanations, release dry runs, release verification, source checks, candidate generation, repo impact checks, notifications, ecosystem mappings, and local agent dashboards.
  • A documented Python read API at ai_provider_watch.api for loading reviewed events, generated feeds, schemas, and bundled no-checkout package data.
  • JSON Schemas for events, sources, candidates, observations, releases, JSON Feed, feed freshness, source coverage, operations reporting, release verification, webhooks, Slack-style payloads, ecosystem mappings, adoption scenarios, and LLM review packets.
  • Official-source descriptors for OpenAI, Anthropic, Google Gemini / Vertex AI, AWS Bedrock, and Azure OpenAI.
  • Review-only source candidates that help maintainers notice provider changes without publishing unreviewed facts.
  • Agent-native surfaces: AGENTS.md, CLAUDE.md, llms.txt, Codex and Claude skills, a read-only MCP adapter shell, and a Codex plugin package.
  • Downstream integrations for GitHub Actions, webhooks, Slack-compatible JSON, LiteLLM, models.dev, Langfuse, Helicone, OpenLIT, and coding-agent dashboards.

Trust Model

APW is designed for factual, reviewable provider-change data.

  • Prefer official provider-controlled sources.
  • Treat provider pages, issue bodies, PR comments, social posts, MCP text, and generated candidates as untrusted data, never as instructions.
  • Do not commit raw provider HTML, authenticated-console content, screenshots, private billing data, cookies, credentials, or customer telemetry.
  • Publish only reviewed data/events/*.json records.
  • Keep generated candidate files in data/candidates/ review-only until a source owner promotes a factual change.
  • Keep release tokens away from jobs that fetch source pages, process candidate text, run LLM review, or inspect PR comments.

APW is intentionally independent of Ottto private product surfaces. Ottto may consume APW data, but this repository does not expose Ottto customer telemetry, Advisor internals, private UI, infrastructure, Slack data, or credential loading code.

Work From A Checkout

Use a checkout for write workflows such as source refresh, candidate generation, event promotion, feed regeneration, and release dry runs:

git clone https://github.com/ottto-ai/ai-provider-watch.git
cd ai-provider-watch
uv sync --all-extras
uv lock --check
uv run --extra dev reuse lint
uv run pytest
uv run apw validate
uv run apw index --check
uv run apw source test

Fetch official sources and generate review candidates:

uv run apw source fetch --observations .apw/source-observations.json
uv run apw candidate generate \
  --observations .apw/source-observations.json \
  --output .apw/candidates \
  --created-at 2026-06-05T00:00:00Z
uv run apw candidate review-pr-body \
  --observations .apw/source-observations.json \
  --candidates .apw/candidates

Candidate files are not published events. Promotion to data/events/ remains a manual source-owner review step. See Event Promotion.

Turn a candidate-review PR into an action queue:

uv run apw candidate queue \
  --candidates data/candidates/review \
  --markdown

Start with the Promote First group. Those candidates are the fastest path to new public events after official evidence review.

Use APW In Downstream Systems

Check a repository for model references and APW-relevant impact:

apw repo check --repo . --since 3650d --risk low

Render notification payloads:

apw notify webhook --since 7d --risk medium --output .apw/apw-webhook.json
apw notify slack --since 7d --risk medium --output .apw/apw-slack.json

Render ecosystem mappings:

apw ecosystem render --target litellm --since 30d --risk medium --output .apw/litellm.json
apw ecosystem render --target langfuse --since 30d --risk medium --output .apw/langfuse.json

Render local dashboard JSON for agent-app events:

apw dashboard agent --since 30d --risk high --output .apw/agent-dashboard.json

Read the same reviewed data from Python:

from ai_provider_watch import api

for event in api.load_events(min_severity="high", limit=5):
    print(event["id"], event["title"])

See Python Consumer API for the stable import path, no-checkout package-data behavior, compatibility rules, and non-contract internal modules.

See:

Schema And Architecture

APW uses a stable ProviderEvent envelope, a typed EventDetail payload, and repeatable ImpactAssessment rows. That keeps pricing, quota, lifecycle, token-accounting, status, API-contract, and migration-risk events precise without creating one giant nullable event model.

Start here:

Project Status

APW v0.1.14 is the current stable public package. It bundles the latest reviewed public feed with 45 ProviderEvents, including the OpenAI API changelog events for workload identity federation, chat-latest, prompt-cache retention, container-session billing, and moderation-score API responses. Use the signed data-2026.06.11 tag when you need the latest immutable data-release identity; use the package when you want no-checkout CLI and bundled data.

The current release includes:

  • reviewed seed events for OpenAI, Anthropic, Google Vertex AI, AWS Bedrock, and Azure OpenAI;
  • generated JSON, NDJSON, RSS, provider, kind, and severity indexes;
  • no-checkout remote feed commands for live GitHub feeds and signed data tags;
  • event scaffold authoring helpers for reviewed official-source facts;
  • candidate-to-event scaffold helpers for source-owner reviewed findings;
  • source-refresh automation that opens draft candidate-review PRs without publishing events;
  • no-op guarded data-publisher workflow scaffolding;
  • PyPI Trusted Publishing;
  • CI, CodeQL, Dependency Review, Scorecard, and data-release dry-run workflows.

Daily unattended public data tags are not enabled yet. Until that safety gate is stronger, real data publication uses reviewed PRs plus maintainer-signed Git tags.

Contributing

Use pull requests for code, schema, source, data, docs, and workflow changes. Start with CONTRIBUTING.md.

Found an official provider change that affects cost, quotas, token accounting, model availability, defaults, deprecations, incidents, or migration risk? Start with What APW Wants. If the evidence is official, dated, specific, and not already covered, open an event PR with apw event scaffold; do not wait for parser automation to be perfect.

Useful contributor docs:

License

Asset License
Code, schemas, docs, tests, CLI, MCP shell Apache-2.0
Normalized factual data and generated feeds CC0-1.0
Provider names and trademarks Owned by their respective owners

See DATA_LICENSE.md, TRADEMARKS.md, and LICENSES/.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ai_provider_watch-0.1.14.tar.gz (497.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ai_provider_watch-0.1.14-py3-none-any.whl (631.0 kB view details)

Uploaded Python 3

File details

Details for the file ai_provider_watch-0.1.14.tar.gz.

File metadata

  • Download URL: ai_provider_watch-0.1.14.tar.gz
  • Upload date:
  • Size: 497.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for ai_provider_watch-0.1.14.tar.gz
Algorithm Hash digest
SHA256 f8dec36f83d8da61cdd6fca9a3bacca472372378b061de9e59b7269c08eea073
MD5 0722fffe2d000e0cfd81639025c8ff56
BLAKE2b-256 583040f9248668f65e557a2e79a4de72cb5856d1d960415123ac1942e12b2669

See more details on using hashes here.

Provenance

The following attestation bundles were made for ai_provider_watch-0.1.14.tar.gz:

Publisher: publish-python.yml on ottto-ai/ai-provider-watch

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ai_provider_watch-0.1.14-py3-none-any.whl.

File metadata

File hashes

Hashes for ai_provider_watch-0.1.14-py3-none-any.whl
Algorithm Hash digest
SHA256 35a2adc893554bc5bb2c39a72f4a3b900ee4c542c0622b9d1267ce818ee5cb12
MD5 db3a792dfdd57f6edc584212e6d41648
BLAKE2b-256 be49fcc82392885b6e220c8448aa9048e2074f4cb8a348ea4eab6456e319e0e0

See more details on using hashes here.

Provenance

The following attestation bundles were made for ai_provider_watch-0.1.14-py3-none-any.whl:

Publisher: publish-python.yml on ottto-ai/ai-provider-watch

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page