Skip to main content

BigQuery MCP

CI

A read-only Model Context Protocol server over Google BigQuery. It lets an AI client (Claude Code, Claude Desktop, …) answer plain-language data questions by discovering schema and running SELECT queries.

The AI does the natural-language → SQL translation; this server just safely executes against BigQuery under your own Google credentials.


Tools exposed

Tool Purpose Cost
list_datasets List datasets in the project free
list_tables List tables/views in a dataset free
get_table_schema Columns (nested paths expanded), partitioning, size, row count free
check_table_freshness When each table was last written — catches stale sources free
list_environments Which BigQuery environments are configured, and the default free
run_query Run a validated, read-only SELECT and return rows scans data

Only run_query costs anything, so the discovery tools are the ones to spend first. Two of them exist to prevent specific, repeated mistakes:

  • get_table_schema reports partitioning from table metadata, never from column names. A table with a partition_date column may not be partitioned — in which case no WHERE clause reduces the scan and every query reads the whole table. The response flags this explicitly when the table is large.
  • check_table_freshness finds tables that stopped being written to without being dropped. Those return stale data rather than an error, which is the failure mode nobody notices.

Environments

One server answers questions about several targets — a warehouse and its staging copy, or two regions of the same project. Every tool takes an optional environment; omitting it uses the default.

# ~/.config/data-platform-mcp/config.toml
default_environment = "warehouse"

[environments.warehouse]
project = "my-data-platform"
impersonate = "data-platform-mcp-ro@my-data-platform.iam.gserviceaccount.com"
dataset_allowlist = ["sales", "events"]

[environments.central]          # same project, different region
project = "my-data-platform"
location = "us-central1"

See config.toml.example for every setting, or set BQ_MCP_ENVIRONMENTS to the same structure as JSON. A single BQ_PROJECT still works unchanged — it becomes one environment named default.

An environment can be named by its own name, an alias, the built-in shorthands (prod, stg, dev, live) or its project id. An unknown name is an error naming the valid options, never a silent fall back to the default: a typo that answered a production question from staging would be invisible in the reply. Every result echoes back the environment it came from.

Regions are why this matters most here. BigQuery cannot query across locations, and its error for trying names neither location, so it reads as a missing table. One environment per location; doctor reports which datasets are where.


Read-only as a property of the identity

The SELECT-only guard and the readOnlyHint annotations are promises about this code. Pointing the server at a service account that holds only roles/bigquery.jobUser and a dataset-scoped roles/bigquery.dataViewer makes it a fact about the credentials — enforced by IAM whatever the code does, and whatever your own roles allow:

data-platform-mcp setup --project my-data-platform --datasets sales,events

Creates the account, grants those two roles, and gives you roles/iam.serviceAccountTokenCreator on it so the server can impersonate it. Add --dry-run to see the commands first; it is safe to re-run.

With --datasets, the dataset allowlist stops being an if statement in this process and becomes a grant Google enforces.


Quick start (per user)

Each person runs their own local copy. Queries execute under their own BigQuery/IAM permissions, so existing access controls decide who can see what. You need Python 3.11+ and the gcloud CLI installed.

1. Install

The package is published as data-platform-mcp (bigquery-mcp was already taken on PyPI by an unrelated project). Once a release is tagged, no checkout is needed — the client can fetch and run it directly:

uvx data-platform-mcp --version

Not yet published. No version tag has been pushed, so use the source install below until one is. See Releasing.

From source:

git clone git@github.com:deBilla/bigquery-mcp.git
cd bigquery-mcp

python3 -m venv .venv
./.venv/bin/pip install -e .

Either way you get a data-platform-mcp command, which is what the client runs.

2. Authenticate to Google (one time)

Uses Application Default Credentials. Run this once; queries then execute as you.

gcloud auth application-default login

Your account needs BigQuery Data Viewer + BigQuery Job User on the project you intend to query.

3. Check your setup

BQ_PROJECT=your-gcp-project data-platform-mcp doctor

Checks credentials, job permission, dataset visibility and — the one that catches people — dataset regions. BigQuery cannot query a dataset from a different location, and its own error names neither the location it wanted nor the one the dataset is in, so it reads as a missing table. doctor names both:

[  ok  ] run a query in my-project (location US)
[  ok  ] 39 datasets visible (no allowlist; all are readable)
[ warn ] 6 of 39 datasets are outside location US
         US-CENTRAL1: analytics_raw, business_data, ds_public, pg_public, public, recommendations
         BigQuery cannot query these from US, and cannot join them with
         datasets that are in it.
         Fix:  set BQ_LOCATION to the region you need, and run a separate
               server for datasets in another one.

A dataset in another region is a warning; one on your BQ_DATASET_ALLOWLIST is a failure, because no tool call could ever read it.

4. Register with your AI client

Replace your-gcp-project with your GCP project ID.

Claude Code — once published:

claude mcp add bigquery \
  --env BQ_PROJECT=your-gcp-project \
  -- uvx data-platform-mcp

From a source install, point at the checkout instead (replace /abs/path/bigquery-mcp):

claude mcp add bigquery \
  --env BQ_PROJECT=your-gcp-project \
  -- /abs/path/bigquery-mcp/.venv/bin/data-platform-mcp

Claude Desktop — add to claude_desktop_config.json:

{
  "mcpServers": {
    "bigquery": {
      "command": "/abs/path/bigquery-mcp/.venv/bin/data-platform-mcp",
      "args": [],
      "env": { "BQ_PROJECT": "your-gcp-project" }
    }
  }
}

5. Restart the client and ask a question

"Which datasets are available? In the sales dataset, how many rows does the orders table have?"


Safety

  • Every query is dry-run first to validate it and estimate bytes scanned.
  • Only SELECT / WITH statements run — no writes, DDL, or DML.
  • Cost confirmation: a query estimated to scan more than BQ_WARN_BYTES (default 1 GB) does not run. It returns status: "confirmation_required" with the estimated scan size and dollar cost so the client can ask before proceeding. Re-call with confirm_expensive=true to run it.
  • Hard cap: queries above BQ_MAX_BYTES_BILLED (default 5 GB) never run, even with confirmation — a runaway-cost backstop.
  • Optional dataset allowlist restricts what can be read.
  • Refusals are protocol errors. Anything the server declines to do — a non-SELECT statement, a disallowed dataset, a query over the hard cap — arrives with MCP's isError set, so it cannot be mistaken for a result. confirmation_required is the deliberate exception: it is a normal result, because the agent is meant to relay it and come back.
  • Responses are size-bounded. run_query stops adding rows once the serialised response reaches ~40k characters and sets stopped_for_size, so a wide result cannot quietly consume the whole context window. A partial answer always says that it is partial.
  • SQL is never written to the audit log — only a hash and a length. Query text routinely contains the user IDs or emails it filters on.

Cost-confirmation flow

run_query(sql)
   │  dry run estimates the scan
   ├── ≤ 1 GB ........... runs, returns rows + estimated_cost_usd
   ├── 1–5 GB .......... status: confirmation_required (size + $ estimate) → ask user
   │                      → run_query(sql, confirm_expensive=true) runs it
   └── > 5 GB ........... rejected, never runs

Configuration (environment variables)

Var Default Meaning
BQ_MCP_ENVIRONMENTS (none) JSON map of environment name to settings. Takes precedence over the config file.
BQ_MCP_DEFAULT_ENVIRONMENT (safest, else first) Environment used when a call omits environment. Prefers a staging/dev environment when unset.
BQ_MCP_CONFIG ~/.config/data-platform-mcp/config.toml Path to the TOML config file
BQ_IMPERSONATE_SERVICE_ACCOUNT (none) Read-only service account to impersonate
BQ_PROJECT (ADC project) GCP project ID whose BigQuery datasets you query. Falls back to the project associated with your credentials; tools error with instructions if neither is set.
BQ_LOCATION US BigQuery location
BQ_WARN_BYTES 1073741824 (1 GB) Above this, ask the user to confirm before running
BQ_MAX_BYTES_BILLED 5368709120 (5 GB) Hard per-query scan cap — never exceeded
BQ_COST_PER_TIB_USD 6.25 On-demand price used to render the cost estimate
BQ_ROW_LIMIT 200 Default rows returned
BQ_DATASET_ALLOWLIST (empty = all) Comma-separated dataset IDs
BQ_MCP_TRANSPORT stdio stdio (subprocess) or http/sse (serve over network)
BQ_MCP_HOST 127.0.0.1 Bind host when transport is http/sse. run-http.sh overrides this to 0.0.0.0 so containers can reach it — see the security note below.
BQ_MCP_PORT 8765 Bind port when transport is http/sse
BQ_MCP_AUDIT_LOG ~/.local/state/data-platform-mcp/audit.jsonl JSONL record of every tool call. off disables it. SQL text is never written — only a hash and length.
BQ_MCP_LOG_LEVEL INFO Verbosity of the stderr log

By default the server speaks stdio — the right choice when a client spawns it (Claude Code, Claude Desktop), and what the Quick start above uses.


Advanced: serve over HTTP

To reach the server from a remote or containerized client instead of having each client spawn its own, run it over HTTP:

BQ_PROJECT=your-gcp-project ./run-http.sh
# Serving … on http://0.0.0.0:8765/mcp

Clients then connect by URL (Claude Code):

claude mcp add --transport http bigquery http://<host>:8765/mcp

⚠️ Security: the HTTP endpoint has no authentication, and every query runs under the host's ADC credentials — not the connecting user's. Anyone who can reach the port gets full read access to BQ_PROJECT under your identity. Only expose it on a trusted network (bind BQ_MCP_HOST=127.0.0.1 and use an SSH tunnel/VPN, or an authenticating proxy). See docs/nanoclaw.md for the containerized-client setup this mode was designed for.

For server deployments, point GOOGLE_APPLICATION_CREDENTIALS at a service-account key with BigQuery Data Viewer + Job User roles instead of using personal ADC.


Development

./.venv/bin/pip install -e ".[dev]"
./.venv/bin/python -m pytest

The suite needs no credentials and no network — every test runs against fakes in tests/conftest.py, so it is deterministic and free. Layers:

File Covers
test_protocol.py The MCP contract through a real in-memory client session: tool set, read-only annotations, generated schemas, isError on refusal
test_query_guard.py The cost gate — what runs, what is refused, what is handed back to the user, and what the caller is told about limits
test_payload_shape.py Response shapes against fake tables, including the partitioning trap and nested-field flattening
test_observability.py The audit trail, and the promise that SQL text never reaches it
test_diagnostics.py doctor's report, including the region and allowlist failures it exists to catch early
test_environments.py Routing between environments, per-environment limits, and impersonation targeting
test_config.py The environment registry, aliases, the TOML file, and the missing-project error that used to be an import-time crash
test_errors.py Auth failures carry the command that fixes them
test_formatting.py The size and cost figures a user is asked to approve
test_eval_scoring.py The eval scorer, fed the trajectories each case exists to reject

Evals

Two further layers need live credentials, so they are not part of pytest: evals/measure.py records what a client actually receives from each tool, and evals/tool_use_evals.py asks real questions through the claude CLI and scores the trajectory from the server's own audit log — which tool ran, against which environment, with which arguments.

./.venv/bin/python evals/measure.py                     # payload sizes
./.venv/bin/python evals/tool_use_evals.py              # 6 cases, spends tokens
./.venv/bin/python evals/tool_use_evals.py --rescore    # re-score saved replies, free

See evals/README.md for what each case catches and evals/BASELINE.md for what the last run measured. Tool and server descriptions are the highest-leverage thing to change in this server, and nothing except an eval tells you they need changing.

Mutation testing

A suite that passes on its first run proves nothing, so the guarantees above were checked by breaking them: reverting refusals to error-shaped returns, logging raw SQL, guessing partitioning from column names, removing the response budget, dropping functools.wraps from the audit wrapper, letting confirmation bypass the hard cap, silencing stale-table detection, and removing the allowlist check. Each one fails the suite.

Releasing

Version numbers live in two files and CI refuses a tag where they disagree — a mismatch would ship a tag pointing at different code than the package claims. (__version__ is read from the installed distribution, so it cannot drift.)

# 1. bump both to the same value
#      pyproject.toml   project.version
#      server.json      version  AND  packages[0].version

# 2. tag and push
git tag v0.2.0 && git push origin v0.2.0

The tag triggers .github/workflows/release.yml, which verifies the versions agree, builds, publishes to PyPI via Trusted Publishing, then registers the release with the MCP registry. Neither step stores a token: PyPI uses OIDC from this repository and the pypi environment, and the registry uses GitHub OIDC. Both need one-time setup before the first release:

  • PyPI: add a trusted publisher at https://pypi.org/manage/account/publishing/ for repository deBilla/bigquery-mcp, workflow release.yml, environment pypi.
  • GitHub: create the pypi environment in repository settings.

What CI checks

.github/workflows/ci.yml runs on every push and pull request:

Job Checks
test The suite on Python 3.11, 3.12 and 3.13 — with no GCP credentials on the runner, which is the point
safety No credential-shaped strings in tracked files; .env/.mcp.json untracked; no mutating BigQuery client calls anywhere in src/
package Builds, twine checks, asserts no local config leaked into the sdist, then installs the wheel into a clean venv and drives the real protocol — 5 tools, every one annotated read-only and documented, instructions intact

The last one is the important one: it catches a package that installs cleanly and dies on its first request, which is a failure no unit test sees.

License

MIT — see LICENSE.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data_platform_mcp-0.1.0.tar.gz (62.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

data_platform_mcp-0.1.0-py3-none-any.whl (44.0 kB view details)

Uploaded Python 3

File details

Details for the file data_platform_mcp-0.1.0.tar.gz.

File metadata

  • Download URL: data_platform_mcp-0.1.0.tar.gz
  • Upload date:
  • Size: 62.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for data_platform_mcp-0.1.0.tar.gz
Algorithm Hash digest
SHA256 4f0241a5c17aac773002adc6c40b204b317bdeeffb36c510235cd5c26a218f88
MD5 0163cd24e147f080a32ef0accb8709cf
BLAKE2b-256 66864f73f0389d36f6cf205e765bada0770751227a12c4a8e5a9c2c0a92c4961

See more details on using hashes here.

Provenance

The following attestation bundles were made for data_platform_mcp-0.1.0.tar.gz:

Publisher: release.yml on deBilla/bigquery-mcp

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file data_platform_mcp-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for data_platform_mcp-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 621ec1a758bf7b528fadae4b243987d873bf2e1c75493b626410644944292fca
MD5 39b89a6d877be9f44a84c014dd8d88b5
BLAKE2b-256 11af4a95274da523fb6806c957b3aa6581ae2bdb676e2f62ccc69b5903293e10

See more details on using hashes here.

Provenance

The following attestation bundles were made for data_platform_mcp-0.1.0-py3-none-any.whl:

Publisher: release.yml on deBilla/bigquery-mcp

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.1.2

2 files

0.1.1

2 files

This release

0.1.0 This release

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page