Skip to main content

DataMCP — AI Data Engineer

Connect your Postgres database. Get a production dbt project in under 10 minutes.

DataMCP is an MCP server that acts as an AI data engineer inside Claude Code, Cursor, and Codex. It connects to your Postgres database, reads and maps the schema, infers the business domain, and generates a complete, production-quality dbt project — automatically.

Full documentation: build and view locally with pip install -e '.[docs]' && mkdocs serve, then open http://127.0.0.1:8000. Covers installation, a full pipeline walkthrough with real output, every tool, AI provider setup, security, and troubleshooting.

Quickstart

pip install datamcp-ai

datamcp init
datamcp configure   # stores credentials in OS keychain, never on disk

# Open Claude Code and type:
# "Set up analytics for my project"

That's it. DataMCP calls the 10 core pipeline tools in sequence (of 30 MCP tools total — see below) and produces:

  • Staging models (one per source table, DuckDB-validated)
  • Fact and dimension mart models
  • 5–11 domain-specific KPI definitions
  • A dlt ingestion pipeline
  • A Dagster project with a daily schedule
  • 30+ data quality tests — all passing

Total time: under 10 minutes.

Installation

pip install datamcp-ai

Requires Python 3.11+. Bring your own Gemini API key (OpenAI optional). The PyPI distribution is named datamcp-ai (the plain datamcp name was already taken by an unrelated package) — the installed CLI command and Python import are still datamcp.

Configuration

datamcp configure
# Prompts for: DB host, port, database, username, password, Gemini key
# (OpenAI key optional — only needed if DATAMCP_AI_PROVIDER=openai)
# All credentials stored in OS keychain — never on disk

datamcp install --editor claude-code  # or cursor, codex

MCP Tools (30)

Core pipeline (steps 1–10 of the standard flow)

Tool Description
connect_database Establish and validate a Postgres connection
introspect_schema Read the complete Postgres schema: tables, columns, data types, PKs, FKs
infer_domain Classify the business domain from schema metadata only
generate_dbt_project Scaffold a complete dbt project with Postgres and DuckDB profiles
generate_staging_models Generate one staging model (stg_*.sql) per source table
generate_mart_models Generate fact and dimension mart models from the relationship graph
generate_kpis Generate domain-specific KPI definitions as dbt metrics
run_dbt Execute a dbt command (run, test, compile, build)
check_freshness Check when each source table last received new rows
get_pipeline_status Get an aggregated health dashboard across all pipeline components

Explore & query

Tool Description
query_knowledge_base Semantic search over the project knowledge base
explain_model Get a plain-English explanation of any dbt model
query_data Ask a natural language question about the data
execute_sql Execute a raw SELECT query against the connected database

Schema analysis & scaffolding

Tool Description
get_project_id Look up the internal project UUID for a project_name, creating it on first use
generate_er_diagram Generate a Mermaid erDiagram from the current schema snapshot
infer_model_candidates Classify tables as fact, dimension, bridge, lookup, or scd_snapshot candidates
generate_dbt_macros Generate dbt macros derived from schema column patterns
scaffold_dagster Generate a complete Dagster project with dbt asset definitions and a daily schedule
check_dlt_alignment Compare the dlt source schema against dbt staging models for drift
configure_postgres_sink Generate a Kafka Connect connector config for Postgres
scaffold_dlt Generate a complete dlt ingestion pipeline for the connected Postgres database
run_dlt Execute a generated dlt pipeline.py and persist the run result

Orchestration, BI & streaming

Tool Description
run_dagster Start, stop, check status of, or trigger a run on a generated Dagster dev server
connect_metabase Authenticate to Metabase, register the connected database, and trigger an initial sync
sync_metabase Re-sync Metabase's metadata and flag charts referencing changed dbt models
create_metabase_dashboard Create one Metabase question per project KPI and group them into a dashboard
create_metabase_chart Turn a natural-language question into a real Metabase chart
provision_kafka_topic Create a Kafka topic for streaming ingestion
check_consumer_lag Check Kafka consumer group lag per partition

Security

  • Database credentials: OS keychain only (Mac Keychain / Linux Secret Service / Windows Credential Manager)
  • AI inference: schema metadata only — table names, column names, types, FK relationships. Never actual data values, credentials, or PII.
  • Knowledge base: schema metadata and model definitions only. No row data.

See SECURITY.md and DATA_PRIVACY.md.

What gets generated

datamcp_output/
├── dbt/
│   └── my_project/
│       ├── dbt_project.yml
│       ├── profiles.yml          # Postgres target
│       ├── profiles_duckdb.yml   # DuckDB local dev target
│       └── models/
│           ├── staging/
│           │   ├── sources.yml
│           │   ├── stg_users.sql
│           │   ├── stg_orders.sql
│           │   └── ...
│           └── marts/
│               ├── fct_orders.sql
│               ├── dim_customers.sql
│               └── _metrics.yml
├── dlt/
│   ├── pipeline.py
│   └── sources/my_project.py
└── dagster_datamcp/
    ├── assets/dbt_assets.py
    ├── schedules/daily_schedule.py
    └── definitions.py

Running locally

# Run dbt against DuckDB (no Postgres needed)
cd datamcp_output/dbt/my_project
dbt run --target duckdb
dbt test --target duckdb

# Or run the full Dagster pipeline
cd datamcp_output/dagster_datamcp
dagster dev

Contributing

See CONTRIBUTING.md.

License

Apache 2.0

Metadata

Release files for datamcp-ai 0.1.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for datamcp-ai 0.1.3
File Size Uploaded
datamcp_ai-0.1.3.tar.gz 519.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for datamcp-ai 0.1.3
File Interpreter ABI Platform
datamcp_ai-0.1.3-py3-none-any.whl Python 3 none any Details

Total release size: 688.5 kB

Release files / datamcp_ai-0.1.3.tar.gz

Download URL datamcp_ai-0.1.3.tar.gz
Size 519.4 kB
Tags Source
SHA-256 checksum
How to use checksums
e071ceb8cf32ffad8de033c74503873e65030ddec8b0f8b6a3afd231578ab32d
BLAKE2b-256 checksum
How to use checksums
4ee05e739a95b05ed12650bc5cfe3e0d157291ad6378bfb5db83b8d9c4a089af
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.11.11 {"installer":{"name":"uv","version":"0.11.11","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release files / datamcp_ai-0.1.3-py3-none-any.whl

Download URL datamcp_ai-0.1.3-py3-none-any.whl
Size 169.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
353d2e7cfd3e8d39e813b3e944dfd0a891d5b8c4280fcdf1de781f2e8ff2836f
BLAKE2b-256 checksum
How to use checksums
0ad78d39b8228f433a9905f7285296f2ecc0858cb2660ef576eee0d87dcbdb50
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.11.11 {"installer":{"name":"uv","version":"0.11.11","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release history Release notifications | RSS feed

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

This release

0.1.3 This release

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page