Skip to main content

GoldenPipe

Golden Suite orchestrator -- Check quality, fix issues, deduplicate records. One command. Built by Ben Severn.

PyPI CI codecov Downloads Python 3.11+ License: MIT Docs DQBench Pipeline Open In Colab

What It Does

Raw Data
  | GoldenCheck    -- profile & discover quality issues
  | GoldenFlow     -- fix issues, standardize, reshape
  | GoldenMatch    -- deduplicate, match, create golden records
  | GoldenIdentity -- persist stable entity IDs across runs   (optional)
  | GoldenAnalysis -- terminal reporting over the run's artifacts  (optional)
  v
Golden Records + AnalysisReport

GoldenPipe orchestrates the full pipeline with adaptive logic:

  • Skips transformation if no quality issues found
  • Routes to privacy-preserving matching if sensitive fields detected
  • Reports reasoning for every decision

Install

pip install goldenpipe

Optional extras:

pip install goldenpipe[analysis]      # adds the GoldenAnalysis terminal report stage
pip install goldenpipe[golden-suite]  # full suite, incl. goldenanalysis
pip install goldenpipe[tui,api,mcp]   # interactive TUI, REST API, MCP server

Quick Start

import goldenpipe as gp

result = gp.run("customers.csv")

print(result.status)        # "success"
print(result.check)         # Quality findings
print(result.transform)     # What was fixed
print(result.match)         # Deduplicated clusters
print(result.reasoning)     # Why each decision was made

CLI

goldenpipe run customers.csv                # Full pipeline
goldenpipe run customers.csv --verbose      # Show reasoning
goldenpipe run customers.csv --skip-flow    # Check + Match only
goldenpipe run customers.csv --strategy pprl  # Force privacy mode
goldenpipe run customers.csv -o golden.csv  # Save golden records

goldenpipe interactive                       # Launch the 4-tab TUI
goldenpipe interactive customers.csv         # Load a source; press 'r' to run it
goldenpipe interactive customers.csv -c pipeline.yml  # Load source + YAML config

Remote MCP Server

GoldenPipe is available as a hosted MCP server on Smithery — connect from any MCP client without installing anything.

Claude Desktop / Claude Code:

{
  "mcpServers": {
    "goldenpipe": {
      "url": "https://goldenpipe-mcp-production.up.railway.app/mcp/"
    }
  }
}

Local server:

pip install goldenpipe[mcp]
goldenpipe mcp-serve

4 tools available: list pipeline stages, validate wiring, run full check-transform-match pipeline, explain configs.

Part of the Golden Suite

Tool Purpose Install
GoldenCheck Validate & profile data quality pip install goldencheck
GoldenFlow Transform & standardize data pip install goldenflow
GoldenMatch Deduplicate & match records pip install goldenmatch
GoldenPipe Orchestrate the full pipeline pip install goldenpipe

Author

Ben Severn

License

MIT

Release files for goldenpipe 1.5.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for goldenpipe 1.5.0
File Size Uploaded
goldenpipe-1.5.0.tar.gz 133.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for goldenpipe 1.5.0
File Interpreter ABI Platform
goldenpipe-1.5.0-py3-none-any.whl Python 3 none any Details

Total release size: 215.2 kB

Release files / goldenpipe-1.5.0.tar.gz

Download URL goldenpipe-1.5.0.tar.gz
Size 133.0 kB
Tags Source
SHA-256 checksum
How to use checksums
b01f8f1af5d62af1e37028b535999b4b1d84ca4b5f16eabfd092ef452b4cfd90
BLAKE2b-256 checksum
How to use checksums
a2124b16f4ea996d76e087f988fae2d6a83235a3b2451837a28a2ea5d32ed8e4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / goldenpipe-1.5.0-py3-none-any.whl

Download URL goldenpipe-1.5.0-py3-none-any.whl
Size 82.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
a5bb3ea2ed9d432a397fb9349362992f5969dbaea56545324a0d9ee53f9b2986
BLAKE2b-256 checksum
How to use checksums
a81dd695042286444c9bf9bfaf2f8b03c613185e2bc928af3a05f6025aecd834
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release history Release notifications | RSS feed

This release

1.5.0 This release

2 release files

1.4.0

2 release files

1.3.0

2 release files

1.2.1

2 release files

1.2.0

2 release files

1.1.0

2 release files

1.0.6

2 release files

1.0.5

2 release files

1.0.4

2 release files

1.0.2

2 release files

1.0.1

2 release files

1.0.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page