Skip to main content

GoldenPipe

Golden Suite orchestrator -- Check quality, fix issues, deduplicate records. One command. Built by Ben Severn.

PyPI CI codecov Downloads Python 3.11+ License: MIT Docs DQBench Pipeline Open In Colab

What It Does

Raw Data
  | GoldenCheck    -- profile & discover quality issues
  | GoldenFlow     -- fix issues, standardize, reshape
  | GoldenMatch    -- deduplicate, match, create golden records
  | GoldenIdentity -- persist stable entity IDs across runs   (optional)
  | GoldenAnalysis -- terminal reporting over the run's artifacts  (optional)
  v
Golden Records + AnalysisReport

GoldenPipe orchestrates the full pipeline with adaptive logic:

  • Skips transformation if no quality issues found
  • Routes to privacy-preserving matching if sensitive fields detected
  • Reports reasoning for every decision

Install

pip install goldenpipe

Optional extras:

pip install goldenpipe[analysis]      # adds the GoldenAnalysis terminal report stage
pip install goldenpipe[golden-suite]  # full suite, incl. goldenanalysis
pip install goldenpipe[tui,api,mcp]   # interactive TUI, REST API, MCP server

Quick Start

import goldenpipe as gp

result = gp.run("customers.csv")

print(result.status)        # "success"
print(result.check)         # Quality findings
print(result.transform)     # What was fixed
print(result.match)         # Deduplicated clusters
print(result.reasoning)     # Why each decision was made

CLI

goldenpipe run customers.csv                # Full pipeline
goldenpipe run customers.csv --verbose      # Show reasoning
goldenpipe run customers.csv --skip-flow    # Check + Match only
goldenpipe run customers.csv --strategy pprl  # Force privacy mode
goldenpipe run customers.csv -o golden.csv  # Save golden records

goldenpipe interactive                       # Launch the 4-tab TUI
goldenpipe interactive customers.csv         # Load a source; press 'r' to run it
goldenpipe interactive customers.csv -c pipeline.yml  # Load source + YAML config

Remote MCP Server

GoldenPipe is available as a hosted MCP server on Smithery — connect from any MCP client without installing anything.

Claude Desktop / Claude Code:

{
  "mcpServers": {
    "goldenpipe": {
      "url": "https://goldenpipe-mcp-production.up.railway.app/mcp/"
    }
  }
}

Local server:

pip install goldenpipe[mcp]
goldenpipe mcp-serve

4 tools available: list pipeline stages, validate wiring, run full check-transform-match pipeline, explain configs.

Part of the Golden Suite

Tool Purpose Install
GoldenCheck Validate & profile data quality pip install goldencheck
GoldenFlow Transform & standardize data pip install goldenflow
GoldenMatch Deduplicate & match records pip install goldenmatch
GoldenPipe Orchestrate the full pipeline pip install goldenpipe

Author

Ben Severn

License

MIT

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

goldenpipe-1.4.0.tar.gz (128.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

goldenpipe-1.4.0-py3-none-any.whl (77.8 kB view details)

Uploaded Python 3

File details

Details for the file goldenpipe-1.4.0.tar.gz.

File metadata

  • Download URL: goldenpipe-1.4.0.tar.gz
  • Upload date:
  • Size: 128.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for goldenpipe-1.4.0.tar.gz
Algorithm Hash digest
SHA256 7e0207000f0a1f8841f4c4ab9b6694005b67191dad9b17a2cb4b90a3f86c3af1
MD5 95592ea0a2b6c4e7de8b8dd6580bc500
BLAKE2b-256 81c6db037a5dd29f96b73306aeb65e5fe6ebc1bc3af25969cebaa79a41866cd7

See more details on using hashes here.

File details

Details for the file goldenpipe-1.4.0-py3-none-any.whl.

File metadata

  • Download URL: goldenpipe-1.4.0-py3-none-any.whl
  • Upload date:
  • Size: 77.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for goldenpipe-1.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ee48d4259a778e37652543ee4d3d647fddebe27ff7247bc5498faa71f452244b
MD5 b1029a8cd9fac09619cef623fc4625b6
BLAKE2b-256 9694ef76b0aa391ac01f19f318c202505a517117b787114abe950674173c1c11

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page