Mass PII / Secret Finder — v2

A recon tool that automates the classic bug-bounty JS-mining workflow:

target URL (+ explicit authorization confirmation, + scope)
   │
   ▼
discover every reachable, in-scope JS file — real multi-hop HTML crawl,
script tags, dynamic import()/chunk manifests, sourcemaps, conventional
paths, optional passive subdomain discovery via public CT logs
   │
   ▼
mine each file for API keys, tokens, credentials, internal endpoints,
and PII-shaped strings — ~90 named patterns + a freeform high-entropy
heuristic that catches secrets no named pattern covers
   │
   ▼
validate findings — structural/offline checks (Luhn, key-shape, JWT
decode), scope-checked + rate-limited reachability probing — and triage
by a weighted severity model
   │
   ▼
report: live console (GUI), plus JSON / HTML / SARIF / Markdown / CSV
export, with diff-against-previous-scan support

⚠️ Authorized use only

Run this only against systems you own or are explicitly authorized to test (a bug bounty program in scope, a client engagement, your own app). Scope enforcement is no longer just a README sentence:

• Explicit authorization is required — the "I own this target or am explicitly authorized to test it" checkbox in the GUI must be checked before a scan will run.
• Every request the crawler/validator makes is checked against a ScopeGuard: the primary target's domain plus any extra in-scope rules you add (exact host, sub.example.com, or *.example.com wildcard). Anything outside that scope is recorded as excluded, never fetched.
• robots.txt is honored during the HTML-crawl phase by default.
• All target-facing requests are rate-limited (default 8 req/s, tunable in the GUI) so scans stay polite.

It does:

• Read-only HTTP requests to the target (fetching pages/JS it already serves)
• Read-only reachability checks on endpoints discovered on that same, in-scope target
• Passive, public-record subdomain discovery (CT logs via crt.sh) — no active subdomain brute force or port scanning

It deliberately does not:

• Attempt to authenticate to third-party providers (AWS, Stripe, Slack, GitHub, etc.) using discovered keys. Testing a leaked key against its provider is a separate action outside the target's own infrastructure and needs its own authorization. The tool flags these for manual, in-scope verification instead and tells you the standard safe way to confirm impact.
• Brute-force, fuzz, or guess authentication credentials.
• Exploit any discovered vulnerability.
• Touch anything outside the declared scan scope.

Setup

Install it as a package — this puts a mass-pii-finder command on your PATH:

pip install .
# isolated (recommended):        pipx install .
# straight from GitHub:          pipx install git+https://github.com/kanishk-dadhich/MassPIIFinder

Or just install the dependencies and run it from the cloned repo:

pip install -r requirements.txt

Support / Donate

If this tool helped you during testing, you can support the project here: https://razorpay.me/@kanishkdadhich

Usage

mass-pii-finder      # if installed as a package
# or, from the cloned repo:
python app.py

Open http://127.0.0.1:7331. Enter a target URL, confirm authorization, optionally add extra in-scope domains and tune scan options, click Run scan. You get a live pipeline log, a severity-sorted findings table, a click-through detail drawer per finding (with decoded JWTs, probe results, full clickable source URLs, and validation notes), scan history (SQLite-backed), a Compare tab for scan-to-scan diffing, and one-click JSON / HTML / SARIF / Markdown / CSV export.

What it detects

~90 named patterns across these categories (up from ~20 in v1), plus a freeform high-entropy heuristic for un-named/custom secret schemes:

Every finding gets a multi-signal confidence score (base pattern confidence + entropy + offline structural validation — Luhn checksum, AWS key-ID shape, JWT segment shape — + noise-hint suppression), a severity rating (CRITICAL/HIGH/MEDIUM/LOW), and (for endpoints) a scope-checked, rate-limited live reachability probe.

Project layout

mass_pii_finder/           the installable package
  app.py         Flask GUI backend (+ SQLite scan history, diff endpoint)
  core/
    scope.py     authorization-scope enforcement (ScopeGuard)
    crawler.py   JS discovery: real multi-hop crawl, dynamic imports, chunk
                 manifests, sourcemaps, passive subdomain discovery, robots.txt,
                 rate limiting
    patterns.py  ~90-pattern regex library + offline structural checks + noise-hint list
    extractor.py pattern matching, entropy scoring, freeform heuristic scanner, dedupe
    validator.py structural validation, JWT decode, scope-checked safe endpoint
                 probing, weighted severity, scan-to-scan diffing
    report.py    JSON / HTML (searchable) / SARIF / Markdown / CSV report builders
  templates/     GUI HTML
  static/        GUI CSS/JS
app.py           shim so `python app.py` still works from the repo
pyproject.toml   packaging (installs the `mass-pii-finder` command)

Extending it

• Add patterns: edit core/patterns.py — each entry is (regex, category, base_confidence).
• Add an offline structural check: add a function to STRUCTURAL_CHECKS in core/patterns.py.
• Add new endpoint shapes: ENDPOINT_PATTERNS in the same file.
• Add a new report format: add a builder function to REPORT_BUILDERS in core/report.py.
• Export SARIF from the GUI to drop findings straight into GitHub code scanning or most CI security dashboards; use the Compare tab to diff a scan against a previous one and focus on genuinely new findings.