Skip to main content

Open-Source Static Analysis for Privacy Data Flows

Project description

truScanner

Open-Source Static Analysis for Privacy Data Flows

truScanner is a static code analysis tool designed to discover and analyze personal data elements in your source code. It helps developers and security teams identify privacy-related data flows and generate comprehensive reports.

๐Ÿš€ Features

  • Comprehensive Detection: Identifies 300+ personal data elements (PII, financial data, device identifiers, etc.)
  • Interactive Menu: Arrow-key navigable menu for selecting output formats
  • Real-time Progress: Visual progress indicator during scanning
  • Multiple Report Formats: Generate reports in TXT, Markdown, or JSON format
  • AI-Powered Enhancement: Optional integration with Ollama or OpenAI for deeper context
  • Backend Integration: Optional upload to backend API for centralized storage
  • Auto-incrementing Reports: Automatically manages report file naming to prevent overwrites

๐Ÿ“ฆ Installation

Prerequisites

  • Python 3.9 or higher
  • ollama (optional, for local AI scanning)

Quick Install

Using pip:

pip install truscanner

Using uv:

uv pip install truscanner

Verify installation:

truscanner --help

๐Ÿ› ๏ธ Usage

Basic Usage

Scan a directory with the interactive menu:

truscanner scan <directory_path>

Example

truscanner scan ./src
truscanner scan ./my-project
truscanner scan C:\Users\username\projects\my-app

Interactive Workflow

  1. Select Output Format:

    • Use arrow keys (โ†‘โ†“) to navigate
    • Press Enter to select
    • Options: txt, md, json, or All (generates all three formats)
  2. Scanning Progress:

    • Real-time progress bar shows file count and percentage
    • Example: Scanning: 50/200 (25%) [โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘] filename.js
  3. AI Enhanced Scan (Optional):

    • After the initial scan, you'll be prompted: Do you want to use Ollama/AI for enhanced PII detection (find what regex missed)? (Y, N):
    • This uses local LLMs (via Ollama) or OpenAI to find complex PII.
    • Live scanning timer: AI Scanning: filename.js... (5.2s taken)
  4. Report Generation:

    • Reports are saved in reports/{directory_name}/ folder
    • Files are named: truscan_report.txt, truscan_report.md, truscan_report.json
    • Subsequent scans auto-increment: truscan_report1.txt, truscan_report2.txt, etc.
    • AI findings are saved with _llm suffix.
  5. Backend Upload (Optional):

    • After reports are saved, you'll be prompted: Do you want to upload the scan report for the above purpose? (Y, N):
    • Enter Y to upload scan results to backend API

Command Options

truscanner scan <directory> [OPTIONS]

Options:
  --with-ai          Enable AI/LLM scanner directly
  --personal-only    Only report personal identifiable information (PII)
  --help             Show help message

๐Ÿ“Š Report Output

Report Location

Reports are saved in: reports/{sanitized_directory_name}/

Report Formats

  • TXT Report (truscan_report.txt): Plain text format, easy to read
  • Markdown Report (truscan_report.md): Formatted markdown with headers and code blocks
  • JSON Report (truscan_report.json): Structured JSON data for programmatic access

Report Contents

Each report includes:

  • Scan Report ID: Unique 32-bit hash identifier
  • Summary: Total findings, time taken, files scanned
  • Findings by File: Detailed list of data elements found in each file
  • Summary by Category: Aggregated statistics by data category

Report ID

Each scan generates a unique Scan Report ID (32-bit MD5 hash) that:

  • Appears in the terminal after scanning
  • Is included at the top of all generated report files
  • Can be used to track and reference specific scans

๐Ÿ”ง Configuration

The truscanner package is pre-configured with the live backend URL for seamless scan uploads. No additional configuration is required.

๐Ÿ“ Project Structure

truscanner/
โ”œโ”€โ”€ src/
โ”‚   โ”œโ”€โ”€ main.py              # CLI entry point
โ”‚   โ”œโ”€โ”€ regex_scanner.py     # Core scanning engine
โ”‚   โ”œโ”€โ”€ ai_scanner.py        # AI/LLM scanning engine
โ”‚   โ”œโ”€โ”€ report_utils.py      # Report utilities
โ”‚   โ””โ”€โ”€ utils.py             # Utilities
โ”œโ”€โ”€ data_elements/           # Data element definitions
โ”œโ”€โ”€ reports/                 # Generated reports
โ”œโ”€โ”€ pyproject.toml           # Project configuration
โ””โ”€โ”€ README.md

๐Ÿค Support

For issues, questions, or contributions, please contact: hello@truconsent.io

MIT License - see LICENSE file for details

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

truscanner-0.2.4.tar.gz (33.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

truscanner-0.2.4-py3-none-any.whl (45.8 kB view details)

Uploaded Python 3

File details

Details for the file truscanner-0.2.4.tar.gz.

File metadata

  • Download URL: truscanner-0.2.4.tar.gz
  • Upload date:
  • Size: 33.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.6

File hashes

Hashes for truscanner-0.2.4.tar.gz
Algorithm Hash digest
SHA256 02486a9afc3806fab12cb9370d7862155147d6a6332638cecb358968104b65e5
MD5 137c89bc331eef06f2bdbd29509c6b78
BLAKE2b-256 1c50fda09f81f30007a57329f56cfaa0a5383dfda52b1b669630f5eaba38a0f8

See more details on using hashes here.

File details

Details for the file truscanner-0.2.4-py3-none-any.whl.

File metadata

  • Download URL: truscanner-0.2.4-py3-none-any.whl
  • Upload date:
  • Size: 45.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.6

File hashes

Hashes for truscanner-0.2.4-py3-none-any.whl
Algorithm Hash digest
SHA256 4e3720dced3ca959a0e471b96cf579ba6519df2f371be7ccd3c91af31428da3e
MD5 4dc42d0ca5af4a87e55dcdd25eb58557
BLAKE2b-256 1911b8489a224a129a670a1ae8e01893f80887792b57aa4d04a7d124f5b2993f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page