project-prompt-generator 0.1.7

A tool to convert project files into structured markdown for LLM prompts

✨ project-prompt-generator (ppg) 📝

A command-line tool to convert your project's files into structured markdown documents, ideal for generating prompts for large language models (LLMs) 🤖.

Features 🌟

• Flexible Output Options: 🔀 Generate individual markdown files, a single consolidated file, or JSON output.
• Automatic Markdown Conversion: 🔄 Converts all project files (excluding those in .gitignore) into individual markdown files.
• Structured Output: 📂 Option to create an all-in-one file that includes an outline and the content of all converted files for easy use with LLMs.
• Code Highlighting: 🌈 Automatically detects file extensions and applies proper markdown code highlighting.
• Customizable Ignored Files: 🛡️ Respects .gitignore and supports additional custom ignore patterns.
• Organized Output: 📋 Generates an outline file that clearly lists all converted files.
• Sensitive Data Masking: 🔒 Automatically detects and masks API keys, passwords, and other sensitive information (enabled by default).
• Event-Based Architecture: 📡 Uses an event system to process files and handle output generation.
• JSON Output Formats: 📊 Supports both compact and line-split JSON formats for different use cases.
• Clipboard Integration: 📎 Option to automatically copy output file paths to clipboard (macOS).
• last-run Tool: 🏃 Quickly run recently modified scripts in your Downloads directory.

Installation 🛠️

# Install via pipx
pipx install project-prompt-generator

# Install from source
pip install .

# Or install in development mode
pip install -e ".[dev]"

Usage 🚀

⚠️ Important Notes

• Markdown Output Deprecation: The --markdown output format is deprecated and will be removed in a future version. Please use JSON output format instead.
• Sensitive Data Masking: While the tool attempts to mask sensitive information, it may not catch all instances. Always review generated files before sharing or uploading them to ensure no sensitive data is exposed.

Navigate to your project's root directory and use the following command:

# Generate JSON output with content split into lines (default)
ppg

# Generate markdown output (compact format) [DEPRECATED]
ppg --markdown

# Force execution outside of a git repository
ppg --force

# Update .envrc with output paths and exit
ppg --update-env

This creates either:

• A JSON file project_data.json in the current directory containing:
  • An outline of all processed files.
  • The content of all files converted to markdown format.

Or, when using --markdown:

• A single file project_docs.md in the current directory containing:
  • An outline listing all processed files.
  • The content of all files converted to markdown format.

Or, when using --json or --json-lines:

• A JSON file (default: project_data.json) containing:
  • An outline of all processed files
  • File contents in either:
    • Compact format (with --json): Content as single strings
    • Line-split format (with --json-lines): Content split into arrays of lines

Security Options

The tool automatically masks sensitive data by default. You can control this behavior with:

# Disable sensitive data masking
ppg --no-mask

Default patterns detect common sensitive information like:

• API keys and tokens
• Passwords
• Database connection strings
• AWS access keys
• Generic secrets
• PowerShell secure strings

Environment Variable Configuration 🔧

You can customize the output locations using the --update-env option, which will automatically update your .envrc file with the appropriate environment variables:

# Update .envrc with default output paths
ppg --update-env

This will add the following environment variables to your .envrc file:

• PPG_OUTPUT_FILE: File for consolidated markdown output
• PPG_JSON_OUTPUT_FILE: File for JSON output
• PPG_ENABLE_CLIPBOARD: Enable/disable clipboard functionality (default: "false")

The paths will be automatically configured to use your Downloads directory with the current project name. You can then modify these paths in the .envrc file if needed.

Note: Make sure you have direnv installed and configured to use the .envrc file.

Project Structure 📁

project-prompt-generator/
├── cli/
│   ├── __init__.py            # Package exports
│   ├── last_run.py            # Last-run tool implementation
│   └── ppg.py                 # Command-line interface
├── outputs/
│   ├── __init__.py            # Package exports
│   ├── events.py              # Event classes for file processing
│   ├── json_handler.py        # JSON output handler
│   ├── osx_clipboard.py       # macOS clipboard functionality
│   ├── output_handler.py      # Base output handler class
│   └── single_file_handler.py # Consolidated file output handler
├── prompts/
│   ├── __init__.py            # Package exports
│   ├── file_processor.py      # File processing utilities
│   ├── generator.py           # Core generation functionality
│   ├── options.py             # Configuration options
│   └── sensitive_masker.py    # Sensitive data masking
├── utils/
│   ├── __init__.py            # Package exports
│   ├── envrc.py               # .envrc configuration
│   ├── file_walker.py         # Directory traversal and file filtering
│   ├── ignore_handler.py      # Handles .gitignore and custom ignores
│   └── language_mapping.py    # Maps file extensions to language hints
├── tests/
│   └── test_sensitive_masker.py  # Tests for sensitive data masking
├── setup.py                   # Package configuration
└── README.md                  # Documentation

How it Works ⚙️

1. The tool scans your project directory, respecting .gitignore and any custom ignore patterns. 🔍
2. Each file is converted into a markdown format with a header showing the filename and path, followed by its content enclosed in a code block with appropriate language highlighting. 📝
3. An event-based system handles file processing and output generation, making the code extensible. 🔄
4. Sensitive data is automatically detected and masked with asterisks (*) to protect your credentials. 🔒
5. Depending on the command used, the tool generates either individual markdown files, a single consolidated file, or JSON output. 🧩

last-run Tool

The last-run tool helps you quickly find and run recently modified scripts in your Downloads directory:

• Lists the 3 most recent .sh and .py scripts
• Shows how long ago each script was modified
• Lets you execute scripts with a simple keypress
• On macOS, allows creating and running scripts directly from clipboard content

Just run last-run from your terminal to use this feature.

License 📄

This project is licensed under the MIT License. 🎉