Skip to main content

A tool to convert folder structures and file contents into markdown for LLMs

Project description

folder2md4llms

Tests Python 3.11+ License: MIT

folder2md4llms is a powerful and flexible tool that converts a repository's contents into a single, LLM-friendly Markdown file. It's designed to be fast, configurable, and easy to use, with a focus on producing high-quality, structured output.

✨ Key Features

  • Smart Condensing: Automatically condenses code to fit within a specified token or character limit without crude truncation.
  • Document Conversion: Converts PDF, DOCX, XLSX, and other document formats into text.
  • Binary File Analysis: Provides intelligent descriptions for images, archives, and other binary files.
  • Highly Configurable: Use a folder2md.yaml file or command-line options to customize the output.
  • Fast and Efficient: Leverages multi-threading and efficient file processing to handle large repositories quickly.
  • Advanced Filtering: Uses .gitignore-style patterns to exclude files and directories.

🚀 Quick Start

Installation

# Using uv (recommended)
uv add folder2md4llms

# Using pip
pip install folder2md4llms

Basic Usage

# Process the current directory and save to output.md
folder2md .

# Process a specific directory and set a token limit
folder2md /path/to/repo --limit 80000t

# Copy the output to the clipboard
folder2md /path/to/repo --clipboard

# Generate a .folder2md_ignore file
folder2md --init-ignore

For a full list of commands and options, see the CLI Reference or run folder2md --help.

🔧 Configuration

You can configure folder2md4llms by creating a folder2md.yaml file in your repository's root directory. This allows you to set advanced options and define custom behavior.

For more details, see the Configuration Guide.

🛠️ Development

Interested in contributing? Get started with these simple steps:

# Clone the repository
git clone https://github.com/henriqueslab/folder2md4llms.git
cd folder2md4llms

# Set up the development environment
make setup

# See all available commands
make help

🤝 Contributing

Contributions are welcome! Please feel free to submit a Pull Request. For more information, see the Contributing Guidelines.

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

folder2md4llms-0.4.35.tar.gz (256.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

folder2md4llms-0.4.35-py3-none-any.whl (101.9 kB view details)

Uploaded Python 3

File details

Details for the file folder2md4llms-0.4.35.tar.gz.

File metadata

  • Download URL: folder2md4llms-0.4.35.tar.gz
  • Upload date:
  • Size: 256.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for folder2md4llms-0.4.35.tar.gz
Algorithm Hash digest
SHA256 a18b59884c060a7923ec1d71682d0f65e8886e9e4150cb56e3ea82581df0bcb2
MD5 292fb526ffc781e26b6e54079d42d5ca
BLAKE2b-256 081b1f44e02a32cf6d9c837c0c7aa87df741f328ba00517d52b7010b6eb00757

See more details on using hashes here.

File details

Details for the file folder2md4llms-0.4.35-py3-none-any.whl.

File metadata

  • Download URL: folder2md4llms-0.4.35-py3-none-any.whl
  • Upload date:
  • Size: 101.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for folder2md4llms-0.4.35-py3-none-any.whl
Algorithm Hash digest
SHA256 13b9a8f03c7fa3bf6c5c5d33bca23db399aff3c12a3aa7eb7e6e713a86b14c24
MD5 0415627bcd30a9b2c51da3531b383e47
BLAKE2b-256 73dad9f99183bb3bc7585b95003dc89d18297709cd81bf67615b64a419e8af80

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page