CLI tool to convert Context7 llms.txt format to locally organized markdown documentation
Project description
Context7 to Markdown (c2md)
A blazing fast CLI tool that converts Context7 formatted llms.txt files to organized markdown documentation with automatic directory structure, multi-language support, and table of contents generation. Supports both local files and direct URLs from Context7.com.
Only caveat is Context7 does not have an open API at the moment, so you must download the raw llms.txt and you MUST add or specify the tokens query to be >= the total number of tokens.
For example, context7.com/context7/neon/llms.txt?tokens=519821.
Install with pip
pip install c2md
Install with uv
uv pip install c2md
uvx c2md
✨ Features
- ⚓ Convert Context7 to Markdown: Transform Context7 format files into clean, organized markdown documentation
- 🧠 Smart Organization: Automatically organizes files into logical directory structures based on source URLs.
- 🗨️ Multi-Language Support: Consolidates multi-language sections into a single document.
- 📜 Table of Contents: Generates comprehensive index files to provide context to your agent.
- 🗺️ URL Mapping: Intelligently maps source URLs to appropriate file paths and names
- ❌ Error Handling: Robust error handling with detailed feedback for troubleshooting
🤔 Why c2md?
MCP is clunky, slow, adds additional prompt context, and time consuming.
With c2md, you can pass a specific section of a technology's documentation to an agent. Instead of fairly unreliable natural language search with the Context7 MCP server, you can just attach the @/path/to/000-index.md to your agent.
Depending on the number of locally available documentation sections/files, this can save tokens/context. For example, the Neon docs have around 240 sections (520,000 tokens), with the total 000-index.md costing around 4,000 tokens; alternatively, calls to the Context7 MCP can cost anywhere from 8,000 to 20,000 tokens.
🚀 Installation
Using pip
pip install c2md
Using uv
uv pip install c2md
or
uvx c2md
Development Installation
# Clone the repository
git clone https://github.com/crisp-sh/context7-to-markdown.git
cd context7-to-markdown
# Install in development mode
pip install -e .
📋 Requirements
- Python 3.8 or higher
- No external dependencies required
🛠️ Usage
After installation, use the c2md command:
Basic Usage
# From local file - output defaults to ./output/
c2md /path/to/llms.txt
# From Context7 URL (must include tokens parameter)
c2md https://context7.com/context7/neon/llms.txt?tokens=519821
Advanced Usage
# Specify output directory, 001-index.md (ToC) generated in output root
c2md /path/to/llms.txt -d /path/to/output
# From Context7 URL with output directory
c2md https://context7.com/context7/neon/llms.txt?tokens=519821 -d .docs/neon
# Disable ToC generation
c2md /path/to/llms.txt --no-tree
# Full example with all options, no ToC/tree
c2md https://context7.com/context7/supabase/llms.txt?tokens=1000000 -d /path/to/output --no-tree
Command Line Options
input_file: Path to the Context7 format input file or Context7 URL (required)-d, --directory: Output directory (default: current directory)-T, --tree: Generate table of contents index (default: enabled)--no-tree: Disable table of contents generation-h, --help: Show help message and exit
📁 Output Structure
The tool creates an organized directory structure:
output/
├── 001-index.md # Table of contents (if enabled)
├── domain1.com/
│ ├── section1/
│ │ ├── 001-page1.md
│ │ └── 002-page2.md
│ └── section2/
│ └── 001-page3.md
└── domain2.com/
└── docs/
└── 001-guide.md
🎯 Context7 Format
The tool processes Context7 format files, which should contain entries with:
- SOURCE: URL or source identifier
- CONTENT: The actual content to be converted
- TITLE: Optional title for the content
- LANGUAGE: Denotes a multi-language document
🏗️ Architecture
The tool consists of several modular components:
- Parser: Processes Context7 format files
- URL Mapper: Maps source URLs to file paths
- File Organizer: Organizes content into directory structures
- Markdown Writer: Generates clean markdown files
- Index Generator: Creates table of contents
🧪 Testing
Run the test suite using Hatch:
# Run tests
hatch run test
# Run tests with coverage
hatch run test-cov
# Run specific test file
hatch run test tests/test_specific.py
Legacy Testing
# Install development dependencies
pip install -e ".[dev]"
# Run tests
python -m unittest discover tests
# Run tests with coverage
python -m unittest discover tests
🔄 Releasing
This project uses automated versioned releases with Hatch for version management.
Quick Release
# Create a patch release (0.1.0 → 0.1.1)
hatch run release patch
# Create a minor release (0.1.0 → 0.2.0)
hatch run release minor
# Create a major release (0.1.0 → 1.0.0)
hatch run release major
🤝 Contributing
Contributions are welcome! Please feel free to submit a PR if you would like to contribute or have an issue.
Development Setup
# Clone the repository
git clone https://github.com/crisp-sh/context7-to-markdown.git
cd context7-to-markdown
# Create a virtual environment
python -m venv venv
source venv/bin/activate # On Windows: venv\Scripts\activate
# Install
pip install -e .
Running Tests
# Run all tests with Hatch
hatch run test
# Run specific test file
hatch run test tests/test_specific.py
# Run tests with coverage
hatch run test-cov
🐛 Bug Reports
If you encounter any issues, please report them on the GitHub Issues page.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file c2md-1.0.0.tar.gz.
File metadata
- Download URL: c2md-1.0.0.tar.gz
- Upload date:
- Size: 20.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
45d70be8e46ec9772cf4f8e08d2a025c35fd0c24b295c7ef3eb3436e86edce72
|
|
| MD5 |
356addeb2f25632c00e1ec1d7f21cc73
|
|
| BLAKE2b-256 |
ec8d39795d2d0d1f8daa8de5d42ddcc0cbb8a17c3812de71f8c48f3d3a4fe4ee
|
Provenance
The following attestation bundles were made for c2md-1.0.0.tar.gz:
Publisher:
release.yml on crisp-sh/context7-to-markdown
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
c2md-1.0.0.tar.gz -
Subject digest:
45d70be8e46ec9772cf4f8e08d2a025c35fd0c24b295c7ef3eb3436e86edce72 - Sigstore transparency entry: 271763315
- Sigstore integration time:
-
Permalink:
crisp-sh/context7-to-markdown@ff33a2120bf2d3b483397c5df85b54e2766827b6 -
Branch / Tag:
refs/tags/v1.0.0 - Owner: https://github.com/crisp-sh
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@ff33a2120bf2d3b483397c5df85b54e2766827b6 -
Trigger Event:
push
-
Statement type:
File details
Details for the file c2md-1.0.0-py3-none-any.whl.
File metadata
- Download URL: c2md-1.0.0-py3-none-any.whl
- Upload date:
- Size: 24.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8098dd2c8f5cbc92259c6d595a97ef7f9bd373235cbab84f66e7dc3ab84b27a4
|
|
| MD5 |
40d62e082378ae635f00f4bd7219c3a2
|
|
| BLAKE2b-256 |
d253a9579da94763d6090fbb1b5c713c7914f3519b0796bb2b9862d8a812bf05
|
Provenance
The following attestation bundles were made for c2md-1.0.0-py3-none-any.whl:
Publisher:
release.yml on crisp-sh/context7-to-markdown
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
c2md-1.0.0-py3-none-any.whl -
Subject digest:
8098dd2c8f5cbc92259c6d595a97ef7f9bd373235cbab84f66e7dc3ab84b27a4 - Sigstore transparency entry: 271763317
- Sigstore integration time:
-
Permalink:
crisp-sh/context7-to-markdown@ff33a2120bf2d3b483397c5df85b54e2766827b6 -
Branch / Tag:
refs/tags/v1.0.0 - Owner: https://github.com/crisp-sh
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@ff33a2120bf2d3b483397c5df85b54e2766827b6 -
Trigger Event:
push
-
Statement type: