llm-markdownify

Turn PDFs, scans and images into clean Markdown with the vision model you already pay for. Built for RAG pipelines and AI agents.

pip install llm-markdownify
markdownify report.pdf -o report.md --model gpt-5.4-mini

Each page goes to a vision LLM with a prompt we measure on a public benchmark, so the Markdown comes back the way a retriever or an agent wants it:

• the text exactly as printed, in reading order, including multi-column layouts
• no running headers, footers or page numbers polluting your chunks
• math as LaTeX ($...$, $$...$$)
• tables as Markdown, or as HTML when they have merged cells, and stitched back together when they break across pages
• charts as a description plus the data values, diagrams as Mermaid
• old scans and handwriting transcribed, not summarized

It works with any provider: OpenAI, Anthropic, Gemini, DeepSeek, Azure, OpenRouter, or a model running on your own machine through Ollama, LM Studio or vLLM.

How good is it?

We measure every change on olmOCR-Bench, the benchmark most PDF-to-Markdown tools publish. It checks 1,403 real pages with about 7,000 pass/fail tests: is this sentence present, is the page footer gone, is paragraph A before paragraph B, is this table cell next to that one, does this equation render the same.

llm-markdownify 0.5 with gpt-6-luna scores 81.6 ± 1.0 on the full benchmark.

By category: tables 89.1, headers/footers 86.6, old scans with math 82.5, multi-column 81.4, arXiv math 79.4, tiny text 88.7, old scans 45.1. Old, faded scans are the weak spot.

What the library adds on top of the model, measured on a fixed 105-page stratified subset:

The biggest single difference is headers and footers. With the bare prompt, 24% of the checks that running headers, footers and page numbers are gone pass (88% with llm-markdownify). Left in, that furniture ends up in every RAG chunk. Other projects' numbers are what they published; ours come from running the benchmark's own scorer on our output.

Reproduce it yourself with evals/olmocr_bench. The harness scores the Markdown this library writes, through the same convert() call you would use.

Quickstart

export OPENAI_API_KEY="sk-..."

markdownify input.pdf -o output.md --model gpt-5.4-mini   # PDF
markdownify scan.png -o scan.md --model gpt-5.4-mini      # PNG, JPG, WEBP, TIFF (multi-page), BMP, GIF

From Python:

from llm_markdownify import convert

convert("input.pdf", "output.md", model="gpt-5.4-mini")

Use any provider

The model name decides where the request goes (via LiteLLM, 100+ providers). Set that provider's key and pick a vision-capable model.

Anything that speaks the OpenAI API works too, including local servers with no key at all:

# Ollama, LM Studio, vLLM, llama.cpp, or a hosted OpenAI-compatible provider
markdownify input.pdf -o output.md --model openai/<model-name> --api-base http://localhost:11434/v1

Built for production

• Safe to call from threads. Use convert() from a web server or a worker pool. (Retry, cache and rate-limit settings are currently process-wide, so give concurrent calls the same settings.)
• Rate limits are waited out, real errors fail fast. Rate limits, timeouts and 5xx responses are retried with backoff. A bad key or a bad request fails on the first attempt with one clear line, and never prints your API key.
• Oversized pages are handled. Page images are capped at 2048 px, below provider limits, so big scans don't get rejected.
• Re-runs are free with --cache: responses are cached on disk and keyed on the exact request.
• Throughput and cost controls: --concurrency, --rate-limit, --max-image-px, --reasoning-effort.

Options

Custom prompts: copy a built-in profile from prompt_profiles.py into a JSON file with the fields name, continuation_system, continuation_user, markdown_system and markdown_user, then pass --profile my_profile.json.

DOCX input goes through Microsoft Word (macOS/Windows): pip install "llm-markdownify[docx]" and pass --allow-docx. Exporting to PDF yourself is more reliable.

Examples

The gallery has about 80 inputs with their Markdown output: receipts, charts, handwriting, formulas, forms, screenshots, scene text.

Roadmap

Next up: an in-memory API that returns per-page results, stdout output and page ranges for agents, an MCP server, a hybrid mode that uses the PDF's own text layer to cut cost, and presets for small local models. Details and current numbers are in docs/ROADMAP.md.

Markdownify Cloud

To run Markdownify in production on your own infrastructure, with your own LLMs, or tuned for your documents, see markdownify.xyz. The cloud version adds features beyond the open-source library and comes with hands-on integration support.

Contributing

uv sync --all-extras --dev
uv run pytest
uv run ruff check src tests

See CONTRIBUTING.md. Maintainers and coding agents: start with AGENTS.md.

License

Apache 2.0. If you distribute this project, keep the LICENSE and NOTICE files intact, crediting the original author, Sethu Pavan Venkata Reddy Pastula.