Skip to main content

Flatten and clean LaTeX, PDF, and PPTX files for LLM consumption

Project description

LaTeX LLM Cleaner

A Python CLI tool that takes a LaTeX .tex file, compiled .pdf, or PowerPoint .pptx and produces a cleaned text version optimized for LLM consumption. Combines functionality from tools like flachtex, arxiv_latex_cleaner, and pandoc into a single utility.

Installation

pip install latex-llm-cleaner

This includes support for .tex, .pdf, and .pptx files out of the box.

For OCR-based equation recovery from PDFs (requires Python ≤ 3.13):

pip install 'latex-llm-cleaner[ocr]'

Global install

# Recommended — handles extras natively:
uv tool install latex-llm-cleaner
uv tool install 'latex-llm-cleaner[ocr]'

# Alternative (pipx):
pipx install latex-llm-cleaner
# For OCR with pipx, inject the heavy dependencies:
pipx inject latex-llm-cleaner surya-ocr 'transformers<5'

Note: OCR requires libjpeg headers. On macOS: brew install jpeg

From source

pip install -e ".[dev]"

Usage

latex-llm-cleaner paper.tex                    # output to stdout
latex-llm-cleaner paper.tex -o cleaned.tex     # output to file
latex-llm-cleaner paper.tex --no-bibliography  # skip bib inlining
latex-llm-cleaner paper.tex --no-macros        # skip macro expansion
latex-llm-cleaner thesis.pdf -o thesis.md      # extract text from PDF
latex-llm-cleaner thesis.pdf --ocr -o thesis.md  # OCR with LaTeX equation recovery
latex-llm-cleaner slides.pptx -o slides.md       # extract slides from PPTX
latex-llm-cleaner slides.pptx --notes -o slides.md  # include speaker notes

All features are on by default. Disable individual steps with --no-* flags:

latex-llm-cleaner INPUT_FILE [options]

Options:
  -o, --output FILE          Write to FILE (default: stdout)
  --no-flatten               Disable \input/\include flattening
  --no-comments              Disable comment removal
  --no-macros                Disable macro expansion
  --keep-usepackage          Keep \usepackage lines (dropped by default)
  --no-bibliography          Disable bibliography inlining
  --no-figures               Disable figure summary substitution
  --figure-summary-suffix S  Suffix for summary files (default: _summary.txt)
  --notes                    Include speaker notes (PPTX only)
  --ocr                      Use Surya vision OCR (recovers LaTeX equations, slower)
  --encoding ENC             File encoding (default: utf-8)
  -v, --verbose              Print processing info to stderr

PDF Input

For compiled PDFs (e.g., theses, published papers), latex-llm-cleaner extracts the text as markdown, preserving table structure and dropping images. Tables are output as markdown tables with | delimiters. Images are noted as [picture omitted] placeholders. The .tex pipeline flags (--no-flatten, etc.) are ignored for PDF input since they don't apply.

OCR mode (equation recovery)

The default PDF extraction is fast but loses display equations. For compiled LaTeX PDFs, the --ocr flag uses Surya vision-based OCR to recover equations as LaTeX source:

pip install 'latex-llm-cleaner[ocr]'
latex-llm-cleaner thesis.pdf --ocr -o thesis.md

This reconstructs inline math as $...$ and display equations as $$...$$ with full LaTeX notation. It's slower (~30s/page on Apple Silicon) but dramatically more accurate for math-heavy documents. Requires Python ≤ 3.13.

PPTX Input

Each slide becomes a markdown section with a heading (# Slide N: Title), separated by ---. Tables are output as markdown pipe-tables. Images are shown as [Image] placeholders unless a summary file is provided (see below).

Speaker notes are excluded by default. Use --notes to include them:

latex-llm-cleaner slides.pptx --notes -o slides.md

Equations stored as Office MathML (OMML) in the presentation are passed through as XML, which LLMs can read directly.

Image summaries for PPTX

Since images are embedded in PPTX files (no file paths), summaries use a slide/image numbering convention. Place summary files in the same directory as the .pptx:

slides.pptx
slide1_image1_summary.txt    ← first image on slide 1
slide3_image1_summary.txt    ← first image on slide 3
slide3_image2_summary.txt    ← second image on slide 3

The --figure-summary-suffix flag works here too (default: _summary.txt).

Processing Pipeline (.tex files)

The five steps run in this order (each operates on the output of the previous step):

  1. Flatten includes — inline \input{}, \include{}, and \subfile{} recursively, with cycle detection
  2. Remove comments — strip % comments while respecting \% escapes and verbatim environments
  3. Expand macros — substitute user-defined macros (\newcommand, \renewcommand, \def, \DeclareMathOperator) inline and remove definitions. Handles macros with 0–9 arguments, optional arguments with defaults, and nested macros via multi-pass expansion. \newtheorem and \let commands are preserved. Also strips \usepackage lines (use --keep-usepackage to retain them).
  4. Inline bibliography — use a pre-compiled .bbl file if available (common in arXiv downloads), otherwise parse .bib files; replaces \bibliography{} with a \begin{thebibliography} block
  5. Figure summary substitution — replace \includegraphics with text descriptions when summary files are available

Figure Summaries

LLMs (as of early 2026) are still poor at extracting precise information from complex figures in papers — dense plots, multi-panel layouts, small labels, etc. To work around this, latex-llm-cleaner can replace figures with equivalent text descriptions.

For each image (e.g., figs/plot.png), place a summary file alongside it with the configured suffix:

figs/plot.png              ← the image
figs/plot_summary.txt      ← the text summary

What to put in a summary

A summary should be data-equivalent to the figure: it should convey the same information a reader would get from looking at the figure, and nothing more. Avoid editorial commentary, interpretation, or conclusions that aren't visually present in the figure itself.

Good example:

Bar chart with four groups (A, B, C, D). Method X scores 0.92, 0.87, 0.76, 0.81. Method Y scores 0.85, 0.91, 0.80, 0.74. Error bars show standard deviation across 5 runs.

Bad example:

This figure clearly demonstrates the superiority of Method X, which aligns with our hypothesis.

Accessibility benefits

LaTeX has limited built-in support for producing accessible output — generated PDFs typically lack alt-text for figures, making them difficult to navigate with screen readers. These same summary files can serve as alt-text source material when compiling to tagged PDF or HTML, improving accessibility beyond the LLM use case.

Development

pip install -e ".[dev]"
pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

latex_llm_cleaner-0.11.1.tar.gz (175.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

latex_llm_cleaner-0.11.1-py3-none-any.whl (26.5 kB view details)

Uploaded Python 3

File details

Details for the file latex_llm_cleaner-0.11.1.tar.gz.

File metadata

  • Download URL: latex_llm_cleaner-0.11.1.tar.gz
  • Upload date:
  • Size: 175.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.2

File hashes

Hashes for latex_llm_cleaner-0.11.1.tar.gz
Algorithm Hash digest
SHA256 f7d0d36cd97e156385a8f392a93adea33206fd24a279d951667cc81c0553d8ea
MD5 a5b69243c5415d9b898d0c844b661918
BLAKE2b-256 dac4e1c881c3d2fc5d586cc0a3e9b759c0a227c9698dbc51e8d604920afdb26f

See more details on using hashes here.

File details

Details for the file latex_llm_cleaner-0.11.1-py3-none-any.whl.

File metadata

File hashes

Hashes for latex_llm_cleaner-0.11.1-py3-none-any.whl
Algorithm Hash digest
SHA256 c4a330cac3e41e1e06ca5d5ee32610d31b59669d330616a41b818fbc997f78f0
MD5 0a8666e2c95d86649244336267a7e6d9
BLAKE2b-256 9f8420c2c36d8ed1460c4fb515ef5c4790a8adffdae1f4a04d07686acc3e30af

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page