Skip to main content

Process large codebases using the RLM (Recursive Language Model) pattern

Project description

coderlm

Process large codebases with Coding Agents using the RLM (Recursive Language Model) pattern — with bundled context guards to keep the agent's output from flooding its own context window.

Instead of stuffing all files into an LLM's context window, give it a file listing and let it use tools to peek, decompose, and recursively call itself on subsets. This keeps each agent focused on a manageable scope while covering arbitrarily large codebases.

Install

# npm / bun
bunx coderlm@latest
npx coderlm@latest

# pypi
uvx coderlm
pipx run coderlm

Or install globally:

npm i -g coderlm    # npm
uv tool install coderlm  # pypi

Usage

coderlm <agent> <globs...> --prompt "<task>" [--max-depth N] [--allowedTools TOOLS]

Examples

# Codex
coderlm codex "src/**/*.ts" --prompt "Find all TODO comments"
coderlm codex "src/**" "lib/**" "test/**" --prompt "Find dead code"
coderlm codex "**/*.ts" --prompt "Summarize the codebase" --max-depth 2

# Gemini
coderlm "bunx --bun @google/gemini-cli" "**/*.py" --prompt "Review for security issues"
coderlm "bunx --bun @google/gemini-cli" "src/**" --prompt "Architecture overview"

# Claude (non-recursive only — Claude cannot spawn nested Claude sessions)
coderlm claude "src/**" --prompt "Fix type errors" --allowedTools "Bash,Edit"

How It Works

  1. Expand globs into a file listing using fd (or find as fallback)
  2. Build a system prompt containing the file list and RLM instructions (explore, decompose, aggregate)
  3. Inject context guards via BASH_ENV so every bash subshell the agent spawns has output truncation active
  4. Launch the agent with agent-specific flags for non-interactive execution

The agent receives a file listing — not file contents. It uses shell tools (rg, cat, head, jq, etc.) to inspect files as needed. For large file sets (>20 files), it spawns recursive sub-agents on subsets.

Context Guards (bundled)

bashrlm.sh is bundled and auto-activates for every agent run. It wraps high-output commands (cat, grep, rg, jq, find, ls, curl, etc.) with automatic truncation, preventing the agent from flooding its own context window with oversized output.

Truncation uses head+tail mode — the agent sees the start and end of any large output, with the middle omitted:

[TRUNCATED — showing 2000 of 15000 chars, first and last 1000]

Guards are redirect-aware: piping to a file (> /tmp/out.txt) bypasses truncation, so multi-step processing works naturally. The agent's system prompt includes instructions for this pattern.

Supported Agents

Agent Command Notes
OpenAI Codex codex Recommended — supports recursive sub-agents
Google Gemini bunx --bun @google/gemini-cli Supports recursive sub-agents
Claude Code claude Non-recursive only — cannot spawn nested Claude sessions
Any CLI my-agent Combined prompt passed as single argument

When to Use

  • Many files to analyze (>10)
  • Task benefits from divide-and-conquer
  • Total content exceeds a comfortable context window
  • You want the agent to explore strategically rather than read everything upfront

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

coderlm-0.1.3.tar.gz (19.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

coderlm-0.1.3-py3-none-any.whl (12.7 kB view details)

Uploaded Python 3

File details

Details for the file coderlm-0.1.3.tar.gz.

File metadata

  • Download URL: coderlm-0.1.3.tar.gz
  • Upload date:
  • Size: 19.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.6 {"installer":{"name":"uv","version":"0.10.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for coderlm-0.1.3.tar.gz
Algorithm Hash digest
SHA256 ef201771488c08724a33def0bfd80bd41a668c5a23e2a2740888475d632145c1
MD5 54f8809482fcf783cb30a4800dc88ec9
BLAKE2b-256 709339472b8e1f64468b21395255774d72556091767ce210b267c6141b76f2ee

See more details on using hashes here.

File details

Details for the file coderlm-0.1.3-py3-none-any.whl.

File metadata

  • Download URL: coderlm-0.1.3-py3-none-any.whl
  • Upload date:
  • Size: 12.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.6 {"installer":{"name":"uv","version":"0.10.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for coderlm-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 9803f857176a207e8b81f287e2deadffcc6cb0d8353fe310f32adca17421976f
MD5 45e1dbd03099a1ac792510968b65747f
BLAKE2b-256 064c3c210d37e4d2244ea0912daf448b55a5cbd0d17654178f9cd1bdef7781ab

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page