Skip to main content

High performance code search for large codebases

Project description

Context extraction at scale

Tools like Aider and Cursor are great at editing code for you once you give them the right context. But finding that context automatically is largely an unsolved problem, especially in large codebases.

LLMap is a CLI code search tool designed to solve that problem by asking
DeepSeek-V3 and DeepSeek-R1 to evaluate the relevance of each source file in your codebase to your problem.

Until recently, this would be prohibitively expensive and slow. But DeepSeek-V3 is cheap, smart, fast, and most importantly, it allows multiple concurrent requests. LLMap performs its analysis (by default) 500 files at a time, so it's reasonably fast even for large codebases.

LLMap also structures its request to take advantage of DeepSeek's caching. This means that repeated searches against the same files will be faster and less expensive.

Finally, LLMap optimizes the problem by using a multi-stage analysis to avoid spending more time than necessary analyzing obviously irrelevant files. LLMap performs 3 stages of analysis:

  1. Coarse analysis using code skeletons [DeepSeek-V3]
  2. Full source analysis of potentially relevant files from (1) [DeepSeek-V3]
  3. Refine the output of (2) to only the most relevant snippets [DeepSeek-R1]

Limitations

Currently only Java and Python files are supported by the skeletonization pass.
LLMap will process other source files, but it will perform full source analysis on all of them, which will be slower.

Extending the parsing to other languages is straightforward; contributions are welcome.

Installation

pip install llmap-ai

Get a DeepSeek API key from platform.deepseek.com.

Usage

export DEEPSEEK_API_KEY=YYY

find src/ -name "*.java" | llmap "Where is the database connection configured?"

LLMs APIs are not super reliable, so LLMap caches LLM responses in .llmap_cache by question and by processing stage, so that you don't have to start over from scratch if you get rate limited or run into another hiccup.

The cache is automatically cleaned out when execution completes successfully.

Output

LLMap prints the most relevant context found to stdout. You can save this to a file and send it to Aider or attach it to a conversation with your favorite AI chat tool.

Errors are logged to stderr.

Options

  --sample SAMPLE       Number of random files to sample
  --save-cache          Keep cache directory after completion
  --llm-concurrency LLM_CONCURRENCY
                        Maximum number of concurrent LLM requests
  --no-refine           Skip refinement and combination of analyses

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llmap_ai-0.9.1.tar.gz (1.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llmap_ai-0.9.1-py3-none-any.whl (2.0 MB view details)

Uploaded Python 3

File details

Details for the file llmap_ai-0.9.1.tar.gz.

File metadata

  • Download URL: llmap_ai-0.9.1.tar.gz
  • Upload date:
  • Size: 1.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.10.15

File hashes

Hashes for llmap_ai-0.9.1.tar.gz
Algorithm Hash digest
SHA256 01a36d212c86096bc255bbdc040867ef0532db4e4c36d345abf8ae0cea6db15d
MD5 2bffc8611388cd4cfe19828dbab58dd8
BLAKE2b-256 376e8ef4d83c84c8ef685493f0ee9fd133b361bb650a9cffc1c501cd16a752ed

See more details on using hashes here.

File details

Details for the file llmap_ai-0.9.1-py3-none-any.whl.

File metadata

  • Download URL: llmap_ai-0.9.1-py3-none-any.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.10.15

File hashes

Hashes for llmap_ai-0.9.1-py3-none-any.whl
Algorithm Hash digest
SHA256 28c983325c59d46d29e359f9c483946f95cb1d29e8584e97a8f3a2b089bba143
MD5 58182bce8294d144a57fc2b6d7e81cf1
BLAKE2b-256 4c8a78120e3abb72dcb77ae06440d7237ee04643dd96e37abb65e319cade21fc

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page