Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

llmdbg

llmdbg is an early-stage debugger for stepping through language-model layers and presenting human-readable interpretations of internal vectors. It speaks the Debug Adapter Protocol so editor integrations can use a standard debugger UI.

The current prototype includes real GPT-2 Small loading, layer-state capture, logit-lens interpretations, and a VS Code debug extension. A deterministic built-in trace remains available when no model is configured.

pip install --pre llmdbg
llmdbg --version

VS Code prototype

Build and install the extension:

cd vscode-extension
npm install
npm run package
code --install-extension llmdbg-0.0.1.vsix

Create a gpt2.llmdbg file in the workspace:

[model]
id = "openai-community/gpt2"
revision = "main"
device = "cuda"
dtype = "bfloat16"

[input]
prompt = "The capital of France is"

[debug]
stop_on_entry = true

Open that file and press F5. If VS Code asks for a debugger, choose llmdbg. No launch.json is required. If a workspace launch configuration is preferred, the complete minimal version is:

{
  "version": "0.2.0",
  "configurations": [
    {
      "type": "llmdbg",
      "request": "launch",
      "name": "llmdbg: Active file",
      "config": "${file}"
    }
  ]
}

On first use, the extension creates a private Python environment in VS Code's extension storage. It does not install anything into the workspace. The first GPT-2 run downloads the model into the normal Hugging Face cache. Use Step Over to advance through embedding, attention, and MLP steps.

License

MIT

Metadata

Release files for llmdbg 0.0.3a3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for llmdbg 0.0.3a3
File Size Uploaded Provenance
llmdbg-0.0.3a3.tar.gz 32.0 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for llmdbg 0.0.3a3
File Interpreter ABI Platform
llmdbg-0.0.3a3-py3-none-any.whl Python 3 none any Details

Total release size: 44.2 kB

Release files / llmdbg-0.0.3a3.tar.gz

Download URL llmdbg-0.0.3a3.tar.gz
Size 32.0 kB
Tags Source
SHA-256 checksum
How to use checksums
14f2c2018ea587f81f8c2f39bb7c54d58c3010143469da77a211982c68bc5b07
BLAKE2b-256 checksum
How to use checksums
48fcf8d763ec7e5d464755b031c4a49dfdd15db96556bca77b478c8a202c47fe
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / llmdbg-0.0.3a3-py3-none-any.whl

Download URL llmdbg-0.0.3a3-py3-none-any.whl
Size 12.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e63632e948717bd2c9b83e814e1a7fb9508b42ce4e5628a3fc3b6128c7ba79a4
BLAKE2b-256 checksum
How to use checksums
b855db367ba8bd2379d3bd94b21ed6b71b3953523342febaa572beee16866e0d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Security for llmdbg 0.0.3a3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Release history Release notifications | RSS feed

This release
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page