This release is a pre-release and may not be stable for production use.
llmdbg
llmdbg is an early-stage debugger for stepping through language-model layers
and presenting human-readable interpretations of internal vectors. It speaks
the Debug Adapter Protocol
so editor integrations can use a standard debugger UI.
The current prototype includes real GPT-2 Small loading, layer-state capture, logit-lens interpretations, and a VS Code debug extension. A deterministic built-in trace remains available when no model is configured.
pip install --pre llmdbg
llmdbg --version
VS Code prototype
Build and install the extension:
cd vscode-extension
npm install
npm run package
code --install-extension llmdbg-0.0.1.vsix
Create a gpt2.llmdbg file in the workspace:
[model]
id = "openai-community/gpt2"
revision = "main"
device = "cuda"
dtype = "bfloat16"
[input]
prompt = "The capital of France is"
[debug]
stop_on_entry = true
Open that file and press F5. If VS Code asks for a debugger, choose
llmdbg. No launch.json is required. If a workspace launch configuration
is preferred, the complete minimal version is:
{
"version": "0.2.0",
"configurations": [
{
"type": "llmdbg",
"request": "launch",
"name": "llmdbg: Active file",
"config": "${file}"
}
]
}
On first use, the extension creates a private Python environment in VS Code's extension storage. It does not install anything into the workspace. The first GPT-2 run downloads and loads the model, then keeps its tensors resident in a persistent model-host process. Stopping and restarting the debugger reuses the resident model and runs only a new forward pass. Closing/reloading VS Code stops the host and releases the model. Use Step Over to advance through embedding, attention, and MLP steps.
License
MIT
1 maintainer
Metadata
1 maintainer
Release files for llmdbg 0.0.3a4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| llmdbg-0.0.3a4.tar.gz | 34.3 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| llmdbg-0.0.3a4-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 48.0 kB
Release files / llmdbg-0.0.3a4.tar.gz
| Download URL | llmdbg-0.0.3a4.tar.gz |
|---|---|
| Size | 34.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e42eedced700dbe7b783cd4ce74c4b29b39161609cf5f062b66311bf98d73f56
|
|
BLAKE2b-256 checksum How to use checksums |
a8b8214c5f6b7981f38ec6f6499fd7b1e994e7b5921811c483e3556370c258fe
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
Release files / llmdbg-0.0.3a4-py3-none-any.whl
| Download URL | llmdbg-0.0.3a4-py3-none-any.whl |
|---|---|
| Size | 13.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
c0d55f1eebdda5faae904a50d51add8f5bf7c7173471c2a8fe51c5ae06787203
|
|
BLAKE2b-256 checksum How to use checksums |
ee47b98d554d74f526c5c7ea61c29ba87f5abfd0b1cfad395756dbf937d1461f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
Security for llmdbg 0.0.3a4
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
