Skip to main content

A helper tool for remote debugging on HPC clusters.

Project description

🚀 remote-debug

A CLI tool to simplify visual debugging of Python scripts on remote HPC clusters directly from your local VS Code instance.

remote-debug helps you bridge the gap between your local editor and a script running on a remote compute node, making it easy to debug GPU-specific issues or complex cluster jobs with a full-featured debugger.


Table of Contents


Installation

Install from PyPI:

pip install remote-debug

Or, build from source using Pixi:

# Install pixi with: curl -fsSL https://pixi.sh/install.sh | sh
pixi install

Quick Start

  1. Initialize your project This command creates the necessary VS Code launch configurations in .vscode/launch.json.

    remote-debug init
    

    [!WARNING] If launch.json exists but is malformed, it will be backed up to launch.json.bak and a new file will be created.

  2. Run your script on the cluster Prefix your usual Python command with remote-debug debug. This will start a debug server and wait for you to connect.

    # Instead of: python my_script.py --arg value
    # Run this:
    remote-debug debug my_script.py --arg value
    
  3. Check your job's output The job output will contain the connection details needed to attach the debugger.

    --- Python Debugger Info ---
    Node: uc2n805.localdomain
    Port: 51041
    Remote Path: /path/to/your/project
    --------------------------
    Script is paused, waiting for debugger to attach..
    
  4. Connect VS Code Follow one of the two methods below depending on your setup. Once attached, you can set breakpoints and debug as if you were running the code locally.


Debugging Workflow

Method A: Connecting from your Local Machine

Use this method if you are running VS Code locally and want to connect to the remote cluster.

  1. Create an SSH Tunnel On your local machine, run the tunnel command using the Node and Port from the job output, along with your cluster's SSH login details.

    # remote-debug tunnel <NODE> <REMOTE_PORT> <SSH_LOGIN>
    remote-debug tunnel uc2n805.localdomain 51041 username@cluster.hostname.com
    

    This will generate an ssh command. Copy, paste, and run it in a new terminal to establish the tunnel. Keep this terminal open.

  2. Attach VS Code

    • Open the "Run and Debug" panel in VS Code (Ctrl+Shift+D).
    • Select "Python Debugger: Remote Attach (via SSH Tunnel)" from the dropdown and click the play button.
    • You will be prompted for:
      • localTunnelPort: The local port for the tunnel (default is 5678).
      • remoteWorkspaceFolder: The Remote Path from the job output.

Method B: Connecting via VS Code Remote-SSH

Use this method if you are already connected to a remote machine (like a login node) using the VS Code Remote - SSH extension.

  1. Attach VS Code
    • Open the "Run and Debug" panel in VS Code (Ctrl+Shift+D).
    • Select "Python Debugger: Attach to Compute Node" from the dropdown and click the play button.
    • You will be prompted for:
      • computeNodeHost: The Node from the job output.
      • computeNodePort: The Port from the job output.

Command Reference

Command Description
remote-debug <script> [args...] Wraps a Python script to start a debugpy listener and waits for a client to attach.
remote-debug init Creates or updates .vscode/launch.json with the required debugger configurations.
remote-debug tunnel <node> <port> <login> Constructs the SSH command to establish a tunnel to the compute node.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

remote_debug-0.2.2.tar.gz (7.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

remote_debug-0.2.2-py3-none-any.whl (6.4 kB view details)

Uploaded Python 3

File details

Details for the file remote_debug-0.2.2.tar.gz.

File metadata

  • Download URL: remote_debug-0.2.2.tar.gz
  • Upload date:
  • Size: 7.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for remote_debug-0.2.2.tar.gz
Algorithm Hash digest
SHA256 17dfcc54dd7c8d36ac306c3766c3bfce250be0a0f3e8f9d884aeefac614eb9af
MD5 31552c4a7903f3998416f8181731ead7
BLAKE2b-256 302c1522ed594ccc7e7499f3abd5a8fc2f81830014017c5e2da05ad5fb69ff0f

See more details on using hashes here.

File details

Details for the file remote_debug-0.2.2-py3-none-any.whl.

File metadata

  • Download URL: remote_debug-0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 6.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for remote_debug-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 febc4a7177056fc31aeca67b21da832a19f37935eb65e1390aa3484e838e17e1
MD5 3ec54701176a94449b1745900f5153ce
BLAKE2b-256 4908e0bc160f2fb8c972682853aef4c6714181553a27805b7b1ccbccbd909754

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page