Skip to main content

Curated AMD GPU compatibility index and CLI for AI workloads

Project description

rocmate

Get AMD GPUs running with AI tools — without the rabbit hole.

rocmate is a curated compatibility index and CLI for running modern AI workloads on AMD GPUs via ROCm. It tells you what works on your specific card, what to set, and what to avoid — based on configurations that real users have tested.

pip install rocmate

rocmate doctor

Why?

AMD GPUs offer great VRAM-per-dollar (especially the RX 7900 XTX with 24 GB), but getting Ollama, ComfyUI, faster-whisper, or axolotl to actually use the GPU still involves hunting through blog posts, GitHub issues, and Discord threads. Information is scattered, often outdated, and rarely specific to your chip generation (gfx1030 vs gfx1100 vs gfx1201).

rocmate consolidates this knowledge into one place — version-controlled, testable, community-maintained.

Quickstart

# Install (Python 3.11+)
pip install rocmate

# Check your system
rocmate doctor

# Show the tested config for a tool
rocmate show ollama

# Install a tool with the right ENV vars
rocmate install ollama

# Auto-fix detected issues
rocmate doctor --fix

Supported tools

Tool gfx1100
RX 7900 XT/XTX
gfx1101
RX 7800/7700 XT
gfx1102
RX 7600
gfx1030
RX 6800/6900
gfx1201
RX 9070
Ollama 🟡
ComfyUI 🟡 🟡
faster-whisper 🟡
llama.cpp 🟡
Stable Diffusion WebUI 🟡 🟡
vLLM 🟡 🟡 🟡
Axolotl 🟡 🟡
ExLlamaV2 🟡 🟡

✅ tested · 🟡 partial / workarounds needed · — no data yet

Run rocmate show <tool> for chip-specific ENV vars, install hints, and tested ROCm versions.

Status

Actively maintained by @tonde on an RX 7900 XTX. Contributions for other AMD chips are very welcome — one YAML file, five minutes. See CONTRIBUTING.md.

Roadmap

  • rocmate doctor — system diagnostic (GPU, ROCm, groups, Docker, Vulkan)
  • rocmate show <tool> — display tested config per chip
  • rocmate list — list all supported tools
  • rocmate install <tool> — plan and execute install with correct ENV vars
  • rocmate doctor --tool <name> — tool-specific compatibility check
  • rocmate doctor --fix — interactively apply fixes for detected issues
  • Windows / HIP SDK support (GPU detection via hipinfo + WMI fallback)
  • Web-facing compatibility matrix

Non-goals

  • Not a replacement for ROCm, Ollama, or any inference engine
  • Not a fork of upstream tools — only configs and glue
  • Not a benchmarking tool

License

MIT — see LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rocmate-0.4.1.tar.gz (24.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

rocmate-0.4.1-py3-none-any.whl (22.1 kB view details)

Uploaded Python 3

File details

Details for the file rocmate-0.4.1.tar.gz.

File metadata

  • Download URL: rocmate-0.4.1.tar.gz
  • Upload date:
  • Size: 24.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for rocmate-0.4.1.tar.gz
Algorithm Hash digest
SHA256 1ac4f6786569fdfc91fd243e69c58dfeba3f28c34923d05ac945902712d869a5
MD5 e7bb1bf5ec80a5e4414b98b1bc0e1809
BLAKE2b-256 73ce584719bfd0ef9128b08ef140554fad6b955a4ff5503dd256fe27ca33ce76

See more details on using hashes here.

File details

Details for the file rocmate-0.4.1-py3-none-any.whl.

File metadata

  • Download URL: rocmate-0.4.1-py3-none-any.whl
  • Upload date:
  • Size: 22.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for rocmate-0.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 9255f2b7f0ef7bf65af3f9f03b53b905793c2890abb8fc75d3cc6c559f1eaf28
MD5 f2642042d4a9e6a3a674ec9940bfd22f
BLAKE2b-256 49975890002707ecca1296ed1707bddebc57a5bae21b480ad74c9bb5bb24ac59

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page