This release is a pre-release and may not be stable for production use.
ROCm Hyperloom
ROCm™ Hyperloom is an autonomous agentic system designed to optimize end-to-end inference workloads (targeting both host code and GPU kernels) on AMD GPUs. Using advanced AI agents and profiling tools, Hyperloom analyzes your workload, identifies performance bottlenecks, implements targeted optimizations, and validates the performance and correctness of the optimizations without requiring manual intervention.
The system operates through a sophisticated multi-stage pipeline. First TraceLens, the profiling brain of the workload understanding stage, consumes traces collected by Magpie (which in turn relies on IntelliKit for some low-level GPU profiling tools), captures bottlenecks, and derives the roofline targets that seed the optimization search tree.
Next, Hyperloom employs a self-evolving code optimization engine following an iterative agentic loop (Think → Decide → Implement → Benchmark). Arbor intelligently explores the optimization space using a Dynamic Specialist Agent and Knowledge Base. In parallel to Arbor, GEAK, a multi-agent GPU performance optimizer, optimizes hot kernels. Once optimizations are identified and validated, Hyperloom prepares the optimized code and generates a report with all proposed changes and expected performance improvements. This end-to-end automation enables developers to achieve significant performance improvements while maintaining code quality and reducing the manual effort traditionally required for GPU optimization.
Hyperloom combines:
- Trace analysis, identifying bottleneck kernels and bridge planning through TraceLens Agent (backend support from Magpie and Intellikit)
- Kernel optimization through the GEAK backend.
- Agentic search space exploration through Arbor, a tree-based cognition layer with dynamic agents, long-horizon campaigns, and self-evolving optimization guided by a curated knowledge base of hardware learnings, pitfalls, and prior campaign artifacts.
Get Started
| Goal | Guide |
|---|---|
| Set up Hyperloom and run a demo | Quickstart |
| Launch and monitor an optimization | Run an optimization |
| Understand the algorithm | Optimization loop |
Documentation
| Topic | Link |
|---|---|
| ROCm Docs | Hyperloom |
| Authentication and credentials | Authentication & credentials |
| Environment variables | Environment variables |
| Components | Components |
| Compatibility | Compatibility matrix |
| Troubleshooting | Troubleshooting |
| Operations | Operations & self-hosting |
| Session output schema | session_breakdown.json |
File Issues and Feedback
If you encounter any problem or bugs while running Hyperloom, feel free to open an issue, or provide us with feedback on how to improve Hyperloom by completing the beta survey.
Developer Entry Points
- Runtime package:
src/hyperloom/ - Main agent instructions:
src/hyperloom/inference_optimizer/SKILL.md - CLI entry point:
python -m hyperloom.inference_optimizer.cli optimize - Operator tools:
python -m hyperloom.inference_optimizer.tools.* - Documentation source:
docs/
For contribution workflow, testing, and linting, see
CONTRIBUTING.md.
Licensing
Hyperloom is released under the MIT License. The full license text
is in LICENSE.
You may use Hyperloom commercially, modify it, and distribute it under the terms of the MIT license, provided the copyright notice and the permission notice are retained in all copies or substantial portions of the software.
Third-party tools and agents (Cursor, Visual Studio, and Claude Code)
that Hyperloom invokes are governed by their own separate license terms
and are NOT covered by the MIT license above — see the "Third-Party
Tools and Agents" section in LICENSE. You are responsible
for reviewing and complying with each tool's individual license.
For security-relevant issues, see SECURITY.md. For
contribution conventions, see CONTRIBUTING.md.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file hyperloom_inference_optimizer-1.0.0a1-py3-none-any.whl.
File metadata
- Download URL: hyperloom_inference_optimizer-1.0.0a1-py3-none-any.whl
- Upload date:
- Size: 4.4 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/7.0.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2fe68c5d52bf4e673d4cc7ee0be228465ca681ef6853e944462c5ee62217c620
|
|
| MD5 |
2744131f4c2c6823d68d9e1a740e9398
|
|
| BLAKE2b-256 |
f73c8e8d0f858e9cff81198acfba0ee28d4d3528437a80bc7dd8fbdadbb459ee
|