Graphsignal: Inference Profiler
Graphsignal is a production-scale inference profiling platform that helps engineers optimize AI performance across models, engines, GPUs, and other accelerators. It provides essential visibility across the inference stack, including:
- Continuous, high-resolution profiling timelines exposing operation durations and resource utilization across inference workloads.
- LLM generation tracing with per-step timing, token throughput, and latency breakdowns for major inference frameworks.
- System-level metrics for inference engines and hardware (CPU, GPU, accelerators).
- Error monitoring for device-level failures and inference errors.
- Automatic engine flag optimization, AI chat for bottleneck investigation, and profiling context for AI coding agents.
Learn more at graphsignal.com.
Install
UV_TOOL_BIN_DIR=/usr/local/bin uv tool install 'graphsignal[cu12]' # CUDA 12.x
# or
UV_TOOL_BIN_DIR=/usr/local/bin uv tool install 'graphsignal[cu13]' # CUDA 13.x
Alternative: install into your workload environment
If you prefer a single environment, or you use the graphsignal.watch() Python API (which requires graphsignal importable by your application), install it directly into your workload's environment instead:
pip install 'graphsignal[cu12]' # CUDA 12.x
# or
pip install 'graphsignal[cu13]' # CUDA 13.x
Profile
Wrap your launch command with graphsignal-run:
export GRAPHSIGNAL_API_KEY=<my-api-key>
graphsignal-run vllm serve <model> --port 8001
Environment variables read by the profiler:
| Variable | Purpose |
|---|---|
GRAPHSIGNAL_API_KEY (required) |
Your account API key. |
GRAPHSIGNAL_TAG_<KEY>=<value> |
Arbitrary tag attached to all signals (e.g. GRAPHSIGNAL_TAG_DEPLOYMENT=us-prod). |
Sign up for a free account at graphsignal.com; you'll find the API key in Settings / API Keys.
See the Profiler CLI reference for the full set of options.
Applications that bootstrap themselves can call graphsignal.watch() from Python instead — see the Profiler API reference.
See integration documentation for libraries and inference engines:
Optimize
Log in to Graphsignal to monitor and analyze your application.
Optimize with AI
Three ways to optimize with AI:
- Auto-flags —
graphsignal-run --auto-flagssets engine flags at launch - Optimize chat — ask questions about a time window in the Graphsignal app
- graphsignal-context — let an AI coding agent (Claude Code, Codex, or Gemini) fetch and analyze profiling data in your IDE
See AI Optimization for details.
Overhead
The profiler has minimal impact on production performance. CUDA kernel activity is collected via CUPTI with low-overhead APIs, and analysis and upload happen in the sidecar process.
Security and Privacy
The profiler only establishes outbound connections to api.graphsignal.com to send data; inbound connections or commands are not possible.
Content and sensitive information, such as prompts and completions, are not recorded.
Troubleshooting
If something doesn't look right, report it to our support team via your account.
In case of connection issues, please make sure outgoing connections to https://api.graphsignal.com are allowed.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file graphsignal-0.20.3.tar.gz.
File metadata
- Download URL: graphsignal-0.20.3.tar.gz
- Upload date:
- Size: 283.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
poetry/2.4.1 CPython/3.10.20 Linux/6.17.0-1020-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
78aec44e0f7018c4d7f1b0fb705ff0bd9007f8d015c628a8d5bda30671557737
|
|
| MD5 |
0f2f9f9118ccfffaf874ffcef7309b6f
|
|
| BLAKE2b-256 |
134becb3861175c91bbafed7d7cff888cb21ec81a3caeba52e7378429e258ba7
|
File details
Details for the file graphsignal-0.20.3-py3-none-any.whl.
File metadata
- Download URL: graphsignal-0.20.3-py3-none-any.whl
- Upload date:
- Size: 311.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
poetry/2.4.1 CPython/3.10.20 Linux/6.17.0-1020-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
dfd3ea6d527a7ba3db394f10240d67487038a6a5217314ee72b50f7835e4b2c0
|
|
| MD5 |
609759b4b9841d33b3462c3b59a17d42
|
|
| BLAKE2b-256 |
0a28ae15ca8c406e561f867e4492bebbf0efc606ee217e670be147f7860be1de
|
