aquila 0.3.0

Deploy, manage, and monitor vLLM instances across a GPU cluster from a single web dashboard.

Aquila

GPU inference cluster manager. Deploy, manage, and monitor vLLM instances across a GPU cluster from a single web dashboard.

Quick Start

pip install aquila

On each GPU node (satellite):

aquila client install
aquila client start

On the management server (host):

aquila host install
aquila host start

Then open the dashboard at http://<host-ip>:5173 to deploy and monitor models across your cluster.

Features

• Web dashboard for deploying and managing vLLM models across multiple GPU nodes
• Runs each model in the official vllm/vllm-openai Docker container — no per-node CUDA/PyTorch setup; the version maps to an image tag
• Live GPU utilization metrics and deployment status monitoring
• Consul-based automatic node discovery
• Support for custom pip packages (via cached derived images) and vLLM plugins