Backend.AI App Proxy Coordinator
Purpose
The App Proxy Coordinator manages routing information for App Proxy Workers, coordinates worker instances, and handles service port mappings for compute session services (Jupyter, SSH, TensorBoard, etc.).
Key Responsibilities
1. Worker Management
- Register and track App Proxy Worker instances
- Monitor worker health and availability
- Distribute routing information to workers
- Handle worker failover
2. Route Management
- Manage service port mappings (session → service → port)
- Update routing tables dynamically
- Propagate route changes to workers
- Handle route conflicts and resolution
3. Service Discovery
- Maintain service registry
- Provide route lookup for workers
- Update routes when sessions change
- Clean up routes for terminated sessions
Entry Points
App Proxy Coordinator has 1 entry point to receive and process requests.
1. REST API
Framework: aiohttp (async HTTP server)
Port: 6030 (default)
Primary Purpose:
- Worker management (registration, monitoring)
- Routing information management (session-to-service port mapping)
Key Features:
- HTTP/HTTPS-based communication
- Centralized service routing information management
- Real-time route updates
- Persistent routing information storage in PostgreSQL
Processing Flow:
Worker Registration Flow
Worker → POST /workers/register → Coordinator
↓
Register worker in DB
↓
Return worker ID and routes
Route Creation Flow
Manager → POST /routes → Coordinator
↓
Store route in DB
↓
Notify all workers
↓
Workers update local routing table
Integrated Architecture:
┌──────────────┐
│ Manager │
│ │
└──────┬───────┘
│ Route Management (REST)
▼
┌─────────────────────────────────────┐
│ App Proxy Coordinator (Port 6030) │
│ - Worker registration │
│ - Route management │
│ - Service port mapping │
│ - Route propagation │
└─────────┬───────────────────────────┘
│
▼ Worker Registration & Route Updates
┌─────┴─────┬─────────┬─────────┐
▼ ▼ ▼ ▼
┌────────┐ ┌────────┐ ┌────────┐ ┌────────┐
│Worker 1│ │Worker 2│ │Worker 3│ │Worker N│
└────────┘ └────────┘ └────────┘ └────────┘
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file backend_ai_appproxy_coordinator-26.8.0.tar.gz.
File metadata
- Download URL: backend_ai_appproxy_coordinator-26.8.0.tar.gz
- Upload date:
- Size: 88.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.2.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
abb1092299dba93c94f6937f5c488c92273021419160d062284cb87e1c65c758
|
|
| MD5 |
9eb027fcace83bc87134d8567c1863e6
|
|
| BLAKE2b-256 |
ef30187850e36c8de5f65e665d0a9015b60bb483302279e1fdc4673b1d4bee11
|
File details
Details for the file backend_ai_appproxy_coordinator-26.8.0-py3-none-any.whl.
File metadata
- Download URL: backend_ai_appproxy_coordinator-26.8.0-py3-none-any.whl
- Upload date:
- Size: 119.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.2.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
57e626c79b9186e1a0a67698c8cd590c8fd5abd1d24279ca13070b30a41b08c5
|
|
| MD5 |
66cac8cd7afc1bc0ab7d363c19327f9f
|
|
| BLAKE2b-256 |
4609fa98c0239788d9e2d3b71de43b88d1fe0b0878a112b444cb7f88b83ee26a
|
