Skip to main content

Backend.AI App Proxy Coordinator

Purpose

The App Proxy Coordinator manages routing information for App Proxy Workers, coordinates worker instances, and handles service port mappings for compute session services (Jupyter, SSH, TensorBoard, etc.).

Key Responsibilities

1. Worker Management

  • Register and track App Proxy Worker instances
  • Monitor worker health and availability
  • Distribute routing information to workers
  • Handle worker failover

2. Route Management

  • Manage service port mappings (session → service → port)
  • Update routing tables dynamically
  • Propagate route changes to workers
  • Handle route conflicts and resolution

3. Service Discovery

  • Maintain service registry
  • Provide route lookup for workers
  • Update routes when sessions change
  • Clean up routes for terminated sessions

Entry Points

App Proxy Coordinator has 1 entry point to receive and process requests.

1. REST API

Framework: aiohttp (async HTTP server)

Port: 6030 (default)

Primary Purpose:

  • Worker management (registration, monitoring)
  • Routing information management (session-to-service port mapping)

Key Features:

  • HTTP/HTTPS-based communication
  • Centralized service routing information management
  • Real-time route updates
  • Persistent routing information storage in PostgreSQL

Processing Flow:

Worker Registration Flow

Worker → POST /workers/register → Coordinator
                                      ↓
                                  Register worker in DB
                                      ↓
                                  Return worker ID and routes

Route Creation Flow

Manager → POST /routes → Coordinator
                             ↓
                         Store route in DB
                             ↓
                         Notify all workers
                             ↓
                         Workers update local routing table

Integrated Architecture:

┌──────────────┐
│   Manager    │
│              │
└──────┬───────┘
       │ Route Management (REST)
       ▼
┌─────────────────────────────────────┐
│  App Proxy Coordinator (Port 6030)  │
│  - Worker registration              │
│  - Route management                 │
│  - Service port mapping             │
│  - Route propagation                │
└─────────┬───────────────────────────┘
          │
          ▼ Worker Registration & Route Updates
    ┌─────┴─────┬─────────┬─────────┐
    ▼           ▼         ▼         ▼
┌────────┐ ┌────────┐ ┌────────┐ ┌────────┐
│Worker 1│ │Worker 2│ │Worker 3│ │Worker N│
└────────┘ └────────┘ └────────┘ └────────┘

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

backend_ai_appproxy_coordinator-26.4.8.tar.gz (87.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

backend_ai_appproxy_coordinator-26.4.8-py3-none-any.whl (118.9 kB view details)

Uploaded Python 3

File details

Details for the file backend_ai_appproxy_coordinator-26.4.8.tar.gz.

File metadata

File hashes

Hashes for backend_ai_appproxy_coordinator-26.4.8.tar.gz
Algorithm Hash digest
SHA256 f5686999c308055de746c968c30e037872c0d7bce0ba2c96f0bf32da2086e470
MD5 efa571001719c8ce6a65cb16aa32937f
BLAKE2b-256 5d7097f41afe464e659f5c519a0e22b53a5c8ca39a687d792dfd459f17573029

See more details on using hashes here.

File details

Details for the file backend_ai_appproxy_coordinator-26.4.8-py3-none-any.whl.

File metadata

File hashes

Hashes for backend_ai_appproxy_coordinator-26.4.8-py3-none-any.whl
Algorithm Hash digest
SHA256 246b64f7629317c3b55f047ea9c66e13939ad434300e03b50aeb440e23102269
MD5 f2bba813c58229eb3c3d660a132ab890
BLAKE2b-256 28d9518cf73d14b8dc307aa97ba6ca0a2aea485b6705a47462b8b48ce594953d

See more details on using hashes here.

Release history Release notifications | RSS feed

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page