Skip to main content

Backend.AI App Proxy Coordinator

Purpose

The App Proxy Coordinator manages routing information for App Proxy Workers, coordinates worker instances, and handles service port mappings for compute session services (Jupyter, SSH, TensorBoard, etc.).

Key Responsibilities

1. Worker Management

  • Register and track App Proxy Worker instances
  • Monitor worker health and availability
  • Distribute routing information to workers
  • Handle worker failover

2. Route Management

  • Manage service port mappings (session → service → port)
  • Update routing tables dynamically
  • Propagate route changes to workers
  • Handle route conflicts and resolution

3. Service Discovery

  • Maintain service registry
  • Provide route lookup for workers
  • Update routes when sessions change
  • Clean up routes for terminated sessions

Entry Points

App Proxy Coordinator has 1 entry point to receive and process requests.

1. REST API

Framework: aiohttp (async HTTP server)

Port: 6030 (default)

Primary Purpose:

  • Worker management (registration, monitoring)
  • Routing information management (session-to-service port mapping)

Key Features:

  • HTTP/HTTPS-based communication
  • Centralized service routing information management
  • Real-time route updates
  • Persistent routing information storage in PostgreSQL

Processing Flow:

Worker Registration Flow

Worker → POST /workers/register → Coordinator
                                      ↓
                                  Register worker in DB
                                      ↓
                                  Return worker ID and routes

Route Creation Flow

Manager → POST /routes → Coordinator
                             ↓
                         Store route in DB
                             ↓
                         Notify all workers
                             ↓
                         Workers update local routing table

Integrated Architecture:

┌──────────────┐
│   Manager    │
│              │
└──────┬───────┘
       │ Route Management (REST)
       ▼
┌─────────────────────────────────────┐
│  App Proxy Coordinator (Port 6030)  │
│  - Worker registration              │
│  - Route management                 │
│  - Service port mapping             │
│  - Route propagation                │
└─────────┬───────────────────────────┘
          │
          ▼ Worker Registration & Route Updates
    ┌─────┴─────┬─────────┬─────────┐
    ▼           ▼         ▼         ▼
┌────────┐ ┌────────┐ ┌────────┐ ┌────────┐
│Worker 1│ │Worker 2│ │Worker 3│ │Worker N│
└────────┘ └────────┘ └────────┘ └────────┘

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

backend_ai_appproxy_coordinator-26.4.10.tar.gz (88.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file backend_ai_appproxy_coordinator-26.4.10.tar.gz.

File metadata

File hashes

Hashes for backend_ai_appproxy_coordinator-26.4.10.tar.gz
Algorithm Hash digest
SHA256 933df98f8c0886902e7c02a01f4b4785a3393f99198fe60a1dc0a997a553ef18
MD5 0ef66dd7525a50db281f4027f1e77ed6
BLAKE2b-256 b336624e1217248ed224e22b554793d418e72beeb40c32dc9b3af9390556aebb

See more details on using hashes here.

File details

Details for the file backend_ai_appproxy_coordinator-26.4.10-py3-none-any.whl.

File metadata

File hashes

Hashes for backend_ai_appproxy_coordinator-26.4.10-py3-none-any.whl
Algorithm Hash digest
SHA256 b69871810557117a35a097ed586bce3453a15ea63e3e3991ed6c8fd3153894bd
MD5 35242527eb4fff6eb6fbe584a7093885
BLAKE2b-256 c73b7199edb8758fcd7d612a0961227d0341bbc9be6caa7f55d861778b1b15da

See more details on using hashes here.

Release history Release notifications | RSS feed

26.8.3

2 files

26.8.2

2 files

26.8.1

2 files

26.8.0

2 files

26.7.0

2 files

This release

26.4.10 This release

2 files

26.4.9

2 files

26.4.8

2 files

26.4.7

2 files

26.4.6

2 files

26.4.5

2 files

26.4.4

2 files

26.4.3

2 files

26.4.2

2 files

26.4.1

2 files

26.4.0

2 files

26.3.3

2 files

26.3.2

2 files

26.3.1

2 files

26.3.0

2 files

26.2.5

2 files

26.2.4

2 files

26.2.3

2 files

26.2.2

2 files

26.2.1

2 files

26.2.0

2 files

26.1.0

2 files

25.19.2

2 files

25.19.1

2 files

25.19.0

2 files

25.18.1

2 files

25.18.0

2 files

25.17.1

2 files

25.17.0

2 files

25.16.0

2 files

25.15.12

2 files

25.15.11

2 files

25.15.10

2 files

25.15.9

2 files

25.15.8

2 files

25.15.7

2 files

25.15.6

2 files

25.15.5

2 files

25.15.4

2 files

25.15.3

2 files

25.15.2

2 files

25.15.1

2 files

25.15.0

2 files

25.14.5

2 files

25.14.4

2 files

25.14.3

2 files

25.14.2

2 files

25.14.1

2 files

25.14.0

2 files

25.13.4

2 files

25.13.3

2 files

25.13.2

2 files

25.13.1

2 files

25.13.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page