Skip to main content

Manage singleton server processes across multiple workers using atomic socket binding

Project description

singleserver

Manage singleton server processes across multiple workers using atomic socket binding.

Problem

When running web applications with multiple workers (e.g., gunicorn), you often need auxiliary services (API servers, background processors, caches) that should only run as a single instance shared by all workers.

Current solutions like systemd unit files or separate containers require additional infrastructure and make local development different from production.

Solution

singleserver uses the OS-level guarantee that only one process can bind a socket at a time. When multiple workers call connect():

  1. First worker acquires the lock and starts the server
  2. Other workers detect the lock is held and connect as clients
  3. If the owner dies, another worker can take over
Worker 1: connect() → bind(:18765) → SUCCESS → starts server, returns client
Worker 2: connect() → bind(:18765) → EADDRINUSE → waits for ready, returns client
Worker 3: connect() → bind(:18765) → EADDRINUSE → waits for ready, returns client

Installation

pip install singleserver

Quick Start

from singleserver import SingleServer

# Define the server
api_server = SingleServer(
    name="api-server",
    command=["python", "-m", "my_api", "--port", "{port}"],
    port=8765,
)

# Connect (starts if needed, connects if already running)
with api_server.connect() as client:
    response = client.get("/data.json")
    print(response.json())

Features

  • Atomic coordination: Uses socket binding for distributed locking
  • Health monitoring: Configurable health checks with automatic restarts
  • Output handling: Redirect stdout/stderr to files
  • Graceful shutdown: SIGTERM with timeout, then SIGKILL
  • No external dependencies: Pure Python, no Redis/etcd/etc needed
  • Same code for dev and prod: No systemd unit files required

Configuration

SingleServer(
    name="my-service",                    # Identifier for logging
    command=["python", "server.py", ...], # Command to run ({port} is replaced)

    # Server address
    port=8765,                           # TCP port
    # OR
    socket="/tmp/my-service.sock",       # Unix socket (faster, more secure)

    # Health checks
    health_check_url="/",                # URL to poll for readiness
    health_check_interval=5.0,           # Seconds between checks
    startup_timeout=30.0,                # Max seconds to wait for startup

    # Restart behavior
    restart_on_failure=True,             # Auto-restart if process dies
    max_restarts=3,                      # Give up after N restarts
    restart_delay=1.0,                   # Seconds between restart attempts

    # Process options
    env={"DATABASE_URL": "..."},         # Environment variables
    cwd="/app",                          # Working directory
    stdout="/var/log/my-service.log",    # Log file
    stderr="stdout",                     # Redirect stderr to stdout

    # Shutdown
    shutdown_timeout=10.0,               # Seconds for graceful stop
)

Use Cases

Internal API server

from singleserver import SingleServer

api = SingleServer(
    name="internal-api",
    command=["python", "-m", "internal_api", "-p", "{port}"],
    port=8765,
)

def my_view(request):
    with api.connect() as client:
        data = client.get("/query").json()
    return JsonResponse(data)

Background service

service = SingleServer(
    name="background-service",
    command=["python", "service.py", "--port", "{port}"],
    port=8888,
    health_check_url="/health",
    restart_on_failure=True,
)

How It Works

  1. Lock acquisition: Uses a separate socket (port + 10000 by default) for coordination
  2. Process management: Owner spawns subprocess in new process group
  3. Health monitoring: Background thread polls health endpoint
  4. Restart logic: Configurable restart attempts with delay
  5. Cleanup: atexit handler and signal handlers for clean shutdown

Development

# Install dev dependencies
uv sync --all-extras

# Run tests
uv run pytest

# Type checking
uv run mypy singleserver

# Linting
uv run ruff check singleserver tests

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

singleserver-0.3.0.tar.gz (74.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

singleserver-0.3.0-py3-none-any.whl (17.2 kB view details)

Uploaded Python 3

File details

Details for the file singleserver-0.3.0.tar.gz.

File metadata

  • Download URL: singleserver-0.3.0.tar.gz
  • Upload date:
  • Size: 74.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.9.2

File hashes

Hashes for singleserver-0.3.0.tar.gz
Algorithm Hash digest
SHA256 614ab86326bd7134981334e2f8a4874017aa5ae0698baa362132021d9fe19ec5
MD5 61a8f58dfdaa700563b6643b6bd78d81
BLAKE2b-256 604d1c1ebafcd2e43dec646105bdebc1b0b9c65bf89dd0f9f34384869165a76e

See more details on using hashes here.

File details

Details for the file singleserver-0.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for singleserver-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 10898ba6409d30b0a4d8054d6efc6db7c54108689adfe0b0322d3ea83655b9b3
MD5 918cbc0552fcc2e0c6cf28a80ec01d35
BLAKE2b-256 e841f877b1abec1f62d81b0952c3bef950fb32e272f420f024f6a3068081060b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page