Skip to main content

Manage singleton server processes across multiple workers using atomic socket binding

Project description

singleserver

Manage singleton server processes across multiple workers using atomic socket binding.

Problem

When running web applications with multiple workers (e.g., gunicorn), you often need auxiliary services (API servers, background processors, caches) that should only run as a single instance shared by all workers.

Current solutions like systemd unit files or separate containers require additional infrastructure and make local development different from production.

Solution

singleserver uses the OS-level guarantee that only one process can bind a socket at a time. When multiple workers call connect():

  1. First worker acquires the lock and starts the server
  2. Other workers detect the lock is held and connect as clients
  3. If the owner dies, another worker can take over
Worker 1: connect() → bind(:18765) → SUCCESS → starts server, returns client
Worker 2: connect() → bind(:18765) → EADDRINUSE → waits for ready, returns client
Worker 3: connect() → bind(:18765) → EADDRINUSE → waits for ready, returns client

Installation

pip install singleserver

Quick Start

from singleserver import SingleServer

# Define the server
api_server = SingleServer(
    name="api-server",
    command=["python", "-m", "my_api", "--port", "{port}"],
    port=8765,
)

# Connect (starts if needed, connects if already running)
with api_server.connect() as client:
    response = client.get("/data.json")
    print(response.json())

Features

  • Atomic coordination: Uses socket binding for distributed locking
  • Health monitoring: Configurable health checks with automatic restarts
  • Output handling: Redirect stdout/stderr to files
  • Graceful shutdown: SIGTERM with timeout, then SIGKILL
  • No external dependencies: Pure Python, no Redis/etcd/etc needed
  • Same code for dev and prod: No systemd unit files required

Configuration

SingleServer(
    name="my-service",                    # Identifier for logging
    command=["python", "server.py", ...], # Command to run ({port} is replaced)

    # Server address
    port=8765,                           # TCP port
    # OR
    socket="/tmp/my-service.sock",       # Unix socket (faster, more secure)

    # Health checks
    health_check_url="/",                # URL to poll for readiness
    health_check_interval=5.0,           # Seconds between checks
    startup_timeout=30.0,                # Max seconds to wait for startup

    # Restart behavior
    restart_on_failure=True,             # Auto-restart if process dies
    max_restarts=3,                      # Give up after N restarts
    restart_delay=1.0,                   # Seconds between restart attempts

    # Process options
    env={"DATABASE_URL": "..."},         # Environment variables
    cwd="/app",                          # Working directory
    stdout="/var/log/my-service.log",    # Log file
    stderr="stdout",                     # Redirect stderr to stdout

    # Shutdown
    shutdown_timeout=10.0,               # Seconds for graceful stop
)

Use Cases

Internal API server

from singleserver import SingleServer

api = SingleServer(
    name="internal-api",
    command=["python", "-m", "internal_api", "-p", "{port}"],
    port=8765,
)

def my_view(request):
    with api.connect() as client:
        data = client.get("/query").json()
    return JsonResponse(data)

Background service

service = SingleServer(
    name="background-service",
    command=["python", "service.py", "--port", "{port}"],
    port=8888,
    health_check_url="/health",
    restart_on_failure=True,
)

How It Works

  1. Lock acquisition: Uses a separate socket (port + 10000 by default) for coordination
  2. Process management: Owner spawns subprocess in new process group
  3. Health monitoring: Background thread polls health endpoint
  4. Restart logic: Configurable restart attempts with delay
  5. Cleanup: atexit handler and signal handlers for clean shutdown

Development

# Install dev dependencies
uv sync --all-extras

# Run tests
uv run pytest

# Type checking
uv run mypy singleserver

# Linting
uv run ruff check singleserver tests

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

singleserver-0.2.0.tar.gz (75.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

singleserver-0.2.0-py3-none-any.whl (17.7 kB view details)

Uploaded Python 3

File details

Details for the file singleserver-0.2.0.tar.gz.

File metadata

  • Download URL: singleserver-0.2.0.tar.gz
  • Upload date:
  • Size: 75.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.9.2

File hashes

Hashes for singleserver-0.2.0.tar.gz
Algorithm Hash digest
SHA256 1e9c94496108cae90e94a11f821183d1ea1a4a7ff90aa0ac7dd9fb5f60af8482
MD5 836868c6226e4ccb4cf0d99ccef27e6d
BLAKE2b-256 17049d05409c82a513279933ab551c89e74e0e6675d2c859b47d192bec92495d

See more details on using hashes here.

File details

Details for the file singleserver-0.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for singleserver-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 694ad2aeb5d7ffb6db0ee2b5b3d41a5b42562648109cc7f7276a1532387954c5
MD5 9ffa73f4306e46b94b44e1f2aaa85844
BLAKE2b-256 e84e1760e393ab9847d590881175a7c528aecf1af3604cc974dfdb4516dabff9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page