Skip to main content

Server implementation for LangGate AI Gateway

Project description

LangGate Server

Server implementation for the LangGate AI Gateway. This package provides the FastAPI server implementation that hosts the LangGate registry API.

Features

  • FastAPI-based API server
  • Registry endpoints for model information
  • Configurable settings through environment variables or config files
  • Structured logging with request context

Usage

# Run the server with uvicorn
import uvicorn
from langgate.server import app

if __name__ == "__main__":
    uvicorn.run(app, host="0.0.0.0", port=4000)

Docker Deployment

The LangGate repository includes a Dockerfile specifically for running this server:

# Build the Docker image
docker build -t langgate-server .

# Run the container
docker run -p 4000:4000 langgate-server

You can also use the provided Docker Compose setup for a complete deployment (which runs the server behind an Envoy proxy on port 10000):

# Start the full LangGate stack
make compose-up

# For development with hot reloading
make compose-dev

Configuration

The server can be configured through:

  • Environment variables
  • A .env file in your working directory
  • A langgate_config.yaml file in your working directory
  • Command-line arguments to the uvicorn server

See the main LangGate documentation for more details on configuration options.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

langgate_server-0.1.5.tar.gz (5.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

langgate_server-0.1.5-py3-none-any.whl (8.2 kB view details)

Uploaded Python 3

File details

Details for the file langgate_server-0.1.5.tar.gz.

File metadata

  • Download URL: langgate_server-0.1.5.tar.gz
  • Upload date:
  • Size: 5.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.6.9

File hashes

Hashes for langgate_server-0.1.5.tar.gz
Algorithm Hash digest
SHA256 cfa113b6b00d1b12375f0b91e8c4cdd54acadbc8fdbd689f7144a10465342981
MD5 2a1f35cf3f7910e6980b4ed68797bee7
BLAKE2b-256 3eeae396d70caa2dc66de4e6d9898980ebb42ebfcb49af1f4f5b3044e5e4ceca

See more details on using hashes here.

File details

Details for the file langgate_server-0.1.5-py3-none-any.whl.

File metadata

File hashes

Hashes for langgate_server-0.1.5-py3-none-any.whl
Algorithm Hash digest
SHA256 3125b2a463383541755f73c661841888334c9ce2cc030ab4b0234155ee42a305
MD5 75ba1997322f42d982991ad845eee231
BLAKE2b-256 91f6ddd3a7c90f3acae488076881b46348284a6a6aac0da4b948d7b55a27e872

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page