Skip to main content

Server implementation for LangGate AI Gateway

Project description

LangGate Server

Server implementation for the LangGate AI Gateway. This package provides the FastAPI server implementation that hosts the LangGate registry API.

Features

  • FastAPI-based API server
  • Registry endpoints for model information
  • Configurable settings through environment variables or config files
  • Structured logging with request context

Usage

# Run the server with uvicorn
import uvicorn
from langgate.server import app

if __name__ == "__main__":
    uvicorn.run(app, host="0.0.0.0", port=4000)

Docker Deployment

The LangGate repository includes a Dockerfile specifically for running this server:

# Build the Docker image
docker build -t langgate-server .

# Run the container
docker run -p 4000:4000 langgate-server

You can also use the provided Docker Compose setup for a complete deployment (which runs the server behind an Envoy proxy on port 10000):

# Start the full LangGate stack
make compose-up

# For development with hot reloading
make compose-dev

Configuration

The server can be configured through:

  • Environment variables
  • A .env file in your working directory
  • A langgate_config.yaml file in your working directory
  • Command-line arguments to the uvicorn server

See the main LangGate documentation for more details on configuration options.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

langgate_server-0.3.3.tar.gz (5.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

langgate_server-0.3.3-py3-none-any.whl (8.3 kB view details)

Uploaded Python 3

File details

Details for the file langgate_server-0.3.3.tar.gz.

File metadata

  • Download URL: langgate_server-0.3.3.tar.gz
  • Upload date:
  • Size: 5.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.6.9

File hashes

Hashes for langgate_server-0.3.3.tar.gz
Algorithm Hash digest
SHA256 7edf7c6aeb46c15edd8177e5626a62bc3221317953d2971cd715b351978504ee
MD5 3d6262cd197f30ce55f5325fec9cddb0
BLAKE2b-256 7a1bead4502484209e528c4a87b12eff35a3453a2b016333cea6e24e913fecc8

See more details on using hashes here.

File details

Details for the file langgate_server-0.3.3-py3-none-any.whl.

File metadata

File hashes

Hashes for langgate_server-0.3.3-py3-none-any.whl
Algorithm Hash digest
SHA256 055d9ed3182f835d9d629d254047171fc6df6bd67ed2886f6ba2d1078aebe0a8
MD5 a53f565c2605cdd5cc56cf5e7b6811fd
BLAKE2b-256 d55cc8fe22899d2fd5afcc7a9674df98a7a8bac3e4b2d9dbf223fdffa13ec9e0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page