Skip to main content

Server implementation for LangGate AI Gateway

Project description

LangGate Server

Server implementation for the LangGate AI Gateway. This package provides the FastAPI server implementation that hosts the LangGate registry API.

Features

  • FastAPI-based API server
  • Registry endpoints for model information
  • Configurable settings through environment variables or config files
  • Structured logging with request context

Usage

# Run the server with uvicorn
import uvicorn
from langgate.server import app

if __name__ == "__main__":
    uvicorn.run(app, host="0.0.0.0", port=4000)

Docker Deployment

The LangGate repository includes a Dockerfile specifically for running this server:

# Build the Docker image
docker build -t langgate-server .

# Run the container
docker run -p 4000:4000 langgate-server

You can also use the provided Docker Compose setup for a complete deployment (which runs the server behind an Envoy proxy on port 10000):

# Start the full LangGate stack
make compose-up

# For development with hot reloading
make compose-dev

Configuration

The server can be configured through:

  • Environment variables
  • A .env file in your working directory
  • A langgate_config.yaml file in your working directory
  • Command-line arguments to the uvicorn server

See the main LangGate documentation for more details on configuration options.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

langgate_server-0.1.0.tar.gz (5.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

langgate_server-0.1.0-py3-none-any.whl (8.2 kB view details)

Uploaded Python 3

File details

Details for the file langgate_server-0.1.0.tar.gz.

File metadata

  • Download URL: langgate_server-0.1.0.tar.gz
  • Upload date:
  • Size: 5.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.6.8

File hashes

Hashes for langgate_server-0.1.0.tar.gz
Algorithm Hash digest
SHA256 ae21a557a491408497de7ef3d7121a2208e68ba84cec59141356e873fe9ddaed
MD5 15d77b3bf1f68eae49a3866c40c03e7f
BLAKE2b-256 c065d1973e294287dcda4be2fefbd634e3fafc264f424c1bce42585d9c171c24

See more details on using hashes here.

File details

Details for the file langgate_server-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for langgate_server-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 eb21c3558e1e92455549cf07789061df4e62c4ab3fecbc13816100e951d19ab2
MD5 99cb8f32bf6331034b0bf77cfef772cf
BLAKE2b-256 365e0b7580f9d7788c1882523c70f43905fff3075ad6989a774e6f14c28ea9ba

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page