LangGraph OpenAI Serve

Serve LangGraph graphs through an OpenAI-compatible /v1 API so existing OpenAI SDKs, Chainlit, Open WebUI, and similar clients can call them without a project-specific protocol.

Install

Use uv for project dependency management:

uv add langgraph-openai-serve

The equivalent pip command is:

pip install langgraph-openai-serve

For interrupt-enabled deployments that use PostgreSQL for checkpointing and cross-worker run coordination, install the optional integration:

uv add "langgraph-openai-serve[postgres]"

For built-in Langfuse tracing, install the tracing integration:

uv add "langgraph-openai-serve[tracing]"

Set LGOS_ENABLE_LANGFUSE=true together with LANGFUSE_PUBLIC_KEY and LANGFUSE_SECRET_KEY. LGOS creates the callback lazily on the first graph run; importing the package never initializes Langfuse.

The package contains the OpenAI-compatible server integration, not a built-in LLM graph. Applications register their own graphs. The demo/ checkout keeps each deployable application in an independent uv project with its own lockfile. Its lgos-rag example indexes a small corpus packaged with the demo API, so the entire directory can be copied and run without files from this repository.

Quick Demo

From this repository, prepare the demo environment and PostgreSQL:

cd demo
cp .env.example .env
docker compose -f compose.yaml up -d lgos-db
uv run --directory api --env-file ../.env \
  --locked --with-editable ../.. lgos-demo-api-setup
uv run --directory api --env-file ../.env \
  --locked --with-editable ../.. lgos-demo-api

Then call the demo with the OpenAI Python client:

from openai import OpenAI

client = OpenAI(base_url="http://localhost:8000/v1", api_key="DUMMY")

response = client.chat.completions.create(
    model="custom-input-output-context",
    messages=[{"role": "user", "content": "Show me custom schemas."}],
    user="demo-user",
)

print(response.choices[0].message.content)

Use curl http://localhost:8000/v1/models only as a diagnostic to inspect the registered demo graph names.

The optional editable overlay tests this checkout without changing the self-contained demo project or its lockfile. The demo publishes independent API and Chainlit images and uses official images for third-party services such as Open WebUI. See the demo Docker Compose guide.

The demo also includes a PostgreSQL-persistent Chainlit client. It uses a shared mock login by default, with PocketID OAuth available as an opt-in mode. See the Chainlit demo.

Use In FastAPI

from fastapi import FastAPI
from langgraph_openai_serve import GraphConfig, GraphRegistry, LanggraphOpenaiServe
from your_graphs import my_graph

app = FastAPI()
graphs = GraphRegistry(
    registry={
        "my-graph": GraphConfig(
            graph=my_graph,
            description="Answer questions with my LangGraph workflow.",
            streamable_node_names=["generate"],
        )
    }
)

LanggraphOpenaiServe(app=app, graphs=graphs).bind_openai_api()

The default base URL is {host}/v1. Registered graph names become OpenAI model values.

Docs

Documentation home: docs/index.md
Package getting started: docs/getting-started.md
Self-contained demo stack: docs/demo/index.md
Runnable demo API: docs/demo/api.md
Demo graph catalog: docs/demo/graphs.md
OpenAI clients: docs/tutorials/openai-clients.md
Custom graphs: docs/tutorials/custom-graphs.md
LangGraph runtime settings: docs/how-to-guides/langgraph-runtime-settings.md
OpenAI-compatible proxies: docs/how-to-guides/openai-proxies.md
API and configuration: docs/reference.md
Compatibility contract: docs/explanation/openai-compatibility.md

Release files for langgraph_openai_serve 0.10.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for langgraph_openai_serve 0.10.1
File	Size	Uploaded
langgraph_openai_serve-0.10.1.tar.gz	32.9 kB	Aug 17, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for langgraph_openai_serve 0.10.1
File	Interpreter	ABI	Platform	Reset
langgraph_openai_serve-0.10.1-py3-none-any.whl 49.0 kB Aug 17, 2026	Python 3	none	any	Details

Total release size: 81.9 kB

Release files / langgraph_openai_serve-0.10.1.tar.gz

Download URL	langgraph_openai_serve-0.10.1.tar.gz
Size	32.9 kB
Tags	Source
SHA-256 checksum How to use checksums	`899b6dc24dcf424dbc221446485026912dd890e4050ba15f69946a5765c851a9`
BLAKE2b-256 checksum How to use checksums	`b19dbbdf3da39df4ae57d5700b0e95d1d2fb973482824b4dec443d441cc94ee1`
Upload date	Aug 17, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`uv/0.12.1 {"installer":{"name":"uv","version":"0.12.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`

Release files / langgraph_openai_serve-0.10.1-py3-none-any.whl

Download URL	langgraph_openai_serve-0.10.1-py3-none-any.whl
Size	49.0 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`f1f20bd296bdcdcb731da438b24f9a82a06b2b6082a530bca67327e992165983`
BLAKE2b-256 checksum How to use checksums	`616018a6865c7b0bdd5fa298fd83e6f426760245ac83ed4b489c4a47636196fd`
Upload date	Aug 17, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`uv/0.12.1 {"installer":{"name":"uv","version":"0.12.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`