OGX
Quick Start | Documentation | OpenAI API Compatibility | Discord
Open-source agentic API server for building AI applications. OpenAI-compatible. Any model, any infrastructure.
OGX is a drop-in replacement for the OpenAI API that you can run anywhere — your laptop, your datacenter, or the cloud. Use any OpenAI-compatible client or agentic framework. Swap between Llama, GPT, Gemini, Mistral, or any model without changing your application code.
from openai import OpenAI
client = OpenAI(base_url="http://localhost:8321/v1", api_key="fake")
response = client.chat.completions.create(
model="llama-3.3-70b",
messages=[{"role": "user", "content": "Hello"}],
)
What you get
- Chat Completions & Embeddings — standard
/v1/chat/completions,/v1/completions, and/v1/embeddingsendpoints, compatible with any OpenAI client - Responses API — server-side agentic orchestration with tool calling, MCP server integration, and built-in file search (RAG) in a single API call (learn more)
- Vector Stores & Files —
/v1/vector_storesand/v1/filesfor managed document storage and search - Batches —
/v1/batchesfor offline batch processing - Open Responses conformant — the Responses API implementation passes the Open Responses conformance test suite
- Multi-SDK support — use the Anthropic SDK (
/v1/messages) or Google GenAI SDK (/v1alpha/interactions) natively alongside the OpenAI API
Use any model, use any infrastructure
OGX has a pluggable provider architecture. Develop locally with Ollama, deploy to production with vLLM, or connect to a managed service — the API stays the same.
See the provider documentation for the full list.
Get started
Install and run a OGX server:
# One-line install
curl -LsSf https://github.com/ogx-ai/ogx/raw/main/scripts/install.sh | bash
# Or install via uv
uv pip install ogx[starter]
# Start the server (uses the starter distribution with Ollama)
uv run ogx stack run starter
Then connect with any OpenAI, Anthropic, or Google GenAI client — Python, TypeScript, curl, or any framework that speaks these APIs.
See the Quick Start guide for detailed setup.
Resources
- Documentation — full reference
- OpenAI API Compatibility — endpoint coverage and provider matrix
- Getting Started Notebook — text and vision inference walkthrough
- Contributing — how to contribute
Client SDKs:
| Language | SDK | Package |
|---|---|---|
| Python | ogx-client-python |  |
| TypeScript | ogx-client-typescript |  |
Community
We hold regular community calls every Thursday at 09:00 AM PST — see the Community Event on Discord for details.
Thanks to all our amazing contributors!
4 maintainers
Metadata
4 maintainers
Release files for ogx 1.0.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| ogx-1.0.3.tar.gz | 16.9 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| ogx-1.0.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 17.6 MB
Release files / ogx-1.0.3.tar.gz
| Download URL | ogx-1.0.3.tar.gz |
|---|---|
| Size | 16.9 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
460373adb1ccfebaba7065bf5ba88e81ed914a7d4b50ece0fad2c85adcf53ee8
|
|
BLAKE2b-256 checksum How to use checksums |
3ca2808826d739fd70e30ad23236459d62103170daaf167ad49ee4add5f9f2fd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.13
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 10, 2026.
Transparency logRelease files / ogx-1.0.3-py3-none-any.whl
| Download URL | ogx-1.0.3-py3-none-any.whl |
|---|---|
| Size | 700.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
abf9322f6faafaf21be3635be8f67f8395a87ad3bde7ed68917ab0265dc430c0
|
|
BLAKE2b-256 checksum How to use checksums |
f84cf199c476ff372bcd5101d5b43d19876e88cb486c43aa7710df9286f9367d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.13
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 10, 2026.
Transparency log
