OGX
Quick Start | Documentation | OpenAI API Compatibility | Discord
Open-source agentic API server for building AI applications. OpenAI-compatible. Any model, any infrastructure.
OGX is a drop-in replacement for the OpenAI API that you can run anywhere — your laptop, your datacenter, or the cloud. Use any OpenAI-compatible client or agentic framework. Swap between Llama, GPT, Gemini, Mistral, or any model without changing your application code.
from openai import OpenAI
client = OpenAI(base_url="http://localhost:8321/v1", api_key="fake")
response = client.chat.completions.create(
model="llama-3.3-70b",
messages=[{"role": "user", "content": "Hello"}],
)
What you get
- Chat Completions & Embeddings — standard
/v1/chat/completions,/v1/completions, and/v1/embeddingsendpoints, compatible with any OpenAI client - Responses API — server-side agentic orchestration with tool calling, MCP server integration, and built-in file search (RAG) in a single API call (learn more)
- Vector Stores & Files —
/v1/vector_storesand/v1/filesfor managed document storage and search - Batches —
/v1/batchesfor offline batch processing - Skills —
/v1alpha/skillsfor managing versioned skill bundles (zip archives with SKILL.md manifests) that agents can invoke - Open Responses conformant — the Responses API implementation passes the Open Responses conformance test suite
- Multi-SDK support — use the Anthropic SDK (
/v1/messages) or Google GenAI SDK (/v1alpha/interactions) natively alongside the OpenAI API
Use any model, use any infrastructure
OGX has a pluggable provider architecture. Develop locally with Ollama, deploy to production with vLLM, or connect to a managed service — the API stays the same.
See the provider documentation for the full list.
Get started
Install and run a OGX server:
# One-line install
curl -LsSf https://github.com/ogx-ai/ogx/raw/main/scripts/install.sh | bash
# Or install via uv
uv pip install ogx
# Start the server (auto-detects providers from the environment)
uv run ogx go
Then connect with any OpenAI, Anthropic, or Google GenAI client — Python, TypeScript, curl, or any framework that speaks these APIs.
See the Quick Start guide for detailed setup.
Resources
- Documentation — full reference
- OpenAI API Compatibility — endpoint coverage and provider matrix
- Getting Started Notebook — text and vision inference walkthrough
- Contributing — how to contribute
Client SDKs:
OGX provides official client SDKs for Python and TypeScript:
| Language | SDK | Package |
|---|---|---|
| Python | ogx-client-python |  |
| TypeScript | ogx-client-typescript |  |
Alternative Python SDK:
For users who prefer an OpenAPI Generator-based SDK, an alternative Python client is available:
- ogx-open-client — Auto-generated from OpenAPI spec, provides similar functionality with a different generation approach
- Usage Examples — End-to-end code examples for all major features
- Strategy & Rationale — Why two SDKs, when to use which, and long-term plans
The official ogx_client SDK is recommended for most use cases. The ogx_open_client package offers an alternative for teams with specific OpenAPI tooling requirements.
Community
We hold regular community calls every Thursday at 09:00 AM PST — see the Community Event on Discord for details.
Thanks to all our amazing contributors!
4 maintainers
Metadata
4 maintainers
Release files for ogx 1.4.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| ogx-1.4.1.tar.gz | 18.7 MB | With provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| ogx-1.4.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 19.6 MB
Release files / ogx-1.4.1.tar.gz
| Download URL | ogx-1.4.1.tar.gz |
|---|---|
| Size | 18.7 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
25368d869b575ab9f372d3492f66613ef4d01b0bafa0eccd657d500d7378d16a
|
|
BLAKE2b-256 checksum How to use checksums |
cc066515b5537ca91271a349850ae082cdd9a483a7de73bc426b329724b23bad
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.13
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 19, 2026.
Transparency logRelease files / ogx-1.4.1-py3-none-any.whl
| Download URL | ogx-1.4.1-py3-none-any.whl |
|---|---|
| Size | 842.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
30bcf9e2ebae95f6b30c9123d74d095a7db271c969dd8a2942385978ca1ed5e0
|
|
BLAKE2b-256 checksum How to use checksums |
9c08346b3cf13f2256e8875f1fce1491f7d108aaef7ff20e1ba30255785589b5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.13
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 19, 2026.
Transparency logSecurity for ogx 1.4.1
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Full provenance
All 2 files in this release have been uploaded with provenance metadata.
Attestation for ogx-1.4.1.tar.gz
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 19, 2026.
Transparency logA note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
