Skip to main content

vLLM Agentic API

Agentic API is a Rust-native gateway for OpenAI-compatible inference servers. It provides the Responses API with conversation state, tool execution, streaming, and continuation. Point it at an existing vLLM server to use open models with your applications and coding clients.

The agentic-api Python package includes the Rust gateway, the agentic CLI, and a Python launcher. The base installation does not install vLLM or GPU dependencies.

Install

Requires Python 3.10 or newer. Prebuilt wheels are available for Linux x86_64 (glibc 2.17 or newer), macOS Intel, and macOS Apple Silicon.

python -m pip install agentic-api
python -m agentic_api --version

Start the server

With an inference server already running at http://127.0.0.1:8000:

python -m agentic_api serve --vllm-base-url http://127.0.0.1:8000

The gateway listens on port 9000 by default. Send Responses API requests to http://127.0.0.1:9000/v1/responses.

To install the pinned vLLM runtime and let the launcher manage a local inference process on a supported Linux host:

python -m pip install 'agentic-api[local]'
python -m agentic_api serve --model MODEL_ID

Run python -m agentic_api doctor --mode remote --json to check your installation.

Learn more

Metadata

Release files for agentic-api 0.10.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for agentic-api 0.10.0
File Interpreter ABI Platform Actions
agentic_api-0.10.0-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl Python 3 none Linux glibc 2.17+ x86-64 Details for agentic_api-0.10.0-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
agentic_api-0.10.0-py3-none-macosx_11_0_arm64.whl Python 3 none macOS 11.0+ ARM64 Details for agentic_api-0.10.0-py3-none-macosx_11_0_arm64.whl
agentic_api-0.10.0-py3-none-macosx_10_12_x86_64.whl Python 3 none macOS 10.12+ x86-64 Details for agentic_api-0.10.0-py3-none-macosx_10_12_x86_64.whl

Total release size: 78.8 MB

Release files / agentic_api-0.10.0-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL agentic_api-0.10.0-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 30.0 MB
Tags Linux glibc 2.17+ x86-64 Python 3
SHA-256 checksum
How to use checksums
2fde7eeaf1bf30af4b9bf9ad13479f275046ffbbe03f530eb5615e9da0e4e5dc
BLAKE2b-256 checksum
How to use checksums
413ac9c7ea4cde600dba21d25ba4bce486f8edaa82ea77553e79139f5f275717
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 9, 2026.

Transparency log

Release files / agentic_api-0.10.0-py3-none-macosx_11_0_arm64.whl

Download URL agentic_api-0.10.0-py3-none-macosx_11_0_arm64.whl
Size 24.0 MB
Tags Python 3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
2bdc70f34536556b1443352de105768cb6e79ef1be9830534eb6c665fe164a4b
BLAKE2b-256 checksum
How to use checksums
5ceb3000beefdcb8a55921f89e466cf2726653b2ac6636341a62b50e2e2bf358
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 9, 2026.

Transparency log

Release files / agentic_api-0.10.0-py3-none-macosx_10_12_x86_64.whl

Download URL agentic_api-0.10.0-py3-none-macosx_10_12_x86_64.whl
Size 24.8 MB
Tags Python 3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums
f14cdecbcd55db4cfbecbe8a788a1b567ac8911ccd75b128887a72ec900fb6bf
BLAKE2b-256 checksum
How to use checksums
31217255394a56be18d8b300fed9f62992d4f925bab7bd97235d41c4c31eddc6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 9, 2026.

Transparency log

Security for agentic-api 0.10.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 3 files in this release have been uploaded with provenance metadata.

Select from 3 files

Attestation for agentic_api-0.10.0-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 9, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page