warpllm

A warp-speed, robust AI gateway written for rust, node, and python applications - built for planet scale by the community.

Mission

This project is to lay out the most resilient open source productionization layer for AI-deployments. Designed for you if you want:

To work with multiple AI providers or your own models.
To keep your AI services up and running with 0 downtime.
Speed (minimal overhead latency).
A granular view of your metrics (uptime, P95 latency, costs, etc).
Control over:
1. Where your data goes.
2. Your AI budget across providers.

Status

[!IMPORTANT] The published packages are 0.2.0, which adds the provider registry — DeepSeek and OpenRouter alongside OpenAI, reached through provider/model routing strings. It is a breaking release: chat_completion is now chat_completions, and most of the public surface moved. See the changelog before upgrading from 0.1.x.

The OpenAI-compatible HTTP gateway has landed on main but is not released yet. Streaming is not implemented.

Install the published SDK:

cargo add warpllm                # rust
pip install warpllm              # python
npm install @warpllm/warpllm     # node

	Released (0.2.0)	On `main`
OpenAI chat completions, non-streaming	Yes	Yes
`provider/model` routing strings	Provider registry	Provider registry
DeepSeek, OpenRouter	Yes	Yes
OpenAI-compatible HTTP gateway	—	Unreleased
Streaming	—	—
Failover, load balancing, caching, metrics	—	—

Unlisted models are rejected rather than guessed at, so routing a name warpllm doesn't know is an error, not a surprise upstream bill.

Layers

An SDK - provide a request and we translate it to work with different providers and models out of box.
[Unreleased] A proxy - run a self-hosted proxy that speaks the OpenAI API:
1. [Coming Soon] Failover - define multiple models to handle outages / errors
2. [Coming Soon] Load Balancing - define a % of requests to be handled per model
3. [Coming Soon] Prompt Response Caching - define a TTL and avoid paying twice for the same prompt

Key focus points

Native SDK support - Written once in rust, compiled for maximum performance, available for rust/typescript/python.
Self hostable - Avoid vendor lock-in (e.g. from cloud provider or model provider), or data leaving your infra.
Warp-speed execution - What we named ourselves after. Machine level code, faster than a typescript or python native library.
Compact file size - Pre-compiled into binary format, not verbose text files.

Roadmap

The roadmap lives in GitHub issues — one issue per item, so direction is discussed where the work happens. Add a comment if you see something missing, or if something there matters enough to you that it should move up.

Contributing

We're excited to have you join us. See the contribution guide for how to get started.

A big thank you to the contributors below who have helped build this AI gateway to this point!

License

The warpllm core is open source under the Apache License 2.0.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

warpllm-0.2.0.tar.gz (181.3 kB view details)

Uploaded Aug 9, 2026 Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

warpllm-0.2.0-cp310-abi3-win_arm64.whl (2.1 MB view details)

Uploaded Aug 9, 2026 CPython 3.10+Windows ARM64

warpllm-0.2.0-cp310-abi3-win_amd64.whl (2.2 MB view details)

Uploaded Aug 9, 2026 CPython 3.10+Windows x86-64

warpllm-0.2.0-cp310-abi3-musllinux_1_2_x86_64.whl (2.5 MB view details)

Uploaded Aug 9, 2026 CPython 3.10+musllinux: musl 1.2+ x86-64

warpllm-0.2.0-cp310-abi3-musllinux_1_2_aarch64.whl (2.3 MB view details)

Uploaded Aug 9, 2026 CPython 3.10+musllinux: musl 1.2+ ARM64

warpllm-0.2.0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3 MB view details)

Uploaded Aug 9, 2026 CPython 3.10+manylinux: glibc 2.17+ x86-64

warpllm-0.2.0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (2.2 MB view details)

Uploaded Aug 9, 2026 CPython 3.10+manylinux: glibc 2.17+ ARM64

warpllm-0.2.0-cp310-abi3-macosx_11_0_arm64.whl (2.0 MB view details)

Uploaded Aug 9, 2026 CPython 3.10+macOS 11.0+ ARM64

warpllm-0.2.0-cp310-abi3-macosx_10_12_x86_64.whl (2.1 MB view details)

Uploaded Aug 9, 2026 CPython 3.10+macOS 10.12+ x86-64

File details

Details for the file warpllm-0.2.0.tar.gz.

File metadata

Download URL: warpllm-0.2.0.tar.gz
Upload date: Aug 9, 2026
Size: 181.3 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for warpllm-0.2.0.tar.gz
Algorithm	Hash digest
SHA256	`ece9183503a717c406b3d648769a1241c668bdd26821045b673ed35929e7a0e0`
MD5	`7354ac97f314f12aacd421aceeb2cc56`
BLAKE2b-256	`b330551386fa199c9dc39eb5281216be730c40f71d15e11ecbd79013a333696a`

See more details on using hashes here.

Provenance

The following attestation bundles were made for warpllm-0.2.0.tar.gz:

Publisher: release-python.yml on warpllm/warpllm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: warpllm-0.2.0.tar.gz
- Subject digest: ece9183503a717c406b3d648769a1241c668bdd26821045b673ed35929e7a0e0
- Sigstore transparency entry: 2399589706
- Sigstore integration time: Aug 9, 2026
Source repository:
- Permalink: warpllm/warpllm@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Branch / Tag: refs/tags/v0.2.0
- Owner: https://github.com/warpllm
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release-python.yml@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Trigger Event: push

File details

Details for the file warpllm-0.2.0-cp310-abi3-win_arm64.whl.

File metadata

Download URL: warpllm-0.2.0-cp310-abi3-win_arm64.whl
Upload date: Aug 9, 2026
Size: 2.1 MB
Tags: CPython 3.10+, Windows ARM64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for warpllm-0.2.0-cp310-abi3-win_arm64.whl
Algorithm	Hash digest
SHA256	`cede84c77141e855a585a774c31684be496c5e04109b784434099802b69180b5`
MD5	`cd8f85fbe27f6072f17644d594a8a0cf`
BLAKE2b-256	`0df193302526fccfd6a8441cd8e64be1eaf80b0ec152b7856752af4f5203e656`

See more details on using hashes here.

Provenance

The following attestation bundles were made for warpllm-0.2.0-cp310-abi3-win_arm64.whl:

Publisher: release-python.yml on warpllm/warpllm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: warpllm-0.2.0-cp310-abi3-win_arm64.whl
- Subject digest: cede84c77141e855a585a774c31684be496c5e04109b784434099802b69180b5
- Sigstore transparency entry: 2399591834
- Sigstore integration time: Aug 9, 2026
Source repository:
- Permalink: warpllm/warpllm@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Branch / Tag: refs/tags/v0.2.0
- Owner: https://github.com/warpllm
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release-python.yml@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Trigger Event: push

File details

Details for the file warpllm-0.2.0-cp310-abi3-win_amd64.whl.

File metadata

Download URL: warpllm-0.2.0-cp310-abi3-win_amd64.whl
Upload date: Aug 9, 2026
Size: 2.2 MB
Tags: CPython 3.10+, Windows x86-64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for warpllm-0.2.0-cp310-abi3-win_amd64.whl
Algorithm	Hash digest
SHA256	`556668ca1a3761591af42a3e2dadab7dfd92afb97d1159ed5158b935c9fa6fa0`
MD5	`6823cd90719912ed061dc39165ae0140`
BLAKE2b-256	`dd925da660df81692fba268275215aa4118c18802016eb8d07d55f26ead6039b`

See more details on using hashes here.

Provenance

The following attestation bundles were made for warpllm-0.2.0-cp310-abi3-win_amd64.whl:

Publisher: release-python.yml on warpllm/warpllm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: warpllm-0.2.0-cp310-abi3-win_amd64.whl
- Subject digest: 556668ca1a3761591af42a3e2dadab7dfd92afb97d1159ed5158b935c9fa6fa0
- Sigstore transparency entry: 2399590313
- Sigstore integration time: Aug 9, 2026
Source repository:
- Permalink: warpllm/warpllm@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Branch / Tag: refs/tags/v0.2.0
- Owner: https://github.com/warpllm
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release-python.yml@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Trigger Event: push

File details

Details for the file warpllm-0.2.0-cp310-abi3-musllinux_1_2_x86_64.whl.

File metadata

Download URL: warpllm-0.2.0-cp310-abi3-musllinux_1_2_x86_64.whl
Upload date: Aug 9, 2026
Size: 2.5 MB
Tags: CPython 3.10+, musllinux: musl 1.2+ x86-64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for warpllm-0.2.0-cp310-abi3-musllinux_1_2_x86_64.whl
Algorithm	Hash digest
SHA256	`f76fee03eb8e0d4f93703c90029250e53dcf029d97ea5f1d2ce187cfec31c657`
MD5	`ee40e564de7d9960688050e30a62b98f`
BLAKE2b-256	`80fb3847632c1e5932b297a0a74a32d4b9c2a84acc35972d2c787cd6e053206a`

See more details on using hashes here.

Provenance

The following attestation bundles were made for warpllm-0.2.0-cp310-abi3-musllinux_1_2_x86_64.whl:

Publisher: release-python.yml on warpllm/warpllm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: warpllm-0.2.0-cp310-abi3-musllinux_1_2_x86_64.whl
- Subject digest: f76fee03eb8e0d4f93703c90029250e53dcf029d97ea5f1d2ce187cfec31c657
- Sigstore transparency entry: 2399591457
- Sigstore integration time: Aug 9, 2026
Source repository:
- Permalink: warpllm/warpllm@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Branch / Tag: refs/tags/v0.2.0
- Owner: https://github.com/warpllm
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release-python.yml@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Trigger Event: push

File details

Details for the file warpllm-0.2.0-cp310-abi3-musllinux_1_2_aarch64.whl.

File metadata

Download URL: warpllm-0.2.0-cp310-abi3-musllinux_1_2_aarch64.whl
Upload date: Aug 9, 2026
Size: 2.3 MB
Tags: CPython 3.10+, musllinux: musl 1.2+ ARM64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for warpllm-0.2.0-cp310-abi3-musllinux_1_2_aarch64.whl
Algorithm	Hash digest
SHA256	`24ba4bb72ba2d57c7a46d8b491c55005be1929593463a832f60a36e18fea1727`
MD5	`e97d872e891a3ae1d7f269b4a642a87c`
BLAKE2b-256	`31f39f58c649faa1cd149b59530396b94c079dfe1d5bc1d13413a6d9893a50cc`

See more details on using hashes here.

Provenance

The following attestation bundles were made for warpllm-0.2.0-cp310-abi3-musllinux_1_2_aarch64.whl:

Publisher: release-python.yml on warpllm/warpllm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: warpllm-0.2.0-cp310-abi3-musllinux_1_2_aarch64.whl
- Subject digest: 24ba4bb72ba2d57c7a46d8b491c55005be1929593463a832f60a36e18fea1727
- Sigstore transparency entry: 2399590610
- Sigstore integration time: Aug 9, 2026
Source repository:
- Permalink: warpllm/warpllm@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Branch / Tag: refs/tags/v0.2.0
- Owner: https://github.com/warpllm
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release-python.yml@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Trigger Event: push

File details

Details for the file warpllm-0.2.0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

Download URL: warpllm-0.2.0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Upload date: Aug 9, 2026
Size: 2.3 MB
Tags: CPython 3.10+, manylinux: glibc 2.17+ x86-64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for warpllm-0.2.0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`0300cd143738c2e84073e5a45522ed4e8666540a97d4af2c11017a93e1e6a062`
MD5	`f0658d7755ca604cf97cec12503c9cfe`
BLAKE2b-256	`828e6c80045b35f9236928a80b3508a2e58f0536a7a6ab6a7b0cce71e858e4ca`

See more details on using hashes here.

Provenance

The following attestation bundles were made for warpllm-0.2.0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release-python.yml on warpllm/warpllm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: warpllm-0.2.0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Subject digest: 0300cd143738c2e84073e5a45522ed4e8666540a97d4af2c11017a93e1e6a062
- Sigstore transparency entry: 2399591062
- Sigstore integration time: Aug 9, 2026
Source repository:
- Permalink: warpllm/warpllm@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Branch / Tag: refs/tags/v0.2.0
- Owner: https://github.com/warpllm
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release-python.yml@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Trigger Event: push

File details

Details for the file warpllm-0.2.0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

Download URL: warpllm-0.2.0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Upload date: Aug 9, 2026
Size: 2.2 MB
Tags: CPython 3.10+, manylinux: glibc 2.17+ ARM64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for warpllm-0.2.0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm	Hash digest
SHA256	`f3010796a5486ca01216ea8cb106d60b4022eeee08bb31cbe6d363d02a45522d`
MD5	`4e92f382053ee909ceb8a9c6fb20970a`
BLAKE2b-256	`a3456f2bcf875b0e206aee6494cf3afd79fe57ef70187702ac235ebd4eb279c5`

See more details on using hashes here.

Provenance

The following attestation bundles were made for warpllm-0.2.0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release-python.yml on warpllm/warpllm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: warpllm-0.2.0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
- Subject digest: f3010796a5486ca01216ea8cb106d60b4022eeee08bb31cbe6d363d02a45522d
- Sigstore transparency entry: 2399591303
- Sigstore integration time: Aug 9, 2026
Source repository:
- Permalink: warpllm/warpllm@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Branch / Tag: refs/tags/v0.2.0
- Owner: https://github.com/warpllm
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release-python.yml@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Trigger Event: push

File details

Details for the file warpllm-0.2.0-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

Download URL: warpllm-0.2.0-cp310-abi3-macosx_11_0_arm64.whl
Upload date: Aug 9, 2026
Size: 2.0 MB
Tags: CPython 3.10+, macOS 11.0+ ARM64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for warpllm-0.2.0-cp310-abi3-macosx_11_0_arm64.whl
Algorithm	Hash digest
SHA256	`f6bd97ae2c1589e2508b5e16507df2c69bc1f42e047fe4f00bac1acc2916fd32`
MD5	`781c4eb146f6c132f01bc8c6bfe61a24`
BLAKE2b-256	`86411d9d5b7da3a7ced6737201673d4472567ce1469b993ed82a04349eaf86bb`

See more details on using hashes here.

Provenance

The following attestation bundles were made for warpllm-0.2.0-cp310-abi3-macosx_11_0_arm64.whl:

Publisher: release-python.yml on warpllm/warpllm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: warpllm-0.2.0-cp310-abi3-macosx_11_0_arm64.whl
- Subject digest: f6bd97ae2c1589e2508b5e16507df2c69bc1f42e047fe4f00bac1acc2916fd32
- Sigstore transparency entry: 2399591973
- Sigstore integration time: Aug 9, 2026
Source repository:
- Permalink: warpllm/warpllm@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Branch / Tag: refs/tags/v0.2.0
- Owner: https://github.com/warpllm
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release-python.yml@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Trigger Event: push

File details

Details for the file warpllm-0.2.0-cp310-abi3-macosx_10_12_x86_64.whl.

File metadata

Download URL: warpllm-0.2.0-cp310-abi3-macosx_10_12_x86_64.whl
Upload date: Aug 9, 2026
Size: 2.1 MB
Tags: CPython 3.10+, macOS 10.12+ x86-64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for warpllm-0.2.0-cp310-abi3-macosx_10_12_x86_64.whl
Algorithm	Hash digest
SHA256	`d87e883971bcd572bbcd9d4cdd53fc02ff225e37645f81afb2ef79047cc38019`
MD5	`bec57600170d03f610d4d58a00c10cc0`
BLAKE2b-256	`2f448b6a71f62cc2edfa21892eed561a4870a7daf98ede7c97831d3fd76c0bfc`

See more details on using hashes here.

Provenance

The following attestation bundles were made for warpllm-0.2.0-cp310-abi3-macosx_10_12_x86_64.whl:

Publisher: release-python.yml on warpllm/warpllm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: warpllm-0.2.0-cp310-abi3-macosx_10_12_x86_64.whl
- Subject digest: d87e883971bcd572bbcd9d4cdd53fc02ff225e37645f81afb2ef79047cc38019
- Sigstore transparency entry: 2399592361
- Sigstore integration time: Aug 9, 2026
Source repository:
- Permalink: warpllm/warpllm@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Branch / Tag: refs/tags/v0.2.0
- Owner: https://github.com/warpllm
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release-python.yml@438f38c4c0cf70f4ccb7abfb0e98a50bffc03929
- Trigger Event: push

Release history Release notifications | RSS feed

This release

0.2.0

Aug 9, 2026

0.1.4

Jul 16, 2026

0.1.3

Jul 15, 2026

0.1.2

Jul 15, 2026

0.1.0

Jul 15, 2026

warpllm 0.2.0

warpllm

Mission

Status

Layers

Key focus points

Roadmap

Contributing

License

Key dates

1 maintainer

License expression

Requires

Classifiers

Download files

Source Distribution

Built Distributions

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

Release history Release notifications | RSS feed