A warp-speed, robust AI gateway
Project description
warpllm
A warp-speed, robust AI gateway written for rust, node, and python applications - built for planet scale by the community.
Community
[!IMPORTANT] warpllm is community-led.
The roadmap, examples, integrations, and rough edges should be shaped in the open by the people building with it. Bring ideas, questions, provider requests, bug reports, benchmarks, and experiments.
Features
- Provider-agnostic API - switch between different providers and models without having to learn a new integration.
- [Coming Soon] Failover - define multiple models to handle outages / errors
- [Coming Soon] Load Balancing - define a % of requests to be handled per model
- [Coming Soon] You decide - post in discord or reddit! Drive the future of warpllm.
Key focus points
- Native SDK support - Written once in rust, compiled for maximum performance, available for rust/typescript/python.
- Self hostable - Avoid vendor lock-in (e.g. from the cloud provider), or data leaving your infra.
- Warp-speed execution - What we named ourselves after. Machine level code, faster than a typescript or python native library.
- Compact file size - Pre-compiled into binary format, not verbose text files.
Roadmap
Next up: streaming, more providers and endpoints, and pip/npm packages — then failover, load balancing, caching, and metrics. See the full ROADMAP.md.
Quickstart
In progress.
License
The warpllm core is open source under the Apache License 2.0.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file warpllm-0.1.2.tar.gz.
File metadata
- Download URL: warpllm-0.1.2.tar.gz
- Upload date:
- Size: 75.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
93d420300a0698db6e10310a51dcc7d9161dba9ace0317e847d77fedc5179c58
|
|
| MD5 |
bc32233ccf60bd41ac356c2b04531372
|
|
| BLAKE2b-256 |
2a1b5f16dcc95adb71e2180c4e86253825e36df475f2cc960f12460cbb74bb59
|
Provenance
The following attestation bundles were made for warpllm-0.1.2.tar.gz:
Publisher:
release-python.yml on warpllm/warpllm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
warpllm-0.1.2.tar.gz -
Subject digest:
93d420300a0698db6e10310a51dcc7d9161dba9ace0317e847d77fedc5179c58 - Sigstore transparency entry: 2175611877
- Sigstore integration time:
-
Permalink:
warpllm/warpllm@10d22084cc56de163062e1b142aceca4abdedbf1 -
Branch / Tag:
refs/tags/v0.1.2 - Owner: https://github.com/warpllm
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release-python.yml@10d22084cc56de163062e1b142aceca4abdedbf1 -
Trigger Event:
push
-
Statement type:
File details
Details for the file warpllm-0.1.2-cp310-abi3-win_arm64.whl.
File metadata
- Download URL: warpllm-0.1.2-cp310-abi3-win_arm64.whl
- Upload date:
- Size: 1.9 MB
- Tags: CPython 3.10+, Windows ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3950b0d62ca3399dd7f805b7cd4ce346c72af38acea8dcb4fd97c7217b337899
|
|
| MD5 |
8d575fea7e102221f2c2caa377bfe9b0
|
|
| BLAKE2b-256 |
78b12927c40be3f927811b293d9b391247799dcb3281f5a3b7ab9669e22b7a51
|
Provenance
The following attestation bundles were made for warpllm-0.1.2-cp310-abi3-win_arm64.whl:
Publisher:
release-python.yml on warpllm/warpllm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
warpllm-0.1.2-cp310-abi3-win_arm64.whl -
Subject digest:
3950b0d62ca3399dd7f805b7cd4ce346c72af38acea8dcb4fd97c7217b337899 - Sigstore transparency entry: 2175612014
- Sigstore integration time:
-
Permalink:
warpllm/warpllm@10d22084cc56de163062e1b142aceca4abdedbf1 -
Branch / Tag:
refs/tags/v0.1.2 - Owner: https://github.com/warpllm
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release-python.yml@10d22084cc56de163062e1b142aceca4abdedbf1 -
Trigger Event:
push
-
Statement type:
File details
Details for the file warpllm-0.1.2-cp310-abi3-win_amd64.whl.
File metadata
- Download URL: warpllm-0.1.2-cp310-abi3-win_amd64.whl
- Upload date:
- Size: 2.0 MB
- Tags: CPython 3.10+, Windows x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c5e43da84fae219101aac590e9b2de8a0abe2dc313148b49bf086206d3db7f13
|
|
| MD5 |
c0a641b3172474817b9d97cb1e23031b
|
|
| BLAKE2b-256 |
0638c25a1dc19af08a92e61c14ed699097500fb110e05778c3157552bedf539f
|
Provenance
The following attestation bundles were made for warpllm-0.1.2-cp310-abi3-win_amd64.whl:
Publisher:
release-python.yml on warpllm/warpllm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
warpllm-0.1.2-cp310-abi3-win_amd64.whl -
Subject digest:
c5e43da84fae219101aac590e9b2de8a0abe2dc313148b49bf086206d3db7f13 - Sigstore transparency entry: 2175611948
- Sigstore integration time:
-
Permalink:
warpllm/warpllm@10d22084cc56de163062e1b142aceca4abdedbf1 -
Branch / Tag:
refs/tags/v0.1.2 - Owner: https://github.com/warpllm
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release-python.yml@10d22084cc56de163062e1b142aceca4abdedbf1 -
Trigger Event:
push
-
Statement type:
File details
Details for the file warpllm-0.1.2-cp310-abi3-musllinux_1_2_x86_64.whl.
File metadata
- Download URL: warpllm-0.1.2-cp310-abi3-musllinux_1_2_x86_64.whl
- Upload date:
- Size: 2.3 MB
- Tags: CPython 3.10+, musllinux: musl 1.2+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1693ff6f3d927288cb4bb04eaaa4529a029924975e958623138ae61a7ea480b3
|
|
| MD5 |
54b438c885eea65e08216c897277cec9
|
|
| BLAKE2b-256 |
f97fcce07f80f7f245913c0a836c018899b42fba85c2a5ede5227fab3858bb6a
|
Provenance
The following attestation bundles were made for warpllm-0.1.2-cp310-abi3-musllinux_1_2_x86_64.whl:
Publisher:
release-python.yml on warpllm/warpllm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
warpllm-0.1.2-cp310-abi3-musllinux_1_2_x86_64.whl -
Subject digest:
1693ff6f3d927288cb4bb04eaaa4529a029924975e958623138ae61a7ea480b3 - Sigstore transparency entry: 2175611925
- Sigstore integration time:
-
Permalink:
warpllm/warpllm@10d22084cc56de163062e1b142aceca4abdedbf1 -
Branch / Tag:
refs/tags/v0.1.2 - Owner: https://github.com/warpllm
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release-python.yml@10d22084cc56de163062e1b142aceca4abdedbf1 -
Trigger Event:
push
-
Statement type:
File details
Details for the file warpllm-0.1.2-cp310-abi3-musllinux_1_2_aarch64.whl.
File metadata
- Download URL: warpllm-0.1.2-cp310-abi3-musllinux_1_2_aarch64.whl
- Upload date:
- Size: 2.1 MB
- Tags: CPython 3.10+, musllinux: musl 1.2+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
afe21ffd398047e9169a36ade3aabb4ad30fbf4a968fb64f2fccd2736e50d47e
|
|
| MD5 |
c70779da45f5d58bd782194ceb7ef6e4
|
|
| BLAKE2b-256 |
9873e35739bf59218b34cbc48ced7b670d1412f8d3b31206aba297e5bff4913b
|
Provenance
The following attestation bundles were made for warpllm-0.1.2-cp310-abi3-musllinux_1_2_aarch64.whl:
Publisher:
release-python.yml on warpllm/warpllm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
warpllm-0.1.2-cp310-abi3-musllinux_1_2_aarch64.whl -
Subject digest:
afe21ffd398047e9169a36ade3aabb4ad30fbf4a968fb64f2fccd2736e50d47e - Sigstore transparency entry: 2175611964
- Sigstore integration time:
-
Permalink:
warpllm/warpllm@10d22084cc56de163062e1b142aceca4abdedbf1 -
Branch / Tag:
refs/tags/v0.1.2 - Owner: https://github.com/warpllm
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release-python.yml@10d22084cc56de163062e1b142aceca4abdedbf1 -
Trigger Event:
push
-
Statement type:
File details
Details for the file warpllm-0.1.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.
File metadata
- Download URL: warpllm-0.1.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 2.0 MB
- Tags: CPython 3.10+, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0b1b7df1f7a701f14d080135c9e6a075a635c651f0b5c6c37407e85e97b3c5e0
|
|
| MD5 |
ab464011dedf91092082d4ed5dddfb25
|
|
| BLAKE2b-256 |
9e6e03c79c545230e93dd043b2ba8535f00572f4cf7255ad3d8ab7ccffb8c5bf
|
Provenance
The following attestation bundles were made for warpllm-0.1.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:
Publisher:
release-python.yml on warpllm/warpllm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
warpllm-0.1.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl -
Subject digest:
0b1b7df1f7a701f14d080135c9e6a075a635c651f0b5c6c37407e85e97b3c5e0 - Sigstore transparency entry: 2175612046
- Sigstore integration time:
-
Permalink:
warpllm/warpllm@10d22084cc56de163062e1b142aceca4abdedbf1 -
Branch / Tag:
refs/tags/v0.1.2 - Owner: https://github.com/warpllm
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release-python.yml@10d22084cc56de163062e1b142aceca4abdedbf1 -
Trigger Event:
push
-
Statement type:
File details
Details for the file warpllm-0.1.2-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.
File metadata
- Download URL: warpllm-0.1.2-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
- Upload date:
- Size: 2.0 MB
- Tags: CPython 3.10+, manylinux: glibc 2.17+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6b1a00809e6255765a4f6a5fc178df5919a432a09da6a6426c72c55a79335963
|
|
| MD5 |
c84c61c40bb2c3423f6be25070b0fe53
|
|
| BLAKE2b-256 |
1de0c80ffb410eccbe6dace17b965e21c1928ae0c5b858ef1caaa298fc4e6d4f
|
Provenance
The following attestation bundles were made for warpllm-0.1.2-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:
Publisher:
release-python.yml on warpllm/warpllm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
warpllm-0.1.2-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl -
Subject digest:
6b1a00809e6255765a4f6a5fc178df5919a432a09da6a6426c72c55a79335963 - Sigstore transparency entry: 2175611904
- Sigstore integration time:
-
Permalink:
warpllm/warpllm@10d22084cc56de163062e1b142aceca4abdedbf1 -
Branch / Tag:
refs/tags/v0.1.2 - Owner: https://github.com/warpllm
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release-python.yml@10d22084cc56de163062e1b142aceca4abdedbf1 -
Trigger Event:
push
-
Statement type:
File details
Details for the file warpllm-0.1.2-cp310-abi3-macosx_11_0_arm64.whl.
File metadata
- Download URL: warpllm-0.1.2-cp310-abi3-macosx_11_0_arm64.whl
- Upload date:
- Size: 1.8 MB
- Tags: CPython 3.10+, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
22871eb68b4e553c7d211845c412f49baf8d653a31a97cfe65890dd90e944317
|
|
| MD5 |
31e746a209ffc8f5d5436ff092972f4e
|
|
| BLAKE2b-256 |
b36f84e841d19966b58dc8e51d37b8590d6f65edbde4bef3b8cb515ea6471009
|
Provenance
The following attestation bundles were made for warpllm-0.1.2-cp310-abi3-macosx_11_0_arm64.whl:
Publisher:
release-python.yml on warpllm/warpllm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
warpllm-0.1.2-cp310-abi3-macosx_11_0_arm64.whl -
Subject digest:
22871eb68b4e553c7d211845c412f49baf8d653a31a97cfe65890dd90e944317 - Sigstore transparency entry: 2175611990
- Sigstore integration time:
-
Permalink:
warpllm/warpllm@10d22084cc56de163062e1b142aceca4abdedbf1 -
Branch / Tag:
refs/tags/v0.1.2 - Owner: https://github.com/warpllm
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release-python.yml@10d22084cc56de163062e1b142aceca4abdedbf1 -
Trigger Event:
push
-
Statement type:
File details
Details for the file warpllm-0.1.2-cp310-abi3-macosx_10_12_x86_64.whl.
File metadata
- Download URL: warpllm-0.1.2-cp310-abi3-macosx_10_12_x86_64.whl
- Upload date:
- Size: 1.9 MB
- Tags: CPython 3.10+, macOS 10.12+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
56e7b26bb131043b06e68060634a643ce4b6bbe513aaeb38edc569ce19bd6dca
|
|
| MD5 |
d78f27021e6871150aa2ece9688d055f
|
|
| BLAKE2b-256 |
b2ca06fe622eac2da9d97a23b5c25e65ff2ab277288505100792cbdd5892d843
|
Provenance
The following attestation bundles were made for warpllm-0.1.2-cp310-abi3-macosx_10_12_x86_64.whl:
Publisher:
release-python.yml on warpllm/warpllm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
warpllm-0.1.2-cp310-abi3-macosx_10_12_x86_64.whl -
Subject digest:
56e7b26bb131043b06e68060634a643ce4b6bbe513aaeb38edc569ce19bd6dca - Sigstore transparency entry: 2175612065
- Sigstore integration time:
-
Permalink:
warpllm/warpllm@10d22084cc56de163062e1b142aceca4abdedbf1 -
Branch / Tag:
refs/tags/v0.1.2 - Owner: https://github.com/warpllm
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release-python.yml@10d22084cc56de163062e1b142aceca4abdedbf1 -
Trigger Event:
push
-
Statement type:
