This release is a pre-release and may not be stable for production use.
loom-py-rt-cuda
The CUDA backend for loom-py-rt. One shared library in one
small wheel; there is nothing here to import.
pip install "loom-py-rt[cuda]"
import loom
loom.devices() # a CUDA device now appears
model = loom.Model.from_file(path, device="gpu")
The base package is unchanged by installing this — it discovers the library on sys.path at import
and device="auto" starts using it. That is what GGML_BACKEND_DL buys: no second copy of the
runtime per accelerator.
If it appears not to have worked
Check loom.devices(). A backend whose driver is too old, or which finds no supported device, loads
without error and registers nothing — the only other symptom is a model running at CPU speed.
device="gpu" asks for an offload device with its own memory, preferring one the kernel confirms is a
GPU. It is not a promise that CUDA specifically was chosen. Pass device="CUDA0" to require this
backend.
Versioning
This package pins the base with ==, not ~=. It carries a libggml-cuda.so that is dlopened beside
the base wheel's libggml-base.so, and ggml makes no ABI promise across revisions — so a base release
that moves its ggml pin invalidates every backend wheel published before it. The exact pin is what
stops pip from pairing two libraries that do not agree.
1 maintainer
Metadata
1 maintainer
Release files for loom-py-rt-cuda 1.0.0rc18
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| loom_py_rt_cuda-1.0.0rc18-py3-none-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl | Python 3 | none | Linux glibc 2.27+ x86-64, Linux glibc 2.28+ x86-64 | Details |
| loom_py_rt_cuda-1.0.0rc18-py3-none-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl | Python 3 | none | Linux glibc 2.27+ ARM64, Linux glibc 2.28+ ARM64 | Details |
Total release size: 129.8 MB
Release files / loom_py_rt_cuda-1.0.0rc18-py3-none-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
| Download URL | loom_py_rt_cuda-1.0.0rc18-py3-none-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 77.2 MB |
| Tags | Linux glibc 2.27+ x86-64 Linux glibc 2.28+ x86-64 Python 3 |
|
SHA-256 checksum How to use checksums |
41633ce7ff9e6f483badbcfd2189d228cc2d1a55f0fe55588b2901e942b0252a
|
|
BLAKE2b-256 checksum How to use checksums |
9cdd4ac3ecfd1a3b7c70e35853ef7bf8a8288e6988c178cefd50ce392f4d6157
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 21, 2026.
Transparency logRelease files / loom_py_rt_cuda-1.0.0rc18-py3-none-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl
| Download URL | loom_py_rt_cuda-1.0.0rc18-py3-none-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl |
|---|---|
| Size | 52.6 MB |
| Tags | Linux glibc 2.27+ ARM64 Linux glibc 2.28+ ARM64 Python 3 |
|
SHA-256 checksum How to use checksums |
d76e54061794f07053191ef815f1530725ac0ca7d9725e4e0aa3d85a4249add2
|
|
BLAKE2b-256 checksum How to use checksums |
e5d9d16e845f41e4dcef05fd56e2e9746a3e43608d134b0de4209bb409d37a62
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 21, 2026.
Transparency logSecurity for loom-py-rt-cuda 1.0.0rc18
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Full provenance
All 2 files in this release have been uploaded with provenance metadata.
Attestation for loom_py_rt_cuda-1.0.0rc18-py3-none-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 21, 2026.
Transparency logA note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
