Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

loom-py-rt-vulkan

The Vulkan backend for loom-py-rt. One shared library in one small wheel; there is nothing here to import.

pip install "loom-py-rt[vulkan]"
import loom

loom.devices()                                   # a Vulkan device now appears
model = loom.Model.from_file(path, device="gpu")

The base package is unchanged by installing this — it discovers the library on sys.path at import and device="auto" starts using it. That is what GGML_BACKEND_DL buys: no second copy of the runtime per accelerator.

If it appears not to have worked

Check loom.devices(). A backend whose driver is too old, or which finds no supported device, loads without error and registers nothing — the only other symptom is a model running at CPU speed.

device="gpu" asks for an offload device with its own memory, preferring one the kernel confirms is a GPU. It is not a promise that Vulkan specifically was chosen. Pass device="Vulkan0" to require this backend.

Versioning

This package pins the base with ==, not ~=. It carries a libggml-vulkan.so that is dlopened beside the base wheel's libggml-base.so, and ggml makes no ABI promise across revisions — so a base release that moves its ggml pin invalidates every backend wheel published before it. The exact pin is what stops pip from pairing two libraries that do not agree.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

loom_py_rt_vulkan-1.0.0rc8-py3-none-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (16.0 MB view details)

Uploaded Python 3manylinux: glibc 2.27+ x86-64manylinux: glibc 2.28+ x86-64

loom_py_rt_vulkan-1.0.0rc8-py3-none-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl (15.9 MB view details)

Uploaded Python 3manylinux: glibc 2.27+ ARM64manylinux: glibc 2.28+ ARM64

File details

Details for the file loom_py_rt_vulkan-1.0.0rc8-py3-none-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for loom_py_rt_vulkan-1.0.0rc8-py3-none-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 1be908efc1542635e547b00d0a67286e3697abd65d8970199e4586f604669141
MD5 ec0cd1e270912e9ad05bdfba752dd6c6
BLAKE2b-256 cf5ce97cd4d64e222da5719fdbf204ed79ee5233606ad94d07a8b9dfd2d72028

See more details on using hashes here.

Provenance

The following attestation bundles were made for loom_py_rt_vulkan-1.0.0rc8-py3-none-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl:

Publisher: wheels.yml on loom-ai-org/loom-py

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file loom_py_rt_vulkan-1.0.0rc8-py3-none-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for loom_py_rt_vulkan-1.0.0rc8-py3-none-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 941bf17ec04d1918b371870499da9cb0189b955810e54935ccc82e691f9605e5
MD5 75496efa6ccf60b3d0fadc55d5641127
BLAKE2b-256 abf7efc64d8eb7c694286f6d2beccd3dcc12e68f7a0c3e0dae6ec9fa0cdd94db

See more details on using hashes here.

Provenance

The following attestation bundles were made for loom_py_rt_vulkan-1.0.0rc8-py3-none-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl:

Publisher: wheels.yml on loom-ai-org/loom-py

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page