Skip to main content

skulk-llama-server-vulkan

The pip-installable Vulkan llama-server build for Skulk's served GGUF engine (Linux x86_64).

The wheel carries the Foxlight-built llama-server and ggml-rpc-server binaries, compiled from the pinned upstream llama.cpp release with the Vulkan backend, plus the Khronos Vulkan loader (Apache-2.0) bundled alongside, so it has no Python dependencies at all. The system's one prerequisite is the GPU driver's Vulkan ICD: mesa-vulkan-drivers on AMD, the NVIDIA driver's ICD on bare-metal NVIDIA.

uv pip install skulk-llama-server-vulkan
llama-server-vulkan --list-devices

Skulk's engine provisioning discovers the installed wheel automatically and wires it as the node's served engine. Version scheme: 0.<llama.cpp build>.<packaging revision>, in lockstep with the CUDA sibling wheel and Skulk's engine pin. Built from source in the Skulk repository's engine-wheel workflow and published via PyPI trusted publishing.

This wheel is the engine path for AMD GPU nodes and the fallback for bare-metal NVIDIA nodes when the CUDA wheel is unavailable; how it fits into Skulk's install and provisioning flow is documented in the Build & Runtime Paths guide.

The bundled binaries derive from llama.cpp (MIT) and the bundled libvulkan is the Khronos Vulkan Loader (Apache-2.0); both license texts ship in the wheel under skulk_llama_server_vulkan/licenses/.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

skulk_llama_server_vulkan-0.10434.0-py3-none-manylinux_2_35_x86_64.whl (67.8 MB view details)

Uploaded Python 3manylinux: glibc 2.35+ x86-64

File details

Details for the file skulk_llama_server_vulkan-0.10434.0-py3-none-manylinux_2_35_x86_64.whl.

File metadata

File hashes

Hashes for skulk_llama_server_vulkan-0.10434.0-py3-none-manylinux_2_35_x86_64.whl
Algorithm Hash digest
SHA256 6805555f40aca939f60c0c4afc41b5d8f44d1116a1c2848bf79ab615adba1a2f
MD5 86deaf25bfb70c9360a35babe6b88a83
BLAKE2b-256 14391a5314c8ab9edbc3362ec65b0baa0e72f458b9848ab7f47140c247971951

See more details on using hashes here.

Provenance

The following attestation bundles were made for skulk_llama_server_vulkan-0.10434.0-py3-none-manylinux_2_35_x86_64.whl:

Publisher: engine-wheel.yml on Foxlight-Foundation/Skulk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page