Skip to main content

skulk-llama-server-vulkan

The pip-installable Vulkan llama-server build for Skulk's served GGUF engine (Linux x86_64).

The wheel carries the Foxlight-built llama-server and ggml-rpc-server binaries, compiled from the pinned upstream llama.cpp release with the Vulkan backend, plus the Khronos Vulkan loader (Apache-2.0) bundled alongside, so it has no Python dependencies at all. The system's one prerequisite is the GPU driver's Vulkan ICD: mesa-vulkan-drivers on AMD, the NVIDIA driver's ICD on bare-metal NVIDIA.

uv pip install skulk-llama-server-vulkan
llama-server-vulkan --list-devices

Skulk's engine provisioning discovers the installed wheel automatically and wires it as the node's served engine. Version scheme: 0.<llama.cpp build>.<packaging revision>, in lockstep with the CUDA sibling wheel and Skulk's engine pin. Built from source in the Skulk repository's engine-wheel workflow and published via PyPI trusted publishing.

The bundled binaries derive from llama.cpp (MIT) and the bundled libvulkan is the Khronos Vulkan Loader (Apache-2.0); both license texts ship in the wheel under skulk_llama_server_vulkan/licenses/.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

skulk_llama_server_vulkan-0.10068.0-py3-none-manylinux_2_35_x86_64.whl (64.8 MB view details)

Uploaded Python 3manylinux: glibc 2.35+ x86-64

File details

Details for the file skulk_llama_server_vulkan-0.10068.0-py3-none-manylinux_2_35_x86_64.whl.

File metadata

File hashes

Hashes for skulk_llama_server_vulkan-0.10068.0-py3-none-manylinux_2_35_x86_64.whl
Algorithm Hash digest
SHA256 e2b5c19fa9097f326c65a1a14ebeaad71db20ba148c07aa8d435d13f854e5463
MD5 81e446e8a6b236a3fe751745cf4e7692
BLAKE2b-256 11e109ff13af98c3132f25d4927d25e350b3de2a3ca523c37c73ff792fbc1136

See more details on using hashes here.

Provenance

The following attestation bundles were made for skulk_llama_server_vulkan-0.10068.0-py3-none-manylinux_2_35_x86_64.whl:

Publisher: engine-wheel.yml on Foxlight-Foundation/Skulk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page