Windows ML llama.cpp backend for Python

These distributions add the optional llama.cpp backend to the windowsml Python package. With them installed, the Windows ML Runtime loads GGUF models.

Install the metapackage through the windowsml extra:

pip install "windowsml[llama]"

Or install it directly:

pip install windowsml-llama

Every distribution pins the exact windowsml version it was built with. The payload is installed into windowsml/lib, beside the Runtime it was built for.

The CUDA backend requires an NVIDIA GPU and driver. It depends on NVIDIA's nvidia-cublas wheel at the exact version Windows ML validates. That wheel is published by NVIDIA under the NVIDIA software license, which installing it accepts. Windows ML loads that cuBLAS, or a later 13.x release, before the backend. Without a supported GPU, the CUDA backend is skipped and the CPU backend remains available.