Vision LLMs on Apple silicon with MLX and the Hugging Face Hub
Project description
MLX-VLM
MLX-VLM a package for running Vision LLMs on your Mac using MLX.
Get started
The easiest way to get started is to install the mlx-vlm
package:
With pip
:
pip install mlx-vlm
Inference:
python -m mlx_vlm.generate --model qnguyen3/nanoLLaVA --max-tokens 100 --temp 0.0
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mlx_vlm-0.0.2.tar.gz
(21.3 kB
view hashes)
Built Distribution
mlx_vlm-0.0.2-py3-none-any.whl
(29.2 kB
view hashes)