Vision LLMs on Apple silicon with MLX and the Hugging Face Hub
Project description
MLX-VLM
MLX-VLM a package for running Vision LLMs on your Mac using MLX.
Get started
The easiest way to get started is to install the mlx-vlm package:
With pip:
pip install mlx-vlm
Inference:
python -m mlx_vlm.generate --model qnguyen3/nanoLLaVA --max-tokens 100 --temp 0.0
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mlx_vlm-0.0.2.tar.gz
(21.3 kB
view details)
Built Distribution
mlx_vlm-0.0.2-py3-none-any.whl
(29.2 kB
view details)
File details
Details for the file mlx_vlm-0.0.2.tar.gz.
File metadata
- Download URL: mlx_vlm-0.0.2.tar.gz
- Upload date:
- Size: 21.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.9.19
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | da66ae4f617fe2851d6d159f6fa3b158fa5e67f762133581a269ba8f032cd461 |
|
| MD5 | dc900e0aaa6b6a14d2feb22792a7b7e4 |
|
| BLAKE2b-256 | ee492ffa5934a09968093d3ea9ec1d36084d749cad1a41e1abe63e4879a5aa3e |
File details
Details for the file mlx_vlm-0.0.2-py3-none-any.whl.
File metadata
- Download URL: mlx_vlm-0.0.2-py3-none-any.whl
- Upload date:
- Size: 29.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.9.19
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 549fb2d82150e8cb8d173e70cc85c8683750a561d4acbf19b03c0edf3ea8f5a2 |
|
| MD5 | aef04d39fa8c1b5d60431d4f09828213 |
|
| BLAKE2b-256 | 9f0f1704f8c30fabfcf5169d1721f5eb26a2ed56d9dbb4142b54e7d39be79de3 |
