lightvl is a lightweight Vision-Language Model (VLM) quantization toolkit
Project description
LightVL is a lightweight Vision-Language Model (VLM) quantization toolkit supporting FP8, INT8, FP8-Block, and INT4-FP8 mixed quantization schemes. It integrates with vLLM for high-throughput inference and supports Qwen3-VL, Qwen3.5, InternVL-Chat, and Gemma-4 models.
Key capabilities:
- CPU or GPU fast quantization
- Automated side-by-side comparison of original vs quantized model latency and accuracy based vllm and transformers
- Batch inference with concurrent request execution
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
lightvl-0.0.6-py3-none-any.whl
(66.0 kB
view details)
File details
Details for the file lightvl-0.0.6-py3-none-any.whl.
File metadata
- Download URL: lightvl-0.0.6-py3-none-any.whl
- Upload date:
- Size: 66.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
21e152c8dc0a52fe0678941cdcfa5f224187ce55d9e204ce55e04df0004536db
|
|
| MD5 |
cbd3cb216623f85810c2e5f69b747f77
|
|
| BLAKE2b-256 |
88db9ffb6efa46ef3959486bfc4972e2ab3e52a7dc1d5dc8c5f4fd109d823490
|
