Whittle 🪒🧠
Whittle is a Python library for compressing large language models (LLMs) by extracting sub-networks to balance performance and efficiency. It is based on LitGPT and allows to compress many state-of-the-art models.
- Neural Architecture Search: Workflows for pre-training super-networks and multi-objective search to select sub-networks.
- Structural Pruning: State-of-the-art approaches to pruning structural components of pre-trained LLMs.
- Distillation: Workflow to distill a student model given a trained teacher model.
- Evaluation: Easy extraction of sub-networks checkpoint and evaluation using LM-Eval-Harness
- Efficiency: Different metrics to estimate efficiency of sub-networks, such as latency, FLOPs, or energy consumption.
Installation
Whittle supports and is tested for python 3.10 to 3.12.
You can install whittle with:
pip install whittle
Install from source
Install whittle from source to get the most recent version:
git clone git@github.com:whittle-org/whittle.git
cd whittle
pip install -e .
Getting started with whittle
To explore and understand different functionalities of whittle checkout this colab notebook and examples/
Projects that use whittle
How to get involved
We more than happy for any code contribution. If you are interested in contribution to whittle, please read our contribution guide.
3 maintainers
Metadata
3 maintainers
Release files for whittle 0.6.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| whittle-0.6.0.tar.gz | 160.4 kB | With provenance | Details |
Release files / whittle-0.6.0.tar.gz
| Download URL | whittle-0.6.0.tar.gz |
|---|---|
| Size | 160.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
d96069bdb402c310b481e8a031ccd320f4538cc14114293144d8058f1fad78d0
|
|
BLAKE2b-256 checksum How to use checksums |
fbfce435c5199861647acbe9dbcc59922fcf8ecdee442db060b9b61a0868a38e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 27, 2026.
Transparency logSecurity for whittle 0.6.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Full provenance
All 1 file in this release has been uploaded with provenance metadata.
Attestation for whittle-0.6.0.tar.gz
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 27, 2026.
Transparency logA note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
