enhancers
Composable acceleration utilities for local language models.
Installation
pip install enhancers
Usage
from enhancers import Benchmark
result = Benchmark(
baseline_tokens_per_second=20,
enhanced_tokens_per_second=50,
)
print(result.speedup)
The initial API provides a typed optimization protocol and a consistent way to report inference speedups. It is designed to accommodate speculative decoding and other local-inference enhancements.
Development
pip install -e ".[dev]"
pytest
ruff check --fix --select I
ruff format
License
MIT
1 maintainer
Metadata
1 maintainer
Release files for enhancers 0.0.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| enhancers-0.0.1.tar.gz | 34.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| enhancers-0.0.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 37.3 kB
Release files / enhancers-0.0.1.tar.gz
| Download URL | enhancers-0.0.1.tar.gz |
|---|---|
| Size | 34.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c846917136d8b09794ddc7a75d73cc82b8eb1a18869c8b2843bcc04c0893c1a9
|
|
BLAKE2b-256 checksum How to use checksums |
e172c69ac5f7799957d318f76c509390a37f81f557bb6ee6b89ab3aa6cad247e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.0
|
Release files / enhancers-0.0.1-py3-none-any.whl
| Download URL | enhancers-0.0.1-py3-none-any.whl |
|---|---|
| Size | 3.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
d4c99d399dbbb614d70553716b7a58136fe8841b5ba2231070fe5daf2e130761
|
|
BLAKE2b-256 checksum How to use checksums |
15e99bc5857e066e99f48b1d0571e0ed2944df57274970cac2d312ce62f8dd11
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.0
|
