enhancers
Composable acceleration utilities for local language models.
Installation
pip install enhancers
Usage
from enhancers import Benchmark
result = Benchmark(
baseline_tokens_per_second=20,
enhanced_tokens_per_second=50,
)
print(result.speedup)
The initial API provides a typed optimization protocol and a consistent way to report inference speedups. It is designed to accommodate speculative decoding and other local-inference enhancements.
Development
pip install -e ".[dev]"
pytest
ruff check --fix --select I
ruff format
License
MIT
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
enhancers-0.0.1.tar.gz
(34.1 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file enhancers-0.0.1.tar.gz.
File metadata
- Download URL: enhancers-0.0.1.tar.gz
- Upload date:
- Size: 34.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.14.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c846917136d8b09794ddc7a75d73cc82b8eb1a18869c8b2843bcc04c0893c1a9
|
|
| MD5 |
28f21579debe900c23c723f0b6ad742c
|
|
| BLAKE2b-256 |
e172c69ac5f7799957d318f76c509390a37f81f557bb6ee6b89ab3aa6cad247e
|
File details
Details for the file enhancers-0.0.1-py3-none-any.whl.
File metadata
- Download URL: enhancers-0.0.1-py3-none-any.whl
- Upload date:
- Size: 3.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.14.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d4c99d399dbbb614d70553716b7a58136fe8841b5ba2231070fe5daf2e130761
|
|
| MD5 |
6a329d7bea9ee5c26c957b44cd5f4e24
|
|
| BLAKE2b-256 |
15e99bc5857e066e99f48b1d0571e0ed2944df57274970cac2d312ce62f8dd11
|
