Contextual Precision Network (CPN) Engine — Dynamic Mixed-Precision LLM Inference Engine
Project description
🚀 CPN Engine (v2.5) — Contextual Precision Network
CPN Engine is an enterprise-grade inference engine that dynamically optimizes LLMs using Contextual Mixed-Precision Routing and Adaptive Entropy Thresholding.
📊 Benchmark & Performance (RTX 4070 Ti - 12GB VRAM)
| Model Architecture | Baseline Precision | CPN Mode | Baseline VRAM | CPN Peak VRAM | VRAM Savings |
|---|---|---|---|---|---|
| Qwen2.5-3B | FP16 | CPN Hybrid (16/4-bit) | 6.20 GB | 3.95 GB | %36.2 |
| DeepSeek-R1-Distill-1.5B | FP16 | CPN Hybrid (16/4-bit) | 3.31 GB | 2.84 GB | %14.3 |
| DeepSeek-R1-Distill-7B | FP16 | CPN Hybrid (16/4-bit) | 14.12 GB (OOM) | 6.63 GB | %53.1 |
💻 Quick Start
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
cpn_engine-2.5.0.tar.gz
(12.9 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file cpn_engine-2.5.0.tar.gz.
File metadata
- Download URL: cpn_engine-2.5.0.tar.gz
- Upload date:
- Size: 12.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9cb113de01f63321981bd1ac0b01f72b94cc445a31273e72ab0912bcd82da15f
|
|
| MD5 |
9c68e8220175a8ba096e629811108f81
|
|
| BLAKE2b-256 |
f94e2d3cd564b0ebb38b649cdefb691db34fb638598b1bb1f73dd78283537096
|
File details
Details for the file cpn_engine-2.5.0-py3-none-any.whl.
File metadata
- Download URL: cpn_engine-2.5.0-py3-none-any.whl
- Upload date:
- Size: 15.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fd43060ad30d610c896590da19da9da9818f04296c64bd527266df08f2dfb005
|
|
| MD5 |
bcd269d6064f54ca3eef260bd89cd515
|
|
| BLAKE2b-256 |
09e05f89c36d8d460609fa1dc5e0a137ec3c857bd5af6858bb97ec0e6eaba4fa
|
