llama-cpp-server-py-core
Describe your project here.
Some tools
Convert huggingface model to gguf model
rye run hf2gguf /opt/models/llm/qwen/Qwen2.5-Coder-14B-Instruct --outfile /opt/models/llm/qwen/Qwen2.5-Coder-14B-Instruct-f16.gguf
Quantize gguf model
rye run quantize /opt/models/llm/qwen/Qwen2.5-Coder-14B-Instruct-f16.gguf /opt/models/llm/qwen/Qwen2.5-Coder-14B-Instruct-Q4_k_m.gguf Q4_k_m
1 maintainer
Metadata
1 maintainer
Release files for llama-cpp-server-py-core 0.1.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| llama_cpp_server_py_core-0.1.4.tar.gz | 34.4 MB | Details |
Release files / llama_cpp_server_py_core-0.1.4.tar.gz
| Download URL | llama_cpp_server_py_core-0.1.4.tar.gz |
|---|---|
| Size | 34.4 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a38c3a0e0b2756e542618369a0105b82c2ffa7c538463221f6a784928b6ff995
|
|
BLAKE2b-256 checksum How to use checksums |
7e0136bdad22c1a35ec447abd3fbf1468a46a09a66a386e71ccaaeff3a8c5c65
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.10.17
|
