Add your description here
Project description
llama-cpp-server-py-core
Describe your project here.
Some tools
Convert huggingface model to gguf model
rye run hf2gguf /opt/models/llm/qwen/Qwen2.5-Coder-14B-Instruct --outfile /opt/models/llm/qwen/Qwen2.5-Coder-14B-Instruct-f16.gguf
Quantize gguf model
rye run quantize /opt/models/llm/qwen/Qwen2.5-Coder-14B-Instruct-f16.gguf /opt/models/llm/qwen/Qwen2.5-Coder-14B-Instruct-Q4_k_m.gguf Q4_k_m
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file llama_cpp_server_py_core-0.1.3.tar.gz.
File metadata
- Download URL: llama_cpp_server_py_core-0.1.3.tar.gz
- Upload date:
- Size: 34.0 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3b753c521a655b54edef52909da30d40c68ba2af0083e9f4e59f9d558c00e487
|
|
| MD5 |
1afbcd8a84add1d4d6d420d917dea85d
|
|
| BLAKE2b-256 |
2bb08a543e5f3aa24b968ad3178b7f27d7ff05c24ea880eb04b1e116be9849bb
|
