Python binding for llama.cpp using cffi
Project description
llama-cpp-cffi
Python binding for llama.cpp using cffi
Build
#
# setup venv
#
python -m venv venv
source venv/bin/activate
pip install poetry
poetry run cibuildwheel --output-dir wheelhouse --platform linux .
poetry run cibuildwheel --output-dir wheelhouse --platform pyodide .
#
# run demos
#
python -B examples/demo_cffi.py
python -B examples/demo_ctypes.py
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distributions
Close
Hashes for llama_cpp_cffi-0.0.2-cp312-cp312-musllinux_1_2_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8998ceb2ee6b9fe970e407d0fc2ae1a0260646a953ec58a8935572e07feb9f9e |
|
| MD5 | 39e606c9242bdfe50b813614e47d3216 |
|
| BLAKE2b-256 | bd6ea71787a6507c6ab32af4354ad82b546b8100dab20f8047087ff35c7a3f85 |
Close
Hashes for llama_cpp_cffi-0.0.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 770258839891ecbdf787d0e08856ea45f3c50e1da57c2c62db172a2d1833fabf |
|
| MD5 | 3e98c19bc4dc2374965e5f5f99e2c428 |
|
| BLAKE2b-256 | 020a73a3fc4657cd7168a85b4dad4ec87db804e20ef5bb04ce2b63da2096b3d7 |
Close
Hashes for llama_cpp_cffi-0.0.2-cp311-cp311-musllinux_1_2_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | d1395b9126f76c2b366e225c79372998a928e68d0a9e013585b94184c05021eb |
|
| MD5 | 2f013906155b561c042a3cd941c31df0 |
|
| BLAKE2b-256 | 0691fe18e3cf0f39fe1794f1690a24e0b55853a0672d61ac98f9624d97cdd28d |
Close
Hashes for llama_cpp_cffi-0.0.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 4b031e1829ed98a2348428d3b16813c98aaea6818f01f5a88373b279db4bec25 |
|
| MD5 | 7a50b36ca31a5d3f6f8e104fe01d0207 |
|
| BLAKE2b-256 | 0e9a72ccf989f5b3783ccee051a5d329480fc84b162b09cb59c5b5668033e63c |
Close
Hashes for llama_cpp_cffi-0.0.2-cp310-cp310-musllinux_1_2_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | cc1c6d0184580dbf9063ba1afe0461bc7e7d5aee8968b01f701bd47b99ed9060 |
|
| MD5 | 3b23657406c5c9dc7033d15ed4ca70d8 |
|
| BLAKE2b-256 | 416db427a3471fcf23c973d0e7e233b1947cd7cee0ebeefb4784831d9c46cff1 |
Close
Hashes for llama_cpp_cffi-0.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 4a74292db21b22aef9f7039dea4185444b6eb8bb06c6b519cc4ac919e7c53226 |
|
| MD5 | 58ae7fe1592617166decbd6e6e7cfb83 |
|
| BLAKE2b-256 | c7b640cfc0b16656cb6f3a5c4ee2398c1ac0da818d99743f277635d0c9efc8a1 |
