llamacpp

Python bindings for llama.cpp

Install

From PyPI

pip install llamacpp

Build from Source

pip install .

Get the model weights

You will need to obtain the weights for LLaMA yourself. There are a few torrents floating around as well as some huggingface repositories (e.g https://huggingface.co/nyanko7/LLaMA-7B/). Once you have them, copy them into the models folder.

ls ./models
65B 30B 13B 7B tokenizer_checklist.chk tokenizer.model

Convert the weights to GGML format using llamacpp-convert. Then use llamacpp-quantize to quantize them into INT4. For example, for the 7B parameter model, run

llamacpp-convert ./models/7B/ 1
llamacpp-quantize ./models/7B/
llamacpp-cli

Note that running llamacpp-convert requires torch, sentencepiece and numpy to be installed. These packages are not installed by default when your install llamacpp.

Command line interface

The package installs the command line entry point llamacpp-cli that points to llamacpp/cli.py and should provide about the same functionality as the main program in the original C++ repository. There is also an experimental llamacpp-chat that is supposed to bring up a chat interface but this is not working correctly yet.

API

Documentation is TBD. But the long and short of it is that there are two interfaces

LlamaInference - this one is a high level interface that tries to take care of most things for you. The demo script below uses this.
LlamaContext - this is a low level interface to the underlying llama.cpp API. You can use this similar to how the main example in llama.cpp does uses the C API. This is a rough implementation and currently untested except for compiling successfully.

Demo script

See llamacpp/cli.py for a detailed example. The simplest demo would be something like the following:

import sys
import llamacpp


def progress_callback(progress):
    print("Progress: {:.2f}%".format(progress * 100))
    sys.stdout.flush()


params = llamacpp.InferenceParams.default_with_callback(progress_callback)
params.path_model = './models/7B/ggml-model-q4_0.bin'
model = llamacpp.LlamaInference(params)

prompt = "A llama is a"
prompt_tokens = model.tokenize(prompt, True)
model.update_input(prompt_tokens)

model.ingest_all_pending_input()

model.print_system_info()
for i in range(20):
    model.eval()
    token = model.sample()
    text = model.token_to_str(token)
    print(text, end="")
    
# Flush stdout
sys.stdout.flush()

model.print_timings()

ToDo

Investigate using dynamic versions using setuptools-scm (Example: https://github.com/pypa/setuptools_scm/blob/main/scm_hack_build_backend.py)

Release files for llamacpp 0.1.14

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for llamacpp 0.1.14
File	Size	Uploaded
llamacpp-0.1.14.tar.gz	1.9 MB	Apr 10, 2023	Details

Built distributions (wheels)

Table of built distributions (wheels) for llamacpp 0.1.14
File	Interpreter	ABI	Platform	Reset
llamacpp-0.1.14-cp311-cp311-win_amd64.whl 179.0 kB Apr 10, 2023	CPython 3.11	CPython 3.11	Windows x86-64	Details
llamacpp-0.1.14-cp311-cp311-musllinux_1_1_x86_64.whl 770.2 kB Apr 10, 2023	CPython 3.11	CPython 3.11	Linux musl 1.1+ x86-64	Details
llamacpp-0.1.14-cp311-cp311-musllinux_1_1_aarch64.whl 735.9 kB Apr 10, 2023	CPython 3.11	CPython 3.11	Linux musl 1.1+ ARM64	Details
llamacpp-0.1.14-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 243.3 kB Apr 10, 2023	CPython 3.11	CPython 3.11	Linux glibc 2.17+ x86-64	Details
llamacpp-0.1.14-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 221.5 kB Apr 10, 2023	CPython 3.11	CPython 3.11	Linux glibc 2.17+ ARM64	Details
llamacpp-0.1.14-cp311-cp311-macosx_11_0_arm64.whl 194.5 kB Apr 10, 2023	CPython 3.11	CPython 3.11	macOS 11.0+ ARM64	Details
llamacpp-0.1.14-cp311-cp311-macosx_10_9_x86_64.whl 217.4 kB Apr 10, 2023	CPython 3.11	CPython 3.11	macOS 10.9+ x86-64	Details
llamacpp-0.1.14-cp311-cp311-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl 401.5 kB Apr 10, 2023	CPython 3.11	CPython 3.11	macOS 10.9+ universal2 (ARM64, x86-64), macOS 11.0+ universal2 (ARM64, x86-64), macOS 11.0+ ARM64, macOS 10.9+ x86-64	Details
llamacpp-0.1.14-cp310-cp310-win_amd64.whl 179.1 kB Apr 10, 2023	CPython 3.10	CPython 3.10	Windows x86-64	Details
llamacpp-0.1.14-cp310-cp310-musllinux_1_1_x86_64.whl 770.3 kB Apr 10, 2023	CPython 3.10	CPython 3.10	Linux musl 1.1+ x86-64	Details
llamacpp-0.1.14-cp310-cp310-musllinux_1_1_aarch64.whl 735.9 kB Apr 10, 2023	CPython 3.10	CPython 3.10	Linux musl 1.1+ ARM64	Details
llamacpp-0.1.14-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 243.4 kB Apr 10, 2023	CPython 3.10	CPython 3.10	Linux glibc 2.17+ x86-64	Details
llamacpp-0.1.14-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 221.6 kB Apr 10, 2023	CPython 3.10	CPython 3.10	Linux glibc 2.17+ ARM64	Details
llamacpp-0.1.14-cp310-cp310-macosx_11_0_arm64.whl 194.5 kB Apr 10, 2023	CPython 3.10	CPython 3.10	macOS 11.0+ ARM64	Details
llamacpp-0.1.14-cp310-cp310-macosx_10_9_x86_64.whl 217.3 kB Apr 10, 2023	CPython 3.10	CPython 3.10	macOS 10.9+ x86-64	Details
llamacpp-0.1.14-cp310-cp310-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl 401.5 kB Apr 10, 2023	CPython 3.10	CPython 3.10	macOS 11.0+ ARM64, macOS 10.9+ x86-64, macOS 10.9+ universal2 (ARM64, x86-64), macOS 11.0+ universal2 (ARM64, x86-64)	Details
llamacpp-0.1.14-cp39-cp39-win_amd64.whl 179.1 kB Apr 10, 2023	CPython 3.9	CPython 3.9	Windows x86-64	Details
llamacpp-0.1.14-cp39-cp39-musllinux_1_1_x86_64.whl 770.4 kB Apr 10, 2023	CPython 3.9	CPython 3.9	Linux musl 1.1+ x86-64	Details
llamacpp-0.1.14-cp39-cp39-musllinux_1_1_aarch64.whl 736.7 kB Apr 10, 2023	CPython 3.9	CPython 3.9	Linux musl 1.1+ ARM64	Details
llamacpp-0.1.14-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 243.5 kB Apr 10, 2023	CPython 3.9	CPython 3.9	Linux glibc 2.17+ x86-64	Details
llamacpp-0.1.14-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 222.2 kB Apr 10, 2023	CPython 3.9	CPython 3.9	Linux glibc 2.17+ ARM64	Details
llamacpp-0.1.14-cp39-cp39-macosx_11_0_arm64.whl 194.6 kB Apr 10, 2023	CPython 3.9	CPython 3.9	macOS 11.0+ ARM64	Details
llamacpp-0.1.14-cp39-cp39-macosx_10_9_x86_64.whl 217.5 kB Apr 10, 2023	CPython 3.9	CPython 3.9	macOS 10.9+ x86-64	Details
llamacpp-0.1.14-cp39-cp39-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl 401.8 kB Apr 10, 2023	CPython 3.9	CPython 3.9	macOS 11.0+ ARM64, macOS 10.9+ x86-64, macOS 10.9+ universal2 (ARM64, x86-64), macOS 11.0+ universal2 (ARM64, x86-64)	Details
llamacpp-0.1.14-cp38-cp38-win_amd64.whl 179.1 kB Apr 10, 2023	CPython 3.8	CPython 3.8	Windows x86-64	Details
llamacpp-0.1.14-cp38-cp38-musllinux_1_1_x86_64.whl 770.1 kB Apr 10, 2023	CPython 3.8	CPython 3.8	Linux musl 1.1+ x86-64	Details
llamacpp-0.1.14-cp38-cp38-musllinux_1_1_aarch64.whl 735.7 kB Apr 10, 2023	CPython 3.8	CPython 3.8	Linux musl 1.1+ ARM64	Details
llamacpp-0.1.14-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 242.7 kB Apr 10, 2023	CPython 3.8	CPython 3.8	Linux glibc 2.17+ x86-64	Details
llamacpp-0.1.14-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 221.8 kB Apr 10, 2023	CPython 3.8	CPython 3.8	Linux glibc 2.17+ ARM64	Details
llamacpp-0.1.14-cp38-cp38-macosx_11_0_arm64.whl 194.4 kB Apr 10, 2023	CPython 3.8	CPython 3.8	macOS 11.0+ ARM64	Details
llamacpp-0.1.14-cp38-cp38-macosx_10_9_x86_64.whl 217.4 kB Apr 10, 2023	CPython 3.8	CPython 3.8	macOS 10.9+ x86-64	Details
llamacpp-0.1.14-cp38-cp38-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl 401.4 kB Apr 10, 2023	CPython 3.8	CPython 3.8	macOS 10.9+ x86-64, macOS 10.9+ universal2 (ARM64, x86-64), macOS 11.0+ universal2 (ARM64, x86-64), macOS 11.0+ ARM64	Details
llamacpp-0.1.14-cp37-cp37m-win_amd64.whl 178.9 kB Apr 10, 2023	CPython 3.7	CPython 3.7 pymalloc	Windows x86-64	Details
llamacpp-0.1.14-cp37-cp37m-musllinux_1_1_x86_64.whl 774.1 kB Apr 10, 2023	CPython 3.7	CPython 3.7 pymalloc	Linux musl 1.1+ x86-64	Details
llamacpp-0.1.14-cp37-cp37m-musllinux_1_1_aarch64.whl 740.5 kB Apr 10, 2023	CPython 3.7	CPython 3.7 pymalloc	Linux musl 1.1+ ARM64	Details
llamacpp-0.1.14-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 246.5 kB Apr 10, 2023	CPython 3.7	CPython 3.7 pymalloc	Linux glibc 2.17+ x86-64	Details
llamacpp-0.1.14-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 226.8 kB Apr 10, 2023	CPython 3.7	CPython 3.7 pymalloc	Linux glibc 2.17+ ARM64	Details
llamacpp-0.1.14-cp37-cp37m-macosx_10_9_x86_64.whl 216.2 kB Apr 10, 2023	CPython 3.7	CPython 3.7 pymalloc	macOS 10.9+ x86-64	Details

Total release size: 16.2 MB

Release files / llamacpp-0.1.14.tar.gz

Download URL	llamacpp-0.1.14.tar.gz
Size	1.9 MB
Tags	Source
SHA-256 checksum How to use checksums	`e558af0778bc9a8335379eacaaf368d9d43966f19b05c445e200397a36c02152`
BLAKE2b-256 checksum How to use checksums	`540b20b42971a0ec3110f7a57eb6d1f495bc833687aa39084c39100278536263`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp311-cp311-win_amd64.whl

Download URL	llamacpp-0.1.14-cp311-cp311-win_amd64.whl
Size	179.0 kB
Tags	CPython 3.11 Windows x86-64
SHA-256 checksum How to use checksums	`06b72ff0b71bbd392253e117272de1adaf61d2888cfa105da8c69f349b1f98ae`
BLAKE2b-256 checksum How to use checksums	`127d0bc3a741099e8af079d755772072daea682f4ef90de1d786c8db1bf0bcdf`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp311-cp311-musllinux_1_1_x86_64.whl

Download URL	llamacpp-0.1.14-cp311-cp311-musllinux_1_1_x86_64.whl
Size	770.2 kB
Tags	CPython 3.11 Linux musl 1.1+ x86-64
SHA-256 checksum How to use checksums	`e519e8f35ddc608db495230946da2df4376db5934873dc61ff34e77a842451a6`
BLAKE2b-256 checksum How to use checksums	`10f7b9363cccc4409fe38482309e66cfce654c372cdd8a6b12ee4b2cab8a3d5f`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp311-cp311-musllinux_1_1_aarch64.whl

Download URL	llamacpp-0.1.14-cp311-cp311-musllinux_1_1_aarch64.whl
Size	735.9 kB
Tags	CPython 3.11 Linux musl 1.1+ ARM64
SHA-256 checksum How to use checksums	`67db633a3d62a4a5cbd54994b1ff7f7e37d9e1b3bbcb46521e48a67e6e909ce7`
BLAKE2b-256 checksum How to use checksums	`029d04f7ec0cc283b37fd3664e9e46064db42b949256cadcb5d3c297e5c0bc01`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL	llamacpp-0.1.14-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size	243.3 kB
Tags	CPython 3.11 Linux glibc 2.17+ x86-64
SHA-256 checksum How to use checksums	`ee41eb9510e8d6c6b944d85c35fbfc51424dfb6953e21f5ab68664bb1c69f24e`
BLAKE2b-256 checksum How to use checksums	`56d4b51839d898960fa09527fcede8e2f0d8cf5b5842affb1f739c24ea9ad751`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL	llamacpp-0.1.14-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size	221.5 kB
Tags	CPython 3.11 Linux glibc 2.17+ ARM64
SHA-256 checksum How to use checksums	`cb550c02b090a0f9fb33add8cd11eb7afc55126b035780873a37e6ffe3ba6217`
BLAKE2b-256 checksum How to use checksums	`e8502895cecce9cd32f1a7d1cbaa43ee349e6844112b6dd8c2fae776364fc912`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp311-cp311-macosx_11_0_arm64.whl

Download URL	llamacpp-0.1.14-cp311-cp311-macosx_11_0_arm64.whl
Size	194.5 kB
Tags	CPython 3.11 macOS 11.0+ ARM64
SHA-256 checksum How to use checksums	`68284591487c23c0f14d7a8408586fa6a2f52a227fbf99710bb61095caf8eef2`
BLAKE2b-256 checksum How to use checksums	`c8d06edda7f6ac88cebdcad5ac5a2c35bfcc4fbd498f9075470154e07c2d428a`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp311-cp311-macosx_10_9_x86_64.whl

Download URL	llamacpp-0.1.14-cp311-cp311-macosx_10_9_x86_64.whl
Size	217.4 kB
Tags	CPython 3.11 macOS 10.9+ x86-64
SHA-256 checksum How to use checksums	`5eb34a3755fabab53a8e9925a2924aa378f3fa992e1c1ac5a6bbad04101f3069`
BLAKE2b-256 checksum How to use checksums	`509973a563bcc82ef76ebb14984361491a8c8381ac6efcde223384e8f3092ba2`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp311-cp311-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl

Download URL	llamacpp-0.1.14-cp311-cp311-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl
Size	401.5 kB
Tags	CPython 3.11 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64 macOS 11.0+ universal2 (ARM64, x86-64)
SHA-256 checksum How to use checksums	`c76c6a79340c053310db0047a292412bc846468fbfa833681753c335baf91939`
BLAKE2b-256 checksum How to use checksums	`927426e11f7dee31a4ccb88947421fc18dc8b5450b1db61777a5c2432fc25b42`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp310-cp310-win_amd64.whl

Download URL	llamacpp-0.1.14-cp310-cp310-win_amd64.whl
Size	179.1 kB
Tags	CPython 3.10 Windows x86-64
SHA-256 checksum How to use checksums	`649f7d675d3b8237e13c02462b8225254c985eb3a5bcecc78c57f3ef0dc17067`
BLAKE2b-256 checksum How to use checksums	`026a2576809146cfcf8e3b1b948d61938683a634222d83032a9e8fd17167f562`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp310-cp310-musllinux_1_1_x86_64.whl

Download URL	llamacpp-0.1.14-cp310-cp310-musllinux_1_1_x86_64.whl
Size	770.3 kB
Tags	CPython 3.10 Linux musl 1.1+ x86-64
SHA-256 checksum How to use checksums	`ae81ff6e293b7798f1990acc371e2f759f53da4225ceeaf81d760a20b596abbd`
BLAKE2b-256 checksum How to use checksums	`a4c2d40709d939c35d1b91afc49ae165584e619983cd0f1dced3eee62e02da9f`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp310-cp310-musllinux_1_1_aarch64.whl

Download URL	llamacpp-0.1.14-cp310-cp310-musllinux_1_1_aarch64.whl
Size	735.9 kB
Tags	CPython 3.10 Linux musl 1.1+ ARM64
SHA-256 checksum How to use checksums	`f21557b79f57970d0b243f5d84bbc608807ff7069855cc71bcd10611344f5d72`
BLAKE2b-256 checksum How to use checksums	`f88d560d58bf8d814c360e12c18597a95f48d2dd7d24b1bd4b83afee84488d15`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL	llamacpp-0.1.14-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size	243.4 kB
Tags	CPython 3.10 Linux glibc 2.17+ x86-64
SHA-256 checksum How to use checksums	`b0d77d7754183faf8eeed644b51679e5ff0676e308c12251d98521fa6f085871`
BLAKE2b-256 checksum How to use checksums	`3fbfb3b7e080b161c57a8c3b816efb9974112b54e09647e4a550d5393d93bb21`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL	llamacpp-0.1.14-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size	221.6 kB
Tags	CPython 3.10 Linux glibc 2.17+ ARM64
SHA-256 checksum How to use checksums	`3109beac3f9693f9f7b96d8b8ba3692369db1d6972fc80dfe2e85010e5396c9f`
BLAKE2b-256 checksum How to use checksums	`949c57259e5360609a1c77e3c622fa4ab45a55640fe068ade1a1054dbffb9177`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp310-cp310-macosx_11_0_arm64.whl

Download URL	llamacpp-0.1.14-cp310-cp310-macosx_11_0_arm64.whl
Size	194.5 kB
Tags	CPython 3.10 macOS 11.0+ ARM64
SHA-256 checksum How to use checksums	`c32965163468f7cc617fc7ce6a722bbbc937d5a6ba1ddde95aa9cf8e80151fe3`
BLAKE2b-256 checksum How to use checksums	`67cafb6bd6dae02783b1d796286f32706f86701750347a9b3e12e6d117d89c74`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp310-cp310-macosx_10_9_x86_64.whl

Download URL	llamacpp-0.1.14-cp310-cp310-macosx_10_9_x86_64.whl
Size	217.3 kB
Tags	CPython 3.10 macOS 10.9+ x86-64
SHA-256 checksum How to use checksums	`955d9cb5077d6df39781dfad5668ff3b1b427e7208d5cf482422ebb44e7cadf5`
BLAKE2b-256 checksum How to use checksums	`54f570dd563eb8d6b11ba275db4f453bf78c8f35c1505ff8f443001df678997e`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp310-cp310-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl

Download URL	llamacpp-0.1.14-cp310-cp310-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl
Size	401.5 kB
Tags	CPython 3.10 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64 macOS 11.0+ universal2 (ARM64, x86-64)
SHA-256 checksum How to use checksums	`aacfef0774bf5a213ebbd29a151793f352d1ee31b8220b68582d53c19a82aaa4`
BLAKE2b-256 checksum How to use checksums	`960299448e4cd35df3f9786d464113633f14711f56c470cbf9aeaf926145fe0f`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp39-cp39-win_amd64.whl

Download URL	llamacpp-0.1.14-cp39-cp39-win_amd64.whl
Size	179.1 kB
Tags	CPython 3.9 Windows x86-64
SHA-256 checksum How to use checksums	`77663b939554b780e3208cea33c2938feb77d3594ddcbf42863c22cd9e87bdcb`
BLAKE2b-256 checksum How to use checksums	`8cf61b45ab60a173f4b976b4fa12207b06c137076a72b9f10497bbc185f493d1`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp39-cp39-musllinux_1_1_x86_64.whl

Download URL	llamacpp-0.1.14-cp39-cp39-musllinux_1_1_x86_64.whl
Size	770.4 kB
Tags	CPython 3.9 Linux musl 1.1+ x86-64
SHA-256 checksum How to use checksums	`36fff86f13431cae3b1406716a40337c075ecce55481d104f7be685d064be394`
BLAKE2b-256 checksum How to use checksums	`bb87bfc80c5ce29a2ffe2eaed70a222acd44b011c992fb1fa3c2a8312f92e3fb`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp39-cp39-musllinux_1_1_aarch64.whl

Download URL	llamacpp-0.1.14-cp39-cp39-musllinux_1_1_aarch64.whl
Size	736.7 kB
Tags	CPython 3.9 Linux musl 1.1+ ARM64
SHA-256 checksum How to use checksums	`8c386e384d311b895b3da0b335d439e1fce5ea1ebb484730330009d514fd8b50`
BLAKE2b-256 checksum How to use checksums	`762845ddb14bfd667df46a7bf576ab0761f3befc5ac17c5729ec1ea4d4526ae2`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL	llamacpp-0.1.14-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size	243.5 kB
Tags	CPython 3.9 Linux glibc 2.17+ x86-64
SHA-256 checksum How to use checksums	`9e220e6efb34eb26e5061e8c147c91c45ff529c6445f3fe63caa12a8f56fde9c`
BLAKE2b-256 checksum How to use checksums	`28bd905c5202932a1a91149e3d7d80858fee64b7f9f3103f980b7638e41d2e50`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL	llamacpp-0.1.14-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size	222.2 kB
Tags	CPython 3.9 Linux glibc 2.17+ ARM64
SHA-256 checksum How to use checksums	`362d042cc07629ff74fcc3c8b98aa86566b4649a3c186fd80c027af91db25c2f`
BLAKE2b-256 checksum How to use checksums	`c2d7e2294de6e28e4fc2a255391717a221f41748fdea84e0a50833311be346d2`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp39-cp39-macosx_11_0_arm64.whl

Download URL	llamacpp-0.1.14-cp39-cp39-macosx_11_0_arm64.whl
Size	194.6 kB
Tags	CPython 3.9 macOS 11.0+ ARM64
SHA-256 checksum How to use checksums	`52fecc05bfb6a7673e375508f307f9fa953bcf224043b69f3669f5358fd3a533`
BLAKE2b-256 checksum How to use checksums	`a9cb2bedb6fb8482b61ad9b2eb42da1b432eee2c35f9c80b5fec7815f4f41045`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp39-cp39-macosx_10_9_x86_64.whl

Download URL	llamacpp-0.1.14-cp39-cp39-macosx_10_9_x86_64.whl
Size	217.5 kB
Tags	CPython 3.9 macOS 10.9+ x86-64
SHA-256 checksum How to use checksums	`5949bc02c3e15b38142e2985892bc0271a5fa53794e9c2dc0db469433e5657b9`
BLAKE2b-256 checksum How to use checksums	`f47fa689d4e4a91e6272bbdfffbedfaebe06d54dfffcad71bb6364d0585d4106`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp39-cp39-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl

Download URL	llamacpp-0.1.14-cp39-cp39-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl
Size	401.8 kB
Tags	CPython 3.9 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64 macOS 11.0+ universal2 (ARM64, x86-64)
SHA-256 checksum How to use checksums	`c756d8a7df225ecc18ef869e344da17b9c3ce1d769f589f8e0933b2066f571e6`
BLAKE2b-256 checksum How to use checksums	`aa1809019f7a9dfc468433bb38d5b2900dc9ea8c1a90207c32495d9912adb683`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp38-cp38-win_amd64.whl

Download URL	llamacpp-0.1.14-cp38-cp38-win_amd64.whl
Size	179.1 kB
Tags	CPython 3.8 Windows x86-64
SHA-256 checksum How to use checksums	`c892e8904831d3d0e9ed6307c2d18f6b8a750ba88f59d6af8647b3b4376da977`
BLAKE2b-256 checksum How to use checksums	`8ab3e4bd87d5d29dbc761e22fa592cab25b39f782e021a3c6d390ad7a3b06975`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp38-cp38-musllinux_1_1_x86_64.whl

Download URL	llamacpp-0.1.14-cp38-cp38-musllinux_1_1_x86_64.whl
Size	770.1 kB
Tags	CPython 3.8 Linux musl 1.1+ x86-64
SHA-256 checksum How to use checksums	`4e8320464f654d4eb160a3fa9b529a2b1eaf724901587fd4a2c53dfec663376b`
BLAKE2b-256 checksum How to use checksums	`8235566b00df380288a709e9c502131fa542ee984245b222b9a444556e6b4b0d`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp38-cp38-musllinux_1_1_aarch64.whl

Download URL	llamacpp-0.1.14-cp38-cp38-musllinux_1_1_aarch64.whl
Size	735.7 kB
Tags	CPython 3.8 Linux musl 1.1+ ARM64
SHA-256 checksum How to use checksums	`ba4bf33f6cda5f4246e60d24758d7b43b704c59ac9cf11b9bd5f7c54cde2bb1f`
BLAKE2b-256 checksum How to use checksums	`051ab39f6f8bd3acce96ef717620df59fa1c2f2c703b8865d960b791267a8cf4`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL	llamacpp-0.1.14-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size	242.7 kB
Tags	CPython 3.8 Linux glibc 2.17+ x86-64
SHA-256 checksum How to use checksums	`1cffa2275f0f3f7d790f4fe601ffd16e74e1f03a089c907a280826caa23e9be6`
BLAKE2b-256 checksum How to use checksums	`930e2d67a85d24640bc0e7d5ef5daa197f2d4fcea2bdb39e9b610434ff58e22d`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL	llamacpp-0.1.14-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size	221.8 kB
Tags	CPython 3.8 Linux glibc 2.17+ ARM64
SHA-256 checksum How to use checksums	`c69b07bc101c9ca418d76d7d4e8508a2b4bbd0ec7d91d359040afb590e2c49a3`
BLAKE2b-256 checksum How to use checksums	`77289f0fcea9a572bef4acb7865353d6882b1de5d9e88738545e43b7ecec0499`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp38-cp38-macosx_11_0_arm64.whl

Download URL	llamacpp-0.1.14-cp38-cp38-macosx_11_0_arm64.whl
Size	194.4 kB
Tags	CPython 3.8 macOS 11.0+ ARM64
SHA-256 checksum How to use checksums	`abc7c5fdcca9e3b68add7fd174265d0ec25678d74100ac4640a875ed38effbd1`
BLAKE2b-256 checksum How to use checksums	`a3c0c2156e6126b4b198bfa864199f6f5e3d800c8a2fc7fcf3f0a3c976f481a8`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp38-cp38-macosx_10_9_x86_64.whl

Download URL	llamacpp-0.1.14-cp38-cp38-macosx_10_9_x86_64.whl
Size	217.4 kB
Tags	CPython 3.8 macOS 10.9+ x86-64
SHA-256 checksum How to use checksums	`9c5222ca3d94d43bb876965b1fa201aa6d8a9b9555fdce546095b2a3d1087d1f`
BLAKE2b-256 checksum How to use checksums	`d8d6a4c404b447704209b80243da6f462745224fd4c01aa18e7d354d9281d300`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp38-cp38-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl

Download URL	llamacpp-0.1.14-cp38-cp38-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl
Size	401.4 kB
Tags	CPython 3.8 macOS 10.9+ universal2 (ARM64, x86-64) macOS 10.9+ x86-64 macOS 11.0+ ARM64 macOS 11.0+ universal2 (ARM64, x86-64)
SHA-256 checksum How to use checksums	`3b4ac68cf55e7ffd1d898347ef48c3977d28345056e4b76fcd50e329bb6b0057`
BLAKE2b-256 checksum How to use checksums	`92a6d8f71be40917df058c7d2cd986ea9574782e739cbf5941845b09e8ef0c0a`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp37-cp37m-win_amd64.whl

Download URL	llamacpp-0.1.14-cp37-cp37m-win_amd64.whl
Size	178.9 kB
Tags	CPython 3.7 CPython 3.7 pymalloc Windows x86-64
SHA-256 checksum How to use checksums	`3f53bd0abe1ac3d0c30680f0537071229c5f7e9d2fb2b1cb1282f0096928908f`
BLAKE2b-256 checksum How to use checksums	`7117be971ec7415e6cfa01fe0ae11c48124c6b7f6745ef5c87520fb3e7629293`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp37-cp37m-musllinux_1_1_x86_64.whl

Download URL	llamacpp-0.1.14-cp37-cp37m-musllinux_1_1_x86_64.whl
Size	774.1 kB
Tags	CPython 3.7 CPython 3.7 pymalloc Linux musl 1.1+ x86-64
SHA-256 checksum How to use checksums	`8b1699b96f279278421c5e2df859df3d4d3785a28aa2ff984b0aacc14ee0f793`
BLAKE2b-256 checksum How to use checksums	`7b360343fb3834bf6b178b00264e8026e0c3e275e4b771fadd23585d3f5d0d0a`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp37-cp37m-musllinux_1_1_aarch64.whl

Download URL	llamacpp-0.1.14-cp37-cp37m-musllinux_1_1_aarch64.whl
Size	740.5 kB
Tags	CPython 3.7 CPython 3.7 pymalloc Linux musl 1.1+ ARM64
SHA-256 checksum How to use checksums	`71b247979dc49cee7889983c5f4c4b1a295554100df3655024452a162c1ce985`
BLAKE2b-256 checksum How to use checksums	`c3a270f756d1fb6405af515932637d726d8897cddca085a0c466fe99ba724f21`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL	llamacpp-0.1.14-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size	246.5 kB
Tags	CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ x86-64
SHA-256 checksum How to use checksums	`ffc02516886b8742d7bf17c753be74a907a600cc9edf5fc63ddaa1b7e22815c0`
BLAKE2b-256 checksum How to use checksums	`e474995c6891ec7d3bdc0d83b952092138c3b5c63e114acf5f385a5bdccf16c2`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL	llamacpp-0.1.14-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size	226.8 kB
Tags	CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ ARM64
SHA-256 checksum How to use checksums	`8f52b43b2b67980a81aec61cc4368e5c28ee9895a487b5fcb82729e42cd49e79`
BLAKE2b-256 checksum How to use checksums	`a2bb0cb21a7358f3c729205628b6987b79283ca6f86dbe346151cc0acaa96985`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / llamacpp-0.1.14-cp37-cp37m-macosx_10_9_x86_64.whl

Download URL	llamacpp-0.1.14-cp37-cp37m-macosx_10_9_x86_64.whl
Size	216.2 kB
Tags	CPython 3.7 CPython 3.7 pymalloc macOS 10.9+ x86-64
SHA-256 checksum How to use checksums	`ce4379cb8ae3355d630b3edd0f08138c3c4e8ce344ea39e5e7d9f72c0b4d1c57`
BLAKE2b-256 checksum How to use checksums	`479ef3536ab627ed882fbad9dbe1e90d7478ee42606a638f0087baac1ec6ac2b`
Upload date	Apr 10, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release history Release notifications | RSS feed

This release

0.1.14 This release

Apr 10, 2023 39 release files

0.1.13

Apr 8, 2023 39 release files

0.1.12

Apr 7, 2023 39 release files

0.1.11

Mar 31, 2023 39 release files

0.1.10

Mar 30, 2023 39 release files

0.1.9

Mar 29, 2023 39 release files

0.1.8

Mar 20, 2023 39 release files

0.1.7

Mar 19, 2023 39 release files

0.1.6

Mar 19, 2023 24 release files

0.1.5

Mar 18, 2023 20 release files

0.1.3

Mar 13, 2023 2 release files

0.1.2