A headless Oobabooga wrapper.
pip install ooba
import ooba
path = ooba.download("https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF")
llm = ooba.llm(path)
messages = [{"role": "user", "content": "Hi Mistral."}]
for token in llm.chat(messages):
print(token)
https://github.com/KillianLucas/ooba/assets/63927363/b741f4ee-9dca-4c50-9405-dd99550b2dc8
1 maintainer
Metadata
1 maintainer
Release files for ooba 0.0.22
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| ooba-0.0.22.tar.gz | 20.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| ooba-0.0.22-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 45.5 kB
Release files / ooba-0.0.22.tar.gz
| Download URL | ooba-0.0.22.tar.gz |
|---|---|
| Size | 20.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
334b4098e84b6e8c605696d787c64a8bf19b1a5d77e972e4e58159a45a7dfa77
|
|
BLAKE2b-256 checksum How to use checksums |
e60b1442abee384551465a0990aaecd5534554761a818096a01d998448041ba7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.6.1 CPython/3.11.5 Darwin/21.6.0
|
Release files / ooba-0.0.22-py3-none-any.whl
| Download URL | ooba-0.0.22-py3-none-any.whl |
|---|---|
| Size | 24.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
92aaa1534af1ef9d27cae781941448d4c47ba9b7b23a8cc8c92cee5a5e61e185
|
|
BLAKE2b-256 checksum How to use checksums |
6fb8e72e1cdf34155c43ec98743688bc73b6adf8dafedc5afced514f08983f4a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.6.1 CPython/3.11.5 Darwin/21.6.0
|
