Tuisko LLM Python
tuisko-llm provides the exact host-side frontend for
unsloth/Qwen3.8-27B-NVFP4 at its pinned revision. It supports:
- checkpoint admission, tokenizer encode/decode, stop IDs, and generation defaults;
- structured chat messages, reasoning history, tool calls, and template controls;
- prompt-prefix accounting and incremental UTF-8-safe token decoding.
It does not initialize CUDA or run inference in process. Use the TuiskoLLM server's OpenAI-compatible HTTP API for generation.
Install
pip install tuisko-llm
Example
from tuisko.llm import ChatMessage, Frontend
frontend = Frontend.open("/path/to/16b6615af3548b88e2d8e382457bc705b00479cf")
messages = [ChatMessage("system", "You are concise."), ChatMessage("user", "Hello")]
prompt = frontend.encode_chat_with_report(messages, enable_thinking=False)
print(prompt.token_ids)
print(prompt.reused_tokens)
ChatMessage also represents prior reasoning, function calls, and tool results. The three chat
methods accept both structured messages and existing (role, content) pairs. Their options expose
thinking controls and OpenAI-compatible tool definitions. Frontend.streaming_decoder() decodes
generated token IDs without splitting UTF-8 text.
Frontend.open() first admits the complete pinned checkpoint inventory. It raises
CheckpointError for snapshot admission failures and FrontendError for tokenizer or template
failures; both derive from TuiskoError.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file tuisko_llm-0.1.0.tar.gz.
File metadata
- Download URL: tuisko_llm-0.1.0.tar.gz
- Upload date:
- Size: 85.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
25585d432748b495134ba77a4d93f15fe6b20d0200e83eae7f88daa8e5d2d014
|
|
| MD5 |
fefe73568674c4d1bb0ca6d4abd44ef5
|
|
| BLAKE2b-256 |
1108189291bf1525837d9e489d1728dd7f4871cbc3e8a7d9ec6ad021be03d766
|
Provenance
The following attestation bundles were made for tuisko_llm-0.1.0.tar.gz:
Publisher:
python-release.yml on blaind/tuiskollm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
tuisko_llm-0.1.0.tar.gz -
Subject digest:
25585d432748b495134ba77a4d93f15fe6b20d0200e83eae7f88daa8e5d2d014 - Sigstore transparency entry: 2570949546
- Sigstore integration time:
-
Permalink:
blaind/tuiskollm@1ef31c35fc73aaa18410abc4c65bee3c185ae381 -
Branch / Tag:
refs/tags/v0.1.0 - Owner: https://github.com/blaind
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
python-release.yml@1ef31c35fc73aaa18410abc4c65bee3c185ae381 -
Trigger Event:
push
-
Statement type:
File details
Details for the file tuisko_llm-0.1.0-cp312-abi3-manylinux_2_34_x86_64.whl.
File metadata
- Download URL: tuisko_llm-0.1.0-cp312-abi3-manylinux_2_34_x86_64.whl
- Upload date:
- Size: 2.5 MB
- Tags: CPython 3.12+, manylinux: glibc 2.34+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8714c04e2c10869a049221fe96bb2eb322ce8ab7f5a8158c990d9c2367857b0b
|
|
| MD5 |
db01b2c9757540885469777a18d30530
|
|
| BLAKE2b-256 |
105b68b69ea331e18a416e41ebfe50ea40b8a5b82e393050c73d50af22abc14c
|
Provenance
The following attestation bundles were made for tuisko_llm-0.1.0-cp312-abi3-manylinux_2_34_x86_64.whl:
Publisher:
python-release.yml on blaind/tuiskollm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
tuisko_llm-0.1.0-cp312-abi3-manylinux_2_34_x86_64.whl -
Subject digest:
8714c04e2c10869a049221fe96bb2eb322ce8ab7f5a8158c990d9c2367857b0b - Sigstore transparency entry: 2570949892
- Sigstore integration time:
-
Permalink:
blaind/tuiskollm@1ef31c35fc73aaa18410abc4c65bee3c185ae381 -
Branch / Tag:
refs/tags/v0.1.0 - Owner: https://github.com/blaind
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
python-release.yml@1ef31c35fc73aaa18410abc4c65bee3c185ae381 -
Trigger Event:
push
-
Statement type:
