Quaynor
Run LLMs locally and efficiently on any device
Quaynor is a lightweight, fast inference engine that makes it simple to run open-source LLMs directly inside your Python applications.
Key Features
- Run locally, offline, for free - No API keys or cloud services required
- Fast, simple tool calling - Just pass normal Python functions
- Reliable tool execution - Automatically derives grammar from function signatures
- Infinite conversations - Conversation-aware preemptive context shifting prevents mid-conversation crashes
- GPU accelerated — Vulkan (Linux/Windows) and Metal (macOS/iOS), where supported
- Thousands of compatible models - Works with any LLM in GGUF format
- Powered by llama.cpp - Built on the proven llama.cpp engine
Quick Start
from quaynor import Chat
chat = Chat('./model.gguf')
response = chat.ask('Hello world?').completed()
print(response)
Installation
pip install quaynor
Documentation
Full documentation: https://www.quaynor.site/
License
MIT — see the repository LICENSE file.
1 maintainer
Metadata
1 maintainer
Release files for quaynor 2.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| quaynor-2.0.0.tar.gz | 2.0 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| quaynor-2.0.0-cp38-abi3-macosx_11_0_arm64.whl | CPython 3.8 | abi3 | macOS 11.0+ ARM64 | Details |
Total release size: 11.9 MB
Release files / quaynor-2.0.0.tar.gz
| Download URL | quaynor-2.0.0.tar.gz |
|---|---|
| Size | 2.0 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
df2fb9ebecaf098b3820fe17a4cff3f2c3cfddde99fd641098a53167c7583d4f
|
|
BLAKE2b-256 checksum How to use checksums |
f7d4888e8016955d3c17562766d5158187e5ae4be328920b2a2163ea836764a7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.13.1
|
Release files / quaynor-2.0.0-cp38-abi3-macosx_11_0_arm64.whl
| Download URL | quaynor-2.0.0-cp38-abi3-macosx_11_0_arm64.whl |
|---|---|
| Size | 9.9 MB |
| Tags | CPython 3.8 abi3 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
c9121895f4e0929d2242f6294b7e269fb0103e2f73320f8f50c740344466aa3e
|
|
BLAKE2b-256 checksum How to use checksums |
c2eefefa160fbb2cdf80946911332039cba7c1744c5c52dadb7c0bd79b08ebe4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.13.1
|
