wfw-ai · WANI v3.1
Local and cloud AI inference. Slash commands. Zero bloat.
pip install wfw-ai
wani
Features
- Local GGUF models via llama-cpp-python
- Cloud: Groq (free) · OpenAI · Anthropic · Gemini · HuggingFace · Ollama
- Auto hardware detection (Oppo A6x, Snapdragon, desktop)
- KV cache quantization — 50% less RAM
- Flash Attention + mmap
- HuggingFace direct download with resume
- Slash commands:
/model /download /connect /system /edit /run /read /write /stats - Shell shortcut:
//ls -la
Install
pip install wfw-ai # core (cloud only)
pip install "wfw-ai[local]" # + local GGUF support
pip install "wfw-ai[all]" # everything
Usage
wani # auto mode
wani --cloud groq --key gsk_... # groq cloud
wani --model mymodel.gguf # specific model
wani --download llama-3.2-3b # download from HF
wani --list # list models
wani --prompt "Hello" --cloud groq # single prompt
Slash Commands
| Command | Action |
|---|---|
/model |
list & load local models |
/download |
download from HuggingFace |
/connect |
manage cloud connections |
/system <text> |
set system prompt |
/edit <file> |
open file in editor |
/run <cmd> |
run shell command |
/read <file> |
load file into context |
/write <file> |
save response to file |
/stats |
hardware + session stats |
/clear |
clear history |
//cmd |
shell shortcut |
Environment Variables
export GROQ_API_KEY=gsk_...
export HF_TOKEN=hf_...
export ANTHROPIC_API_KEY=sk-ant-...
export GEMINI_API_KEY=...
export OPENAI_API_KEY=sk-...
Oppo A6x / 4GB Devices
Auto-detected. Optimal settings applied: 4 threads, Q8 KV cache, mmap on, Flash Attention on.
Recommended models:
wani --download llama-3.2-1b— 700MBwani --download llama-3.2-3b— 1.8GB ← best for 4GB
by Zain Ali · MIT License
1 maintainer
Metadata
1 maintainer
Release files for wfw-ai 3.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| wfw_ai-3.1.0.tar.gz | 21.2 kB | Without provenance | Details for wfw_ai-3.1.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| wfw_ai-3.1.0-py3-none-any.whl | Python 3 | none | any | Details for wfw_ai-3.1.0-py3-none-any.whl |
Total release size: 45.3 kB
Release files / wfw_ai-3.1.0.tar.gz
| Download URL | wfw_ai-3.1.0.tar.gz |
|---|---|
| Size | 21.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
85604054c810990119ee51b73fb92e55780a8f723212e6dfb77bf644256497a6
|
|
BLAKE2b-256 checksum How to use checksums |
5fe2f5472e3f618cb0891d512b523afae93798f9b03ab23eb74d09209cba5489
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
python-requests/2.34.2
|
Release files / wfw_ai-3.1.0-py3-none-any.whl
| Download URL | wfw_ai-3.1.0-py3-none-any.whl |
|---|---|
| Size | 24.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
1edb45ac6300e32afdcceb18dd60f6074025190d5d9a89c9992209de06b55e1b
|
|
BLAKE2b-256 checksum How to use checksums |
d808f35ec019a84c400f5086a6bc7b1e930df971dcc6d9a899cf776f74703f95
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
python-requests/2.34.2
|
Security for wfw-ai 3.1.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
