NobodyWho

Run LLMs locally and efficiently on any device

NobodyWho is a lightweight, open-source inference engine that makes it simple to run open-weights language models directly inside your Python applications. No API keys, no cloud infrastructure, no complexity—just fast, easy local AI.

Key Features

• Run locally, offline, for free - No API keys or cloud services required
• Fast, simple tool calling - Just pass normal Python functions
• Reliable tool execution - Automatically derives grammar from function signatures
• Infinite conversations - Conversation-aware preemptive context shifting prevents mid-conversation crashes
• GPU accelerated - Vulkan-powered inference for maximum performance
• Thousands of compatible models - Works with any LLM in GGUF format
• Powered by llama.cpp - Built on the proven llama.cpp engine

Quick Start

from nobodywho import Chat

chat = Chat('./model.gguf')
response = chat.ask('Hello world?').completed()
print(response)

Installation

pip install nobodywho

Documentation

Full documentation available at: https://docs.nobodywho.ooo/python/

License

EUPL-1.2 - Free for commercial and proprietary use. Modified versions of the library itself must remain open source.