Skip to main content

Local AI inference for Africa — Ollama, open weights, degraded-mode fallbacks. 6 tools.

Project description

offline-mcp

offline-mcp Glama score smithery badge


Compatible with claude-sonnet-5 (released 2026-06-30) — Anthropic's most agentic Sonnet yet. Runs multi-step tool chains end-to-end without stopping short. Install: pip install offline-mcp · Use with any MCP client.


Local AI inference infrastructure — Ollama wrapper, open weights directory, degraded-mode guide for East Africa.

PyPI Thesis Layer

Why: Never assume OpenAI survives, Anthropic stays accessible, or export controls disappear. This matters more in Africa than anywhere else.

1st world equivalent: Ollama, LLaMA, Mistral local deployment

Why This Exists: Data Sovereignty

"If you take the deal, you're going to be exploited. If you don't take it, you're going to die."
— Frank Ssekamwa, Ugandan digital rights expert

Across the Global South, AI and health data from communities is being extracted, processed abroad, and used to build models whose value flows away from the communities that generated it.

offline-mcp is the sovereignty floor of the East Africa coordination stack.

When this runs on a Raspberry Pi 4 with a 50W solar panel and a 256GB SD card:

  • Health data stays in the clinic. Health guidance comes from local models.
  • Land records stay in the land office. Queries don't touch foreign servers.
  • Civic data stays in the county. AI assistance runs without internet.

No API key. No cloud dependency. No data leaving the community.

The models available via offline-mcp (Llama 3.2, Qwen 2.5) run entirely on device. Community data used to generate AI outputs creates no dataset sent back to model providers.

This is not a privacy feature. It is the architectural foundation of digital independence.


Research Foundation

This server implements patterns validated by peer-reviewed research on offline-first AI for bandwidth-constrained environments:

arXiv:2603.03339 (2026) — Offline-First LLM Architecture for Adaptive Learning in Low-Connectivity Environments — confirms that meaningful AI support is achievable with hardware-aware model selection when designed for infrastructure-limited deployment. Key finding: offline-first is a complementary paradigm, not a compromise.

Design principles applied:

  • Local-first: all core operations execute without internet connectivity
  • Graceful degradation: reduced functionality beats no functionality
  • JSONL queue: events accumulated offline sync when connectivity returns
  • Hardware-aware: tool selection adapts to available compute

East Africa context: Kenya, Tanzania, Uganda — rural areas with intermittent connectivity represent the primary deployment target. This server is not designed for ideal conditions. It is designed for real ones.

Install

pip install offline-mcp

Tools (6)

Tool Description
check_ollama_status Check if Ollama is running locally and list available models
run_local_inference Run a prompt through a local Ollama model
list_recommended_models Best open-weight models for East Africa use cases
degraded_mode_guide 4-level degraded mode architecture for offline operation
open_weights_directory Directory of open-weight models with Africa language support
local_deployment_guide Deployment guide for laptop, server, Raspberry Pi, Android

Context

Runs on a 50W solar panel + Raspberry Pi 4. Viable for rural Kenya clinics, schools, and community offices.

The Nairobi Stack

License

MIT © Gabriel Mahia | contact@aikungfu.dev

Part of the East Africa Coordination Stack

This MCP server is one of 32 tools in the Kenya coordination infrastructure. Connect it to africa-coord-bus — the coordination event bus that routes signals between domains automatically.

pip install africa-coord-bus

All 32 servers: pypi.org/user/gmahia Live demo: coord-cascade-demo

IP & Collaboration

MIT licensed. Feedback via GitHub Issues only — pull requests are not accepted. Demo data is labeled DEMO and is not suitable for operational decisions. Full policy: docs/architecture/IP_POLICY.md. Security reports: see SECURITY.md.

Part of the East Africa coordination stack

Model-agnostic by design: closed APIs, open-weight models, and small distilled models are all first-class citizens.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

offline_mcp-0.1.4.tar.gz (8.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

offline_mcp-0.1.4-py3-none-any.whl (8.6 kB view details)

Uploaded Python 3

File details

Details for the file offline_mcp-0.1.4.tar.gz.

File metadata

  • Download URL: offline_mcp-0.1.4.tar.gz
  • Upload date:
  • Size: 8.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for offline_mcp-0.1.4.tar.gz
Algorithm Hash digest
SHA256 895a81a0027cc1e866d740ee3e6a67630e7896800b1a0bc7d982c7305485f5ed
MD5 9ffced05108554e98117365d955eedcc
BLAKE2b-256 4354a9c461fcb45dcd37207cfa66b91028bc2a7b46a8ce6ca03877e2c077bf22

See more details on using hashes here.

File details

Details for the file offline_mcp-0.1.4-py3-none-any.whl.

File metadata

  • Download URL: offline_mcp-0.1.4-py3-none-any.whl
  • Upload date:
  • Size: 8.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for offline_mcp-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 2cbf74acfe9b1e5dbf4568e3cbdf036448142a4cd70d7cd6fa5aad4fcba3e4a3
MD5 9ecd323cd1902ffebd7fd8c37d1a4cca
BLAKE2b-256 8d67138bfb45733deb1b5ed8fc9f304420b5938eb968ac4d8355aee8cdf5eee8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page