Skip to main content

Local AI inference for Africa — Ollama, open weights, degraded-mode fallbacks. 6 tools.

Project description

offline-mcp

offline-mcp Glama score smithery badge

Local AI inference infrastructure — Ollama wrapper, open weights directory, degraded-mode guide for East Africa.

PyPI Thesis Layer

Why: Never assume OpenAI survives, Anthropic stays accessible, or export controls disappear. This matters more in Africa than anywhere else.

1st world equivalent: Ollama, LLaMA, Mistral local deployment

Why This Exists: Data Sovereignty

"If you take the deal, you're going to be exploited. If you don't take it, you're going to die."
— Frank Ssekamwa, Ugandan digital rights expert

Across the Global South, AI and health data from communities is being extracted, processed abroad, and used to build models whose value flows away from the communities that generated it.

offline-mcp is the sovereignty floor of the East Africa coordination stack.

When this runs on a Raspberry Pi 4 with a 50W solar panel and a 256GB SD card:

  • Health data stays in the clinic. Health guidance comes from local models.
  • Land records stay in the land office. Queries don't touch foreign servers.
  • Civic data stays in the county. AI assistance runs without internet.

No API key. No cloud dependency. No data leaving the community.

The models available via offline-mcp (Llama 3.2, Qwen 2.5) run entirely on device. Community data used to generate AI outputs creates no dataset sent back to model providers.

This is not a privacy feature. It is the architectural foundation of digital independence.


Install

pip install offline-mcp

Tools (6)

Tool Description
check_ollama_status Check if Ollama is running locally and list available models
run_local_inference Run a prompt through a local Ollama model
list_recommended_models Best open-weight models for East Africa use cases
degraded_mode_guide 4-level degraded mode architecture for offline operation
open_weights_directory Directory of open-weight models with Africa language support
local_deployment_guide Deployment guide for laptop, server, Raspberry Pi, Android

Context

Runs on a 50W solar panel + Raspberry Pi 4. Viable for rural Kenya clinics, schools, and community offices.

The Nairobi Stack

License

MIT © Gabriel Mahia | contact@aikungfu.dev

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

offline_mcp-0.1.2.tar.gz (6.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

offline_mcp-0.1.2-py3-none-any.whl (7.2 kB view details)

Uploaded Python 3

File details

Details for the file offline_mcp-0.1.2.tar.gz.

File metadata

  • Download URL: offline_mcp-0.1.2.tar.gz
  • Upload date:
  • Size: 6.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for offline_mcp-0.1.2.tar.gz
Algorithm Hash digest
SHA256 16a252ab5725f21cb70cb21ace74172e8f7398344f0638d3e4817745bb2812b2
MD5 69d5fd083a072ac9d0b4eb51097b9c32
BLAKE2b-256 fc3f5435b026af5e6b3a5106ff9b7ae88826151c74b6f20766d23ef7601e2f28

See more details on using hashes here.

File details

Details for the file offline_mcp-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: offline_mcp-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 7.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for offline_mcp-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 cac34161866ce7c56b1cdbee894cd9fedf25b31648bf2e11b5e22507b848d3da
MD5 79c63e2b5be0e9a9c1409e864368dec8
BLAKE2b-256 b368b05ad4db128726bace1a6b6adffd26b6bb8c07d5162b271c045597ed1c49

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page