Skip to main content

OpenKOS

Open Knowledge Orchestration System — a local-first engine for the Open Knowledge Format.

OpenKOS turns your scattered text into a living, portable knowledge base your AI agents can actually use — compiled once, kept current, and stored as plain Open Knowledge Format files so it is never locked to any app, model, or vendor.

Project status: alpha. OpenKOS runs: the Compiler and the Graph-and-Memory arcs (MVP 1 and MVP 2) are complete — 25 CLI verbs, hybrid retrieval, and the full forget/purge lifecycle all ship today. The API may still change between releases, but OpenKOS is published and installable now — pip install openkos, see Getting started. Early contributors and feedback are welcome — see Contributing.


The problem

Your AI assistant forgets everything between sessions, so you re-explain the same context every time and the insights you build together disappear into chat history. Meanwhile your notes pile up in folders nobody keeps current. Two powerful things — your knowledge and your models — sit side by side, disconnected.

Retrieval (RAG) doesn't fix this: it re-reads your raw documents on every question and rediscovers everything from scratch. Nothing accumulates. The cross-references are never drawn, the contradictions never reconciled.

The idea

Instead of retrieving from raw sources every time, an LLM can incrementally build and maintain a persistent, interlinked knowledge base that sits between you and your sources — Andrej Karpathy's LLM Wiki pattern. Knowledge is compiled once and then kept current. It compounds.

In June 2026 Google Cloud published a vendor-neutral specification for that pattern: the Open Knowledge Format (OKF) — a directory of markdown files with YAML frontmatter, portable across any tool. It is young (v0.1, still a draft) but open, minimal, and gaining adoption. Google's framing was: "What's missing is a format, not another service," and they invited the community to build producers and consumers.

OpenKOS is that producer and consumer, built for individuals and running entirely on your machine.

Before / after

Without OpenKOS With OpenKOS
Asking your AI about your own notes It re-reads raw files every time It answers from a compiled, cited knowledge base
New source Piles up unread Compiled into a Source plus typed knowledge objects, each linked to its source
Provenance "Where did this come from?" is a guess Every object links back to its immutable source
Facts that change Old claims quietly rot Freshness stamps keep the base honest over time
Portability Trapped in one app Plain OKF files — open in Obsidian, VS Code, GitHub, anything
Privacy Your knowledge leaves your machine Local-first, offline-capable, local models

What it feels like

# point OpenKOS at a folder of text and compile it into an OKF bundle
openkos ingest ./sources

# ask a question and get a cited answer from the compiled knowledge
openkos query "what did I conclude about how to live well?"

# check the base stays honest — stale `as of` stamps and orphan pages
openkos lint

(The full command set — 25 verbs spanning ingest, cited query, the typed graph, entity resolution, volatility tiers (suggest-volatility/set-volatility), the guided curate/next curation loop, and the forget/purge lifecycle — is in docs/cli.md.)

Getting started

Alpha: the commands below run today. OpenKOS is on PyPI — install the released version below, or install from the GitHub repository to track the latest main. The API may still change between releases.

OpenKOS is a local-first command-line tool. You install the engine once, then create a knowledge bundle per knowledge base — much like installing git once and running git init in many repositories.

Prerequisites: Python 3.12+; git; git-filter-repo (only needed for purge); and a local model runtime — Ollama with the chat model (ollama pull qwen3:8b) and the embedding model (ollama pull bge-m3) pulled. No accounts, no API keys: nothing leaves your machine.

Install the engine (once):

uv tool install openkos   # or: pipx install openkos — or: pip install openkos

This installs the openkos command on your PATH. To try it once without a persistent install, run it ephemerally:

uvx openkos --help

Prefer the latest unreleased main? Install from the repository instead — the same command with a git URL:

uv tool install git+https://github.com/jasonssdev/openkos

Create a bundle (per knowledge base). By convention the first workspace lives at the root of your home directory, named knowledge:

mkdir ~/knowledge && cd ~/knowledge
openkos init

init scaffolds the workspace — raw/ for your immutable sources and bundle/ for the compiled OKF bundle (starting with just index.md and log.md; concept-type folders are never pre-created, only added as you ingest) — then writes AGENTS.md and, last, the openkos.yaml marker. It refuses without writing anything if the directory already looks like a workspace.

You never run git yourself. init also turns the workspace into a git repository, writes a .gitignore (the derived .openkos/ stays out of version control), and makes the first commit; from then on every mutating command auto-commits its own writes. Git remains fully available for inspection and undo (git log, git diff, git revert) — it is just no longer a chore. Sources sit beside the bundle rather than inside it, so bundle/ stays pure OKF: portable, conformant, and shareable on its own.

Then the loop:

openkos ingest ./meeting-notes.txt   # compile a source into the bundle
openkos query "what did we decide?"  # get a cited answer

See docs/cli.md for the full command reference and docs/user-journey.md for the end-to-end experience.

Philosophy

  • Local-first and private by default. Runs on your machine, works offline, built for local models. The cloud is optional, never required.
  • Standard-aligned, not bespoke. We adopt OKF rather than invent a format, and adopt its definitions rather than restate them. An open, vendor-neutral specification is the most agnostic choice there is.
  • Living knowledge, honest over time. Sources are immutable; concept documents evolve as you learn; fast-changing facts carry freshness stamps so nothing silently becomes a lie.
  • The human curates; the engine maintains. You source, explore, and ask. OpenKOS does the bookkeeping — extraction, linking, freshness, indexing.
  • Reconstructible and explainable. Every index, embedding, and graph rebuilds from the canonical bundle plus sources. Answers always cite.

How OpenKOS relates to the ecosystem

We build on the shoulders of prior work rather than competing with it:

  • Karpathy's LLM Wiki — the seminal pattern. OpenKOS is a concrete engine that instantiates it.
  • Open Knowledge Format (Google Cloud) — the standard we store and exchange in. Google's reference stack targets enterprise cloud data (BigQuery); OpenKOS is its local-first, personal counterpart.
  • Obsidian-based tools (obsidian-mind, obsidian-second-brain) — excellent, but tied to Obsidian and packaged as prompt/skill conventions. OpenKOS is a standalone, app-agnostic engine whose output is portable OKF.

The wedge, in one line: the local-first, personal producer-consumer-runtime for OKF that nobody else has built.

Roadmap at a glance

OpenKOS ships in three MVP arcs, each usable on its own. Full detail in docs/roadmap.md.

  • MVP 1 — The Compiler. (Complete.) The Karpathy loop, locally, over text: ingest → OKF concepts with provenance → cited query → freshness lint. Useful in an afternoon.
  • MVP 2 — The Graph and Memory. (Complete.) Entity/relationship extraction and reversible merge, a typed knowledge graph (an OpenKOS layer over OKF's untyped links — other tools still read the bundle fine), hybrid retrieval (lexical FTS5 + local vectors + graph, fused via RRF with PageRank), a fail-closed sensitivity filter (confidential concepts never leave the machine — held back from any backend that is not verifiably local), reference-aware forget plus an irreversible purge (right-to-be-forgotten), and answers that file back into the base (query --save, the two-output rule).
  • MVP 3 — The Runtime and Interoperability. An MCP server and APIs so agents use OpenKOS as durable memory; full OKF import/export with the wider ecosystem.

Beyond that: a desktop app, graph visualization, richer memory, and federation — explored only after the MVPs prove out with real users.

Documentation

Contributing

OpenKOS is early, which is the best time to shape it. The clearest entry points are the "community can contribute" notes under the current MVP in the roadmap. Please open an issue to discuss anything larger than a small change before sending a PR, so we can make sure it fits and can be merged.

See CONTRIBUTING.md for how to get involved and CODE_OF_CONDUCT.md for community standards. Maintainers: see MAINTAINERS.md for how contributions are reviewed and decided.

License

Apache License 2.0 — see LICENSE.

Release files for openkos 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for openkos 0.2.1
File Size Uploaded
openkos-0.2.1.tar.gz 354.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for openkos 0.2.1
File Interpreter ABI Platform
openkos-0.2.1-py3-none-any.whl Python 3 none any Details

Total release size: 751.4 kB

Release files / openkos-0.2.1.tar.gz

Download URL openkos-0.2.1.tar.gz
Size 354.7 kB
Tags Source
SHA-256 checksum
How to use checksums
cab40c9b5247e84a7e4f489085442ce7ec23cdd33ff4830b7d621e5c9af703a8
BLAKE2b-256 checksum
How to use checksums
dc920ac9d50f4b710dca5feeaf01570e872eb5656f141be2107739baba000b28
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.12.1 {"installer":{"name":"uv","version":"0.12.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / openkos-0.2.1-py3-none-any.whl

Download URL openkos-0.2.1-py3-none-any.whl
Size 396.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
866ec03794036af6486089c8982020812631e1de314021a2e699460c65097e6a
BLAKE2b-256 checksum
How to use checksums
cda2e18c6fcc8fe6e6f4bab69e3edbd34fe46528a648535c371faef41f1b517b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.12.1 {"installer":{"name":"uv","version":"0.12.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release history Release notifications | RSS feed

0.2.14

2 release files

0.2.13

2 release files

0.2.12

2 release files

0.2.11

2 release files

0.2.10

2 release files

0.2.9

2 release files

0.2.8

2 release files

0.2.7

2 release files

0.2.6

2 release files

0.2.5

2 release files

0.2.4

2 release files

0.2.3

2 release files

This release

0.2.1 This release

2 release files

0.2.0

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page