Skip to main content

Cross-agent distributed memory over a mesh transport (currently Zenoh)

Project description

kioku-mesh

Persistent, mesh-synced memory for your AI coding agent. Start on one machine in 30 seconds. Use the same memory across machines when you need it.

30-second local start

pip install -e git+https://github.com/h-wata/kioku-mesh.git#egg=kioku-mesh
# or: uv tool install git+https://github.com/h-wata/kioku-mesh.git
$ kioku-mesh init --mode local
wrote ~/.config/mesh-mem/config.yaml
local backend ready — no zenohd required.
next: kioku-mesh save "hello local"

$ kioku-mesh save "Chose Postgres over SQLite for analytics"
saved: a1b2c3d4...

$ kioku-mesh search "Postgres"
[note][2] 2026-05-22T07:51:47
Chose Postgres over SQLite for analytics <id=a1b2c3d4...>

$ kioku-mesh mcp install

No daemon. No extra binary. Your agent starts reading and writing memory immediately.

What this is

kioku-mesh gives your AI coding agents (Claude Code, Codex CLI, Gemini CLI…) a shared long-term memory that survives session resets and syncs across hosts over a LAN, VPN, or mesh-VPN. A decision saved on your desktop is instantly searchable on your laptop — or by a different agent on the same machine.

Architecture: Tier 0 / 1 / 2

Tier What runs What you get Dependencies
Tier 0 SQLite only (no zenoh library started) Single-machine persistence (save / search) None beyond kioku-mesh
Tier 1 zenoh-python in mode=router (in-process) Ephemeral multi-host mesh, no extra binary zenoh-python
Tier 2 auto-downloaded zenohd + zenoh-backend-rocksdb Persistent multi-host mesh zenohd (auto-provisioned)

Tier 0 is the default --mode local. It writes to a local SQLite database and requires nothing beyond the kioku-mesh package itself. Zero daemon, zero extra install.

Tier 1 lifts the same SQLite store into an in-process Zenoh router so multiple machines can share observations over TCP without running a separate zenohd binary. Sessions are ephemeral — observations sync while the router is running but are not replicated to persistent storage across hosts.

Tier 2 adds persistence across restarts by routing through zenohd with the RocksDB backend. Observations survive host reboots and propagate to peers that were offline during a write. This is the setup documented in the Power users section.

What you get

  • Single-machine persistence — save and search on one machine, no daemon, no extra install (Tier 0, --mode local). Your agent's memory survives session resets.
  • One-command MCP registrationkioku-mesh mcp install wires the MCP server into your agent's config with sensible defaults; no JSON / TOML hand-editing required.
  • Multi-agent support — Claude Code, Codex CLI, Claude Desktop, Gemini CLI, and ChatGPT Desktop can all read and write the same memory pool.
  • Self-diagnosiskioku-mesh doctor checks backend reachability, config, and storage health with actionable hints.
  • SQLite-first local search — fast substring search and tab-completion without any network round-trips.
  • Soft-delete with GCkioku-mesh delete writes a tombstone; kioku-mesh gc physically purges expired records.
  • stdio MCP transport — works with all agents that support MCP stdio; no HTTP tunnel or auth layer needed for trusted-LAN usage.
  • Multi-host shared memory (opt-in) — extend to a multi-machine mesh via Power users: multi-host mesh. No changes to save / search / MCP workflows required.

Try it (local-only quickstart)

Install kioku-mesh

# recommended
uv tool install git+https://github.com/h-wata/kioku-mesh.git
# alternatives:
#   uv tool install --editable .                          # local checkout
#   python3 -m venv ~/.venv/mesh-mem && \
#     ~/.venv/mesh-mem/bin/pip install -e '.[dev]'

After install, both kioku-mesh (CLI) and kioku-mesh-mcp (MCP server) land on PATH.

Two binaries — know the difference

  • kioku-mesh (one hyphen) — the CLI. Run this yourself.
  • kioku-mesh-mcp (two hyphens) — the stdio MCP server. Spawned by MCP clients automatically; running it from a terminal prints a usage message and exits.

Initialize local backend

kioku-mesh init --mode local
# wrote ~/.config/mesh-mem/config.yaml
# local backend ready — no zenohd required.

Save and search

# basic save
kioku-mesh save "note content" --project demo --tags a,b

# structured save (memory_type / importance / subject / summary; all optional)
kioku-mesh save "store oidc tokens server-side, never in client cookies" \
    --project demo --memory-type decision --importance 4 \
    --subject "auth flow" --summary "pick OIDC over session cookies"

kioku-mesh search "note"               # default --limit 50, summary-first display
kioku-mesh get-memory <observation_id> # full record (32-char id)
kioku-mesh status

Verify with kioku-mesh doctor

kioku-mesh doctor          # human-readable PASS / FAIL with hints
kioku-mesh doctor --json   # machine-readable; same checks

Exit code: 0 all pass, 1 warnings, 2 any failure (scriptable). Current v0.3 check set:

  • config_file~/.config/mesh-mem/config.yaml exists (kioku-mesh init if not)
  • state_dir_hardlinksMESH_MEM_STATE_DIR is writable and supports POSIX hard links

JSON shape:

{
  "ok": false,
  "worst_status": "fail",
  "checks": [
    {"name": "config_file", "status": "fail",
     "summary": "~/.config/mesh-mem/config.yaml not found",
     "hint": "Run: kioku-mesh init --mode local"}
  ]
}

Ready to use memory across multiple machines? See Power users: multi-host mesh.

Use it with your agent (MCP)

Two binaries — know the difference

  • kioku-mesh (one hyphen) — the CLI. Run this yourself: kioku-mesh mcp install, kioku-mesh status, etc.
  • kioku-mesh-mcp (two hyphens) — the stdio MCP server. It is spawned in the background by an MCP client (Claude Code, Codex CLI, Claude Desktop…); you do not type this command directly. Running it from a terminal will print a usage message and exit.

One-shot install: kioku-mesh mcp install

For the two most common clients, kioku-mesh mcp install automates the registration so you don't have to hand-edit a JSON or TOML config:

# Claude Code (delegates to `claude mcp add` under the hood)
kioku-mesh mcp install --client claude-code

# Codex CLI (writes the [mcp_servers.mesh_mem] block into ~/.codex/config.toml)
kioku-mesh mcp install --client codex-cli

Both forms bake the absolute path to kioku-mesh-mcp into the registration, set sensible MESH_MEM_AGENT_FAMILY / MESH_MEM_CLIENT_ID defaults per client.

Useful flags:

Flag Purpose
--name NAME registry key (default mesh_mem; matches existing docs)
-e KEY=VALUE extra env var; repeatable. Overrides the per-client defaults.
--dry-run print the claude mcp add command or the TOML block instead of executing
--force replace an existing registration of the same name

Claude Desktop, Gemini CLI, and ChatGPT Desktop are still set up via the manual recipes in docs/mcp-clients.md — Claude Desktop pending macOS / Windows verification, the rest pending stable upstream config schemas.

Manual registration

Register the kioku-mesh-mcp console script in each agent's MCP config. Use the absolute path to the installed binary — typically ~/.local/bin/kioku-mesh-mcp when installed via uv tool install, or ~/.venv/mesh-mem/bin/kioku-mesh-mcp for a manual venv. The PATH-dependent form breaks when agents are launched from a desktop shortcut with a different environment. Per-client setup (Claude Code via claude mcp add, Claude Desktop, Gemini CLI, Codex CLI, ChatGPT Desktop), the non-interactive claude -p smoke recipe, optional MESH_MEM_SESSION_ID pinning, and the Claude Code SessionStart hook for cross-peer context injection all live in docs/mcp-clients.md (日本語版).

Power users: multi-host mesh

The recommended layout is 1 hub + N spokes: one always-on peer acts as the hub and listens on every IP that any spoke can reach (LAN, Tailscale, VPN). Each spoke dials only the hub. Zenoh router transit then carries traffic between spokes without a direct link, so adding a new spoke does not require touching any existing peer's config or restarting them. Verified empirically with a 3-PC test on 2026-05-10 (docs/poc-reports/topology-2026-05-10.md).

Step 1 — Install zenohd

kioku-mesh stores observations in a Zenoh router (zenohd) with the RocksDB storage backend. Both must be on PATH before running kioku-mesh init. They are separate packages not pulled in by the kioku-mesh install.

Target version: Zenoh 1.9.0. Older zenohd 1.5 builds are reachable but lack first-class RocksDB replication.

apt (Debian / Ubuntu)

sudo install -d /etc/apt/keyrings
curl -L https://download.eclipse.org/zenoh/debian-repo/zenoh-public-key \
  | sudo gpg --dearmor --yes --output /etc/apt/keyrings/zenoh-public-key.gpg
echo 'deb [signed-by=/etc/apt/keyrings/zenoh-public-key.gpg] https://download.eclipse.org/zenoh/debian-repo/ /' \
  | sudo tee /etc/apt/sources.list.d/eclipse-zenoh.list > /dev/null
sudo apt update
sudo apt install zenoh zenoh-backend-rocksdb

Required packages: zenoh (the zenohd binary) and zenoh-backend-rocksdb (libzenoh_backend_rocksdb.so).

Other platforms / non-apt installs

Follow the official Zenoh docs: zenoh.io/docs/getting-started/installation. Both zenohd and zenoh-backend-rocksdb must be version-matched (mixing 1.9 with 1.5 or 2.x will silently misbehave at storage startup).

Verify

zenohd --version
# expected: zenohd v1.9.0 ...

zenohd -c ~/.config/mesh-mem/zenohd.json5
# look for: Successfully loaded backend "rocksdb" ...

If the rocksdb log line is missing, the backend library is not on the plugin search path — re-check your install.

Step 2 — Configure and start zenohd

kioku-mesh init          # writes ~/.config/mesh-mem/zenohd.json5 (loopback, single host)
zenohd -c ~/.config/mesh-mem/zenohd.json5   # leave running in another terminal

The default init writes a single-host config: loopback listen, in-memory volume (no RocksDB dependency, no persistence across restarts), multicast scouting disabled.

To pin identity across runs:

export MESH_MEM_AGENT_FAMILY=claude
export MESH_MEM_CLIENT_ID=claude-code

After restarting zenohd or your host, kioku-mesh may briefly return fewer results until peer alignment completes (typically 5–10 s, up to ~3 min for cold-era data). Use kioku-mesh status to check readiness (mesh_ready: yes when alignment is complete).

Multi-host mesh setup

Steps

  1. Pick the hub. Choose the always-on peer (typically a desktop / home server). Make sure its listen endpoints cover every network that any spoke can reach: LAN, Tailscale, VPN — aggregate them now so later spokes don't force a hub restart.

  2. Generate per-peer configs with kioku-mesh init.

    # on the hub — listen on loopback + every LAN/VPN IF spokes will reach
    kioku-mesh init --mode hub \
        --listen 127.0.0.1 \
        --listen 192.168.3.10 \
        --listen 100.64.0.5
    
    # on each spoke — dial the hub
    kioku-mesh init --mode spoke \
        --listen 127.0.0.1 \
        --listen 192.168.3.21 \
        --connect 192.168.3.10
    

    Both modes write to ~/.config/mesh-mem/zenohd.json5 by default and emit a rocksdb + replication block whose digest parameters match byte-for-byte across peers. kioku-mesh init without --listen opens an interactive picker that lists detected interface IPs.

    For 5+ peers or a precise walkthrough with example IPs, see config/peers/example_5peer.md. The bundled config/zenohd_peer.json5.template is still available for anyone who prefers hand-editing.

  3. Open the firewall. TCP/7447 from every spoke to the hub (the hub's inbound rule is what matters; spokes typically only need outbound). See Firewall section below for ufw / iptables recipes.

  4. Start zenohd on each peer.

    export ZENOH_BACKEND_ROCKSDB_ROOT="$HOME/.local/share/mesh-mem"
    mkdir -p "$ZENOH_BACKEND_ROCKSDB_ROOT"
    zenohd -c ~/.config/mesh-mem/zenohd.json5
    

    Hub first is convenient but not required; spokes retry their connect until the hub answers.

  5. Verify connectivity.

# on peer1
kioku-mesh save "mesh-check from peer1" --project mesh-check

# on every other peer
kioku-mesh search "mesh-check from peer1" --limit 5
# every peer should see the observation once the replication interval elapses

Troubleshooting

Symptom Likely cause Check
nc -vz <peer> 7447 refused / times out Firewall, NAT, VPN down Open port; confirm tunnel route
Connects but no observations cross Storage block mismatch (different interval / hot / warm) diff the two configs
Some peers see it, others don't Clock drift > a few seconds chronyc tracking (see Time sync)
Search returns nothing on all peers MESH_MEM_DISABLE_INDEX=1 plus stale fallback unset MESH_MEM_DISABLE_INDEX and retry
Observations duplicate in search results Pre-v0.2.0 MESH_MEM_DISABLE_INDEX=1 fallback Upgrade to v0.2.0 (#12 fix)

For the full 5-peer setup with example IPs, firewall rules, and add/remove procedures, see config/peers/example_5peer.md.

To run the localhost 5-peer smoke test (requires pip install -e '.[dev,test]'):

pip install -e '.[dev,test]'   # installs PyYAML and other test deps
PYTHONPATH=src python3 scripts/smoke_5peer_mesh.py

Reference / config / troubleshooting

kioku-mesh init flags

Flag Purpose
--mode local (default) SQLite-only local backend; no zenoh, no daemon
--mode localhost loopback + in-memory volume; no rocksdb, no replication
--mode hub LAN-facing router with rocksdb + replication; spokes dial in
--mode spoke rocksdb + replication; dials the hub (requires --connect)
--listen ENDPOINT repeatable. Accepts ip, ip:port, or tcp/ip:port. If omitted on hub/spoke, an interactive picker lists detected IFs.
--connect ENDPOINT repeatable. Required for --mode spoke.
--out PATH override output path (default: ~/.config/mesh-mem/config.yaml, honors XDG_CONFIG_HOME)
--force overwrite an existing file
--print emit to stdout instead of writing a file
--install-systemd also write a user-scope systemd unit at ~/.config/systemd/user/mesh-mem-zenohd.service so zenohd starts on login. Linux only — macOS / Windows / non-systemd hosts get a clear error.

CLI startup: --rebuild and MESH_MEM_FORCE_REBUILD

kioku-mesh (the CLI) is a one-shot process. Since v0.2.4 it skips the startup rebuild_from_zenoh scan by default — on a populated mesh that scan can add ~15 s to every CLI invocation (#38). The local SQLite index still converges via the replication subscriber while the process is running, so save / search / get-memory / delete / status all see live writes from this and other peers.

Long-running processes (kioku-mesh-mcp, autonomous agents) keep the default — they pay the rebuild cost once at startup.

Opt back in for a single CLI run when you need the index aligned with the on-disk Zenoh storage:

kioku-mesh --rebuild status               # explicit per-invocation flag
MESH_MEM_FORCE_REBUILD=1 kioku-mesh search hello   # env-level equivalent

Full resolution order: --rebuild flag > MESH_MEM_FORCE_REBUILD > MESH_MEM_SKIP_REBUILD > module default (True for long-lived processes, False for the CLI).

Shell completion (optional)

kioku-mesh ships an argcomplete-based completer for bash / zsh (#76):

pip install -e '.[completion]'
# bash
eval "$(register-python-argcomplete kioku-mesh)"
# zsh: add to ~/.zshrc
#   autoload -U bashcompinit && bashcompinit
#   eval "$(register-python-argcomplete kioku-mesh)"

--project / --pc-id / --by-pc-id use dynamic completers that read distinct values from the local SQLite index only (no Zenoh round-trip) so tab-completion stays fast even when the mesh is large.

Architecture summary

  • Source of truth (Tier 0): SQLite local database under MESH_MEM_STATE_DIR.
  • Source of truth (Tier 2): Zenoh + RocksDB storage under mem/obs/** and mem/tomb/**.
  • Read path: SQLite local sidecar index by default; Zenoh full-scan fallback with MESH_MEM_DISABLE_INDEX=1.
  • Delete model: logical delete is an existence-based tombstone; physical delete is handled by kioku-mesh gc.
  • Identity: agent_family / client_id come from env, pc_id is persisted per host, session_id is stable per process.
  • Interfaces: CLI (kioku-mesh) and stdio MCP server (kioku-mesh-mcp) share the same store primitives.

Status & known limitations

kioku-mesh is a LAN / VPN / mesh-VPN shared memory for trusted peers. Trust comes from network admission, not transport-level auth. LAN replication, DR, and split-brain recovery have been verified on a 2-host setup (1,192 writes across a ~24 h partition, data integrity verified G3 / G4 / Tombstone); the default read path uses a SQLite sidecar index backed by Zenoh + RocksDB.

Scope decision: no transport-level auth or encryption

kioku-mesh intentionally carries no in-protocol authentication or encryption. mem/** and mem/tomb/** are readable and writable by anyone who can reach port 7447 — the security boundary is the network itself. This is a deliberate scope choice: trusted-peer shared memory on a LAN, VPN, or mesh-VPN (Tailscale, WireGuard) where admission control is handled at the network layer.

⚠️ Do not expose port 7447 to untrusted networks. Never open to the internet or to an untrusted LAN segment. See Firewall for per-peer allow rules.

stdio MCP transport only. Works with Claude Code, Claude Desktop, Gemini CLI, and Codex CLI. Web apps (claude.ai, chatgpt.com) are not supported — they require HTTP/SSE transport + tunnel + auth, which is out of this project's current scope.

Versioning

kioku-mesh follows SemVer with the explicit caveat that 0.x is experimental: minor version bumps may include breaking changes to APIs and on-disk storage schema. The CHANGELOG announces every break, but a stable migration path is only guaranteed from 1.0 onward. 1.0 will lock in API stability and the storage schema.

Operational notes

  • Cold-era resync is step-function, not incremental. After reconnect, a peer that has been offline may show 0 obs for 97–282 s before jumping to the full count. Hot/warm-era reconvergence stays at ~5 s as designed. See plan.md for the real-world validation results.
  • gc broadcast is best-effort. A replica unreachable during gc --force-id catches up on its next local gc --retention-days run; there is no delivery-confirmation channel.
  • MAX_SEARCH is a return-size cap, not a scan budget. The default search path is the SQLite sidecar index with case-insensitive substring matching against payload_json; MAX_SEARCH=10000. With MESH_MEM_DISABLE_INDEX=1, the legacy Zenoh full-scan fallback is used. No FTS5 full-text search.
  • Logical vs physical delete. kioku-mesh delete / delete_memory write a tombstone; the observation is hidden from search but still stored. kioku-mesh gc --retention-days N (default 30) physically removes expired tombstones plus their observations. kioku-mesh gc --force-id <obs_id> broadcasts a best-effort immediate purge to every replica.

See docs/Spec.md for the current behavior, plan.md for design notes, and gh issue list --state open for live tracking.

Multi-agent identity (single host, multiple agents)

kioku-mesh composes Zenoh keys from a 4-tier identity (agent_family / client_id / pc_id / session_id) so two agents on the same host land at non-colliding keys. Setup recipes for multiple terminals, direnv, and MCP-launched agents live in docs/multi-agent.md (日本語版).

Operations

systemd unit (zenohd)

Easiest path is kioku-mesh init --install-systemd (#86), which writes both ~/.config/mesh-mem/zenohd.json5 AND ~/.config/systemd/user/mesh-mem-zenohd.service in one step, with the absolute zenohd path baked in. Enable with systemctl --user daemon-reload && systemctl --user enable --now mesh-mem-zenohd.

The manual template below is still documented for operators who want custom paths or system-scope (/etc/systemd/system/). Drop it at ~/.config/systemd/user/mesh-mem-zenohd.service and enable with the same command. Replace /ABSOLUTE/PATH/TO/kioku-mesh with the actual checkout path on the host — the unit has no way to discover where you cloned the repo.

[Unit]
Description=kioku-mesh zenohd router
After=network-online.target
Wants=network-online.target

[Service]
Type=simple
Environment=ZENOH_BACKEND_ROCKSDB_ROOT=%h/.local/share/mesh-mem
ExecStartPre=/usr/bin/install -d %h/.local/share/mesh-mem
# EDIT: absolute path to your kioku-mesh checkout, plus home or office config.
ExecStart=/usr/bin/zenohd -c /ABSOLUTE/PATH/TO/mesh-mem/config/zenohd_home.json5
Restart=on-failure
RestartSec=5s

[Install]
WantedBy=default.target

Swap zenohd_home.json5 for zenohd_office.json5 on the office host. For system-scope, move to /etc/systemd/system/ and replace %h with an absolute home path too.

Auto-start with systemd (system-wide drop-in)

If zenohd was installed via apt, it ships a base unit at /usr/lib/systemd/system/zenohd.service whose ExecStart targets /etc/zenohd/zenohd.json5 — not the kioku-mesh config. Use a drop-in override to redirect it without modifying the base unit.

# 1. Create the drop-in directory
sudo mkdir -p /etc/systemd/system/zenohd.service.d/

# 2. Copy the example
sudo cp docs/systemd-zenohd-override.example.conf \
    /etc/systemd/system/zenohd.service.d/override.conf

# 3. Edit User= and ExecStart= for your environment
sudo $EDITOR /etc/systemd/system/zenohd.service.d/override.conf

# 4. Reload and enable
sudo systemctl daemon-reload
sudo systemctl enable --now zenohd.service
sudo systemctl status zenohd.service
  • Home node: use config/zenohd_home.json5
  • Office node: change ExecStart= to config/zenohd_office.json5
  • %h in the example expands to the home directory of User=; no absolute paths needed except for the config file itself.

Firewall

7447/tcp must be reachable only between the two peer PCs on the LAN.

ufw
# home, assuming office is 192.168.3.y
sudo ufw allow from 192.168.3.y to any port 7447 proto tcp comment 'kioku-mesh'
sudo ufw reload
iptables
sudo iptables -A INPUT -p tcp --dport 7447 -s 192.168.3.y -j ACCEPT
sudo iptables -A INPUT -p tcp --dport 7447 -j DROP

Do NOT open 7447 to the whole LAN or the internet. The PoC has no transport-level auth; anyone who reaches the port can read and write mem/**.

Time sync

kioku-mesh depends on the host wall clock in three places:

  • created_at — set at save time by models.py:_utc_now_iso(); appears in search_memory output and in --since-iso comparisons.
  • --since-iso filtersearch_observations parses and compares timestamps from both hosts; silent clock skew shifts the effective cutoff by the drift amount.
  • gc --retention-days — tombstone expiry is evaluated using deleted_at from each replica's local clock; skewed clocks cause asymmetric expiry.
Install chrony (recommended)

chrony is the recommended NTP client. It supports makestep for immediate large-offset correction, which systemd-timesyncd (the default on Ubuntu) does not.

# Debian / Ubuntu
sudo apt install chrony
sudo systemctl enable --now chrony
Verify alignment — both hosts
# Per-host offset (run on each node)
chronyc tracking | grep -E 'Stratum|Last offset|RMS offset|System time'

# Upstream source quality
chronyc sources -v

# Cross-host sanity check — run simultaneously on both nodes and compare
date -u

Recommended thresholds:

  • Each node Last offset < 100 ms
  • Observed inter-host drift (date -u difference) < 100 ms

timedatectl status alone is not a reliable indicator of inter-host alignment.

During NTP skew testing (TASK-122) both Home and Office reported NTP service: active / synchronized: yes via timedatectl, yet the actual wall-clock difference between the two hosts was 12.75 seconds. This happened because synchronized: yes only means the host has reached its own NTP server — it says nothing about whether two hosts share the same time reference or have converged to within a useful tolerance of each other.

Always cross-check with date -u on both nodes, or use chronyc tracking and compare System time offsets.

Drift recovery

If you detect a large offset after the fact:

# timedatectl set-ntp true only slews the clock slowly — may take minutes/hours
# for large offsets. Use chronyc makestep for immediate correction:
sudo chronyc makestep

# Confirm
chronyc tracking | grep 'Last offset'
PoC verification

See docs/poc-reports/SUMMARY.md §8.4 for the skew boundary test results. Key findings: replication integrity held at ±10 s skew, but --since-iso filter cutoffs shifted proportionally and timedatectl proved unreliable as an inter-host alignment signal.

Retention / gc

kioku-mesh gc performs physical deletion; the default retention is 30 days.

# Daily retention sweep via user cron (run on ONE host; replication carries the deletes).
# Appends to the existing crontab rather than replacing it. Re-running is idempotent only
# if the exact same line is not already present, so check `crontab -l` afterwards.
( crontab -l 2>/dev/null; echo '15 3 * * * ~/.venv/mesh-mem/bin/kioku-mesh gc --retention-days 30' ) | crontab -

Emergency purge

When sensitive data lands in the mesh unintentionally:

# 1. On the host where you first noticed it — tombstones via MCP or CLI also work,
#    but force-id covers the case where the obs is still unreachable locally.
kioku-mesh gc --force-id <32-char observation_id>

# 2. Repeat on every peer PC. broadcast purge is best-effort;
#    running on each replica is the safety guarantee.

gc --force-id always exits 0 once the broadcast has been sent — even when the local replica never held the record — because a reachable peer may have completed the purge.

Windows host setup

kioku-mesh development is Linux-first and WSL2 is strongly recommended on Windows. Native Windows host setup — Python install, zenohd + RocksDB plugin, Windows Defender Firewall, w32time sync, NSSM service registration — lives in docs/windows-setup.md (日本語版).

Continuous Integration

Pull requests run lint (pre-commit) and tests automatically (see #22).

Developer scripts

Only a small number of maintained helper scripts remain under scripts/. At the moment, the documented ones are the 5-peer smoke test (scripts/smoke_5peer_mesh.py) and the Claude Code SessionStart hook sample (scripts/hooks/session-start.sh).

Development

# Install with test dependencies (required to run MCP smoke tests)
pip install -e '.[dev,test]'

# Run all tests
pytest tests/ -q

# Run only MCP smoke tests
pytest tests/test_mcp_server.py tests/test_mcp_cli.py -v

Requirements

  • Python >= 3.10
  • For Tier 0 (local mode): no extra dependencies beyond kioku-mesh itself.
  • For Tier 2 (multi-host): Zenoh 1.9.0 (eclipse-zenoh Python binding and zenohd + zenoh-backend-rocksdb router). See Install zenohd for apt / prebuilt / cargo recipes.
  • MESH_MEM_STATE_DIR (default ~/.local/share/mesh-mem) must be on a filesystem that supports POSIX hard links — ext4 / btrfs / xfs / tmpfs / NFSv3+ all qualify. FAT / exFAT and certain older SMB mounts do NOT, and get_pc_id() will fail on first run in that case.
  • NTP/chrony clock sync (see Time sync). Replication uses HLC timestamps; clock skew > a few seconds breaks digest comparison.

Migration

Migration notes from the zenoh-memmesh-mem v0.1.x transition (state directory move from ~/.local/share/zenoh-mem to ~/.local/share/mesh-mem) live in docs/migration.md. The v0.3.0 PyPI rename from mesh-mem to kioku-mesh keeps all on-disk paths (~/.local/share/mesh-mem, ~/.config/mesh-mem/) unchanged — only the package name and CLI binary changed.

Acknowledgments (日本語)

kioku-mesh は先行する "AI エージェント向け永続メモリ" プロジェクトから大きなインスピレーションを受けています。設計思想・API 形状のアイデアを参考にさせてもらった各プロジェクトに感謝します。

  • engram by Gentleman-Programming — MCP ベースのクロスセッションメモリ (MIT)。save_observation / search_memory のツール分割と "observation" という単位の切り出しは engram の設計を参考にしています。
  • claude-mem by Alex Newman (@thedotmack) — Claude Code プラグイン、セッションの自動キャプチャ & 圧縮 (AGPL-3.0)。"エージェントの長期記憶を別プロセスに切り出す" という発想の先例として大きく影響を受けました。

両プロジェクトからはコードを引いていません(いずれも参考・インスピレーション)。差別化ポイントは Zenoh メッシュによる マルチホスト・マルチエージェント共有 です。

設計ドキュメント

現状仕様は docs/Spec.md にまとめています。設計判断の背景は docs/adr/ を、検証記録は docs/poc-reports/ を参照してください。

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kioku_mesh-0.3.0.tar.gz (224.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

kioku_mesh-0.3.0-py3-none-any.whl (85.2 kB view details)

Uploaded Python 3

File details

Details for the file kioku_mesh-0.3.0.tar.gz.

File metadata

  • Download URL: kioku_mesh-0.3.0.tar.gz
  • Upload date:
  • Size: 224.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for kioku_mesh-0.3.0.tar.gz
Algorithm Hash digest
SHA256 7787bdb32ab4d1b81babc92e80547417d11b1423a80487552800c6ad26dff07d
MD5 59bd097dd7042f47894c02537df1103f
BLAKE2b-256 88dad348e2b2137ff4ecef687a09ee019e5b77e0d70de66e564388299bd50031

See more details on using hashes here.

Provenance

The following attestation bundles were made for kioku_mesh-0.3.0.tar.gz:

Publisher: publish.yml on h-wata/kioku-mesh

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kioku_mesh-0.3.0-py3-none-any.whl.

File metadata

  • Download URL: kioku_mesh-0.3.0-py3-none-any.whl
  • Upload date:
  • Size: 85.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for kioku_mesh-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ffae861e7b01cf6ebccbba6fea5b0a494d3a8837e29c02c328158b23633beac8
MD5 8b829e70996efb41b8497605a92855a9
BLAKE2b-256 5f82b20b18b98ba4247a505754568cd97a4e0a6f21de7b8b64fc0f662326201d

See more details on using hashes here.

Provenance

The following attestation bundles were made for kioku_mesh-0.3.0-py3-none-any.whl:

Publisher: publish.yml on h-wata/kioku-mesh

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page