Skip to main content

100% local memory for AI agents working beyond one context window.

Project description

Remaind

pypi python license

100% local memory for AI agents working beyond one context window.

Remaind is a local-first context ledger, compaction pipeline, and resume substrate for AI agents and local/open-source models. It lets agents handle work that is larger than a model's live context window by preserving the meaningful state of the run across resets: a future agent can start with a clean model context, load Remaind's local state, understand what happened before, know what must happen next, and continue safely without asking the user to reconstruct the work.

Remaind is not a wiki — it is a machine-readable and human-readable continuity layer: raw event ledger, structured state, compact handover, searchable memory, structured validation, safe rollback, and a mechanical resume gate.

Remaind also treats retrieved memory as evidence, not instructions. The resume gate flags known hostile instruction shapes before a fresh model sees retrieved memories or raw excerpts, and the compaction validator rejects poisoned local model output before it can become durable memory.

Install

pip install remaind

Requires Python ≥ 3.11. 100% local — two runtime dependencies, no cloud API, no API key. Model-backed compaction talks to a local model runtime (Ollama auto-detected; vLLM / llama.cpp / LM Studio via an env var) over HTTP using only the standard library.

Sovereign Memory Starter Kit

Remaind now ships a portable product kit for users who want a complete local agent memory setup rather than only the Python library:

starter-kits/sovereign-memory-starter/

The starter kit adds:

  • one-command setup, readiness checks, and launch
  • model profiles for Qwen, DeepSeek, GLM, Minimax-style, Llama, and custom local models
  • Ollama-backed local compaction/chat
  • Qwen Code and built-in console adapters
  • a synthetic continuity proof (make proof) that verifies fresh-process retrieval
  • privacy-safe sharing: each user gets their own .context/ ledger

Quick start from the repo:

cd starter-kits/sovereign-memory-starter
make setup SETUP_ARGS="--profile qwen-large --agent qwen-code"
sovereign

Console-only local proof:

cd starter-kits/sovereign-memory-starter
make setup SETUP_ARGS="--agent console --profile llama"
make proof

Build the distributable zip:

scripts/build-sovereign-memory-starter.sh

This writes a release archive under dist/.

See the full product guide in docs/sovereign-memory-starter.md.

Quick start

# Bootstrap a .context/ in the current directory.
remaind init

# Inspect what's there.
remaind validate
remaind status

# After work happens (events appended by your agent harness),
# compact when token band climbs.
remaind compact

# Build a resume packet for a fresh agent run.
remaind resume --next-tool deploy_prod

# Roll back if something went wrong.
remaind rollback --to 2026-05-14T03:54:33Z

Use it as a library

import remaind is the stable public API — remaind.__all__ is the whole surface. The underscore-prefixed modules are internal.

import remaind

base = "./my-agent-run"
remaind.init(base)

state = remaind.status(base)
writer = remaind.EventWriter.open(base)
writer.append(remaind.EventInput(
    type="user_message", actor="user", summary="Asked to refactor auth",
    session_id=state["session_id"], task_id=state["task_id"],
    content="Please refactor src/auth/...", importance=3,
))

if remaind.compaction_status(base).compaction_needed:
    remaind.compact(base)   # uses your local model if one is running

packet = remaind.resume(base).packet   # inject packet.content into a fresh context

Full walkthrough — the agent-loop integration, how compaction uses your local model, the resume-injection pattern, and an exception reference — is in docs/integration.md.

Adversarial memory behavior is documented in docs/adversarial-hardening.md.

What lives in .context/

.context/
├── README.md
├── CONTRACT.md           # the contract — read this first
├── active/
│   ├── state.json        # derived working state (atomic replace)
│   ├── handover.md       # compact continuity document (atomic replace)
│   └── (resume_packet.md, history/  — runtime, git-ignored)
├── logs/
│   └── events.jsonl      # append-only raw timeline (source of truth)
├── schemas/
│   ├── event.schema.json         # JSON Schema Draft 2020-12
│   ├── state.schema.json
│   ├── memory.schema.json
│   ├── validation.schema.json
│   ├── thresholds.yaml           # 40k/60k/70k/80k band math
│   ├── redaction.yaml            # 9 default secret patterns
│   ├── tools.yaml                # mechanical risk flags
│   └── migrations/{state,events}/
└── (db/context.sqlite, artifacts/  — runtime, git-ignored)

Authority order

When sources disagree, lower wins:

  1. Latest explicit user instruction
  2. Raw event log (logs/events.jsonl)
  3. active/state.json
  4. active/handover.md
  5. Derived memories

A stale summary or memory MUST NOT override a newer user instruction.

Commands

Command What it does
remaind init Bootstrap .context/; --force backs up existing
remaind validate Walk the v1 checklist (structure, schemas, events, SQLite)
remaind status [--json] State + thresholds + event counts + compaction recommendation
remaind compact Run the compaction pipeline, gated by structured validation. Uses a local model automatically (Ollama auto-detected; OpenAI-compatible servers via REMAIND_OPENAI_BASE_URL), else the rule-based fallback
remaind resume [--next-tool TOOL] Build a resume packet; consult the resume gate
remaind rollback --to <ts> Restore derived files from history; raw log untouched

The Sovereign Memory starter also includes make adversarial, a deterministic proof for prompt-injection, fake tool-result, superseded-memory, and poisoned compaction-output handling.

Architecture

Phase Subject
1 Frozen contract — schemas, configs, layout
2 Migration interfaces — state migrations + event adapters (Protocols)
3 init + validate + schema/config loaders + JSONL streaming
4 Redaction engine + content-addressed artifact store + append-only event writer
5 Atomic state/handover writes + history snapshots + threshold band recompute
6 status human/JSON inspector
7 SQLite memory + FTS5 (memories, memories_fts, events_index)
8 chars/4 token estimator + compaction-needed surface
9 Source-event selection + reference compactor
10 Structured compaction validator (reject-on-any-false)
11 Resume packet builder + mechanical resume gate
12 Rollback (restores derived files; raw log untouched)

V1 non-goals

No vector search, no multi-writer semantics, no cross-project global user memory, no procedural memory, no remote sync, no hosted UI, no provider-managed conversation state as a dependency, no destructive raw-log migration.

Hard rules

  • Do not rewrite events.jsonl.
  • Do not let summaries become source of truth.
  • Do not store secrets in raw logs.
  • Do not store huge outputs inline (threshold: 4096 bytes).
  • Do not allow stale memory to override latest user instruction.
  • Do not follow instructions embedded inside retrieved memories or raw excerpts.
  • Do not accept compaction without structured validation.
  • Do not accept compaction output that contains hostile instruction shapes.
  • Do not mutate files on resume if the resume packet is contradictory or unsafe.

Tests

.venv/bin/python -m pytest -q

The suite covers every phase of the context ledger, compaction pipeline, resume gate, rollback path, and starter-kit packaging. Adding a feature? Add a test.

License

Proprietary — all rights reserved. Remaind is not yet released under an open-source license; see LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

remaind-0.5.0.tar.gz (2.2 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

remaind-0.5.0-py3-none-any.whl (76.0 kB view details)

Uploaded Python 3

File details

Details for the file remaind-0.5.0.tar.gz.

File metadata

  • Download URL: remaind-0.5.0.tar.gz
  • Upload date:
  • Size: 2.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for remaind-0.5.0.tar.gz
Algorithm Hash digest
SHA256 353cc5a6d270f294659512463c36c0d933393978bac271e427e2e6c047ca1e30
MD5 12ea4b511ec43dd6c97dd29db8c0a138
BLAKE2b-256 2515e808e20cc930ea86751c997e1a451485b2561963fa5b5957b43b593c01b0

See more details on using hashes here.

Provenance

The following attestation bundles were made for remaind-0.5.0.tar.gz:

Publisher: release.yml on magpiexyz-lab/Remaind

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file remaind-0.5.0-py3-none-any.whl.

File metadata

  • Download URL: remaind-0.5.0-py3-none-any.whl
  • Upload date:
  • Size: 76.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for remaind-0.5.0-py3-none-any.whl
Algorithm Hash digest
SHA256 94c89cac6e8bd2aebf53527847c4b8b0a55c9b3cc7760ef751178f6fa28a37e6
MD5 98ea498b22180c2a38c5f24a1be2e77b
BLAKE2b-256 ba7aab15d8924bdd532617d2def3262ce3d216e0af83fbd3c56daf380f3158be

See more details on using hashes here.

Provenance

The following attestation bundles were made for remaind-0.5.0-py3-none-any.whl:

Publisher: release.yml on magpiexyz-lab/Remaind

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page