Skip to main content

anatid

anatid is an embedded graph memory for AI agents, built on DuckDB and released under the MIT license. The database is a single file. There is no server to run and no daemon to supervise.

Install it and an agent gains a memory that stores entities, the edges between them, and facts attached to both. That memory records two kinds of time: what was true, and what the agent believed at any past instant. Queries run three ways at once, through vector similarity, Best Match 25 (BM25) text scoring, and graph traversal, fused into a single ranked list. Writes can be routed through the human-in-the-loop approval flow in the OpenAI Agents Software Development Kit (SDK), so an agent proposes a change to its own memory and a person decides whether it lands.

Every retrieval structure in anatid is derived rather than canonical. The full-text index, the graph adjacency structure, and the optional vector index are built the same way: a versioned base generation, plus a journal written inside the same transaction as the row it describes, merged on every read before any tenant or time filter runs. So a write is findable by the next read with nothing rebuilt. An index that has gone stale, or been damaged, or was never built at all, costs latency rather than correctness, and every fallback reports which of eight reasons applied. The SQL path over the canonical tables remains the oracle.

Why this project exists: Kuzu was archived on 2025-10-10. Graphiti deprecated its Kuzu driver, Mem0 removed open-source graph memory in v2.0.0, and Cognee began migrating away. A number of people were left with an embedded graph memory and nowhere obvious to go.

Two-hop recall over 1,000,000 memories has a median latency of 2.88 ms on DuckDB against 7.35 ms on a tuned LadybugDB, the maintained MIT fork of Kuzu. That is a factor of 2.5, and the two engines return identical result identifier lists. The measurement came before the library, and it is why anatid sits on DuckDB. Method and caveats are in docs/benchmarks.md.

Install

pip install anatid                    # just duckdb
pip install "anatid[agents]"          # + the OpenAI Agents SDK integration
pip install "anatid[mcp]"             # + the Model Context Protocol server

To track main instead:

pip install "git+https://github.com/thedatasense/anatid"

anatid runs on Python 3.10 through 3.13 and requires one dependency, duckdb>=1.5. Continuous integration runs the test suite on Linux, macOS and Windows across all four Python versions, including the two integration suites, which is why the [dev] extra installs openai-agents and mcp. Tests that load the 100k-row benchmark dataset, and those needing the compiled C++ extension, skip in continuous integration because neither artifact lives in the repository. Both run locally before a release.

Quickstart

from anatid import Anatid, utcnow

vec = [0.0] * 63 + [1.0]                                        # your embedding model's output

with Anatid.open("agent.anatid", tenant=1, embedding_dim=64) as db:
    db.relate("Ada", "Kestrel", rel_kind="leads")               # an entity to entity edge
    m = db.remember("Ada prefers dark roast coffee",            # a fact, filed under 2 entities
                    entities=["Ada", "coffee"], kind="preference",
                    embedding=vec, writer="agent-1",
                    episode="Standup 2026-03-01: Ada takes it dark roast.")  # raw evidence first
    t0 = utcnow()
    hits = db.recall("coffee", embedding=vec, seed_entity="Ada", k=3)   # findable already
    print(hits[0].content, hits[0].sources, "| bm25_stale:", hits.bm25_stale)

    new = db.supersede(m.memory_id, "Ada switched to decaf")    # closes the old row, keeps it
    print("old still current?", db.get(m.memory_id).is_current) # False, history intact
    print("at t0:", [x.content for x in db.as_of(t0).recall_2hop("Ada")])
    print("evidence:", db.provenance(new.memory_id).source_text)
Ada prefers dark roast coffee ('vector', 'text', 'graph') | bm25_stale: False
old still current? False
at t0: ['Ada prefers dark roast coffee']
evidence: Standup 2026-03-01: Ada takes it dark roast.

Running the block above produces exactly that. Nothing was rebuilt before the recall call. The write was journalled inside its own transaction and the text arm merged it. Calling db.maintain_indexes() folds the journal into fresh generations when you want the speed of a built index, and db.index_health() reports whether that is due, and why.

A longer commented walkthrough covering recall_2hop, forget(hard=True) and stats() lives in examples/quickstart.py. It needs no API key and finishes in under a second.

For something closer to how memory tends to fail in practice, run examples/dinner_party.py. Six months of ordinary household facts, a cook who asks whether Friday's menu is safe, and an allergy that neither the question nor any single stored sentence mentions. The graph walks from the dinner to a guest to an ingredient to the dish. Word search alone returns the recipe cards and stops.

The verbs

verb what it does
remember(content, entities=[...]) write a fact and the ABOUT edges that make it reachable
recall(query, embedding=, seed_entity=) hybrid retrieval: cosine, BM25 and 2-hop graph, fused with reciprocal rank fusion
recall_2hop(seed) / context(entity) pure graph recall; context defaults to 0 hops
supersede(old_id, content) replace a belief, keeping the old one closed and linked
unrelate(a, b) close an edge that stopped being true
reinforce(id) / prune(...) strengthen what gets used, drop what does not
forget(id, hard=False) stop believing, with the audit trail kept, or erase completely
as_of(t) every read, as the database saw the world at t
provenance(id) the supersession chain, the raw episodes, every writer involved
relate(a, b) / upsert_entity / episode the graph and evidence primitives underneath
update(id, content, expected_version=n) compare and swap: read the version, write, one transaction
atomic(callback) re-run the whole callback on a retryable conflict, with jittered backoff
maintain_indexes() / index_health() build the derived indexes that are due; report each one's state
doctor() integrity and upkeep checks, with severities and samples

Each write verb is exactly one DuckDB transaction. Reads run their statements outside an explicit transaction, so a concurrent commit can land between a recall's arms and its hydration step. Wrap the call in db.transaction() when you need a single snapshot.

prune behaves differently: a query, then one transaction per memory it forgets. A failure part-way leaves earlier deletions committed. Taking its dry_run list first shows what it will touch.

Write verbs accept now= and the temporal read verbs accept as_of=, which keeps tests deterministic. Function forms exist as well, through from anatid.verbs import remember. And db.connection hands you the raw DuckDB cursor whenever you want SQL. The memory is ordinary tables, joinable against your Parquet and CSV files in place.

Why DuckDB, with numbers

Phase 0 was a benchmark, run before any of the library existed: 1,000,000 memories, 2.3M edges, ten tenants, four engines, the same operations under identical semantics, all checked against a pure-Python oracle.

Two-hop recall is the query shape agent memory hits hardest. Over 1,000 queries on a single thread:

engine p50 p95 load on disk concurrent reads
DuckDB with the C++ CSR extension 2.04 ms 3.07 ms 4.8 s 481 MiB 825/s
DuckDB, plain SQL 2.88 ms 3.50 ms 4.6 s 434 MiB 583/s
LadybugDB 0.20.2, tuned 7.35 ms 28.73 ms 16.2 s 1,158 MiB 147/s

The kill criterion set beforehand was to abandon DuckDB if it ran more than five times slower. It came in at 0.39x on plain SQL and 0.28x with the extension. At the 95th percentile those figures are 0.12x and 0.11x.

All three engines returned identical result identifier lists across 1,000 oracle-checked queries and 200 post-write verification queries. LadybugDB's figure is the fastest of six Cypher formulations across two thread settings; the naive formulation ran 16 times slower, and reporting that one would have flattered DuckDB.

Where DuckDB loses is worth stating plainly. Hybrid recall runs about 22% slower, 16.4 ms against 20.0 ms median, though no engine in the run had an approximate nearest neighbour index, so that comparison measures scan speed. Concurrent readers cost DuckDB writers real throughput, dropping from 397 writes per second with writers alone to between 152 and 189 once two readers join. LadybugDB with enable_multi_writes=True commits more writes per second than DuckDB does.

Full tables covering every phase, the mixed workload, concurrency, correctness, and nine limitations of the benchmark itself are in docs/benchmarks.md. Raw JSON with per-operation latency arrays sits in spike/results/.

OpenAI Agents SDK integration

The OpenAI Agents SDK already carries what human-in-the-loop review needs: needs_approval=True on a function_tool, RunResult.interruptions, a serializable RunState, and state.approve() alongside state.reject(). It also defines a Session protocol for conversation history, with backends for SQLite, SQLAlchemy and Redis.

Missing from it are a DuckDB session, graph memory, and approval-gated memory writes. As far as we can establish, no open-source project combines all four of the Agents SDK, DuckDB, a graph store, and human approval on memory writes. anatid supplies the missing three while rebuilding none of the SDK's machinery.

from agents import Agent, Runner
from anatid import Anatid
from anatid.integrations.openai_agents import AnatidSession, create_memory_tools

db = Anatid.open("agent.anatid", tenant=1)
session = AnatidSession("conv-1", db)                # conversation history, same file as the graph
tools = create_memory_tools(db, session=session)     # 3 read tools, 3 write tools

agent = Agent(name="assistant", tools=tools)
result = await Runner.run(agent, "Ada switched to decaf, remember that", session=session)

while result.interruptions:                          # writes stop here; reads never do
    state = result.to_state()
    for item in result.interruptions:
        print(item.tool_name, item.raw_item.arguments)   # "anatid_remember" {"content": ...}
        state.approve(item)                              # or state.reject(item)
    result = await Runner.run(agent, state, session=session)

Writes are gated and reads run straight through. The tools anatid_remember, anatid_supersede and anatid_forget carry needs_approval, while anatid_recall, anatid_context and anatid_provenance do not. Nothing reaches the database until somebody approves.

The approval policy is a callable, so you can shape it. approve_low_risk() waves through small ordinary writes and still stops for hard deletes. Unless you opt out explicitly, anatid_forget(hard=True) always requires approval, since a hard forget removes the row, its edges, its embedding and its provenance together.

Approval can also happen later, and somewhere else entirely. RunStateStore(db) parks the SDK's serialized RunState in the same anatid file, so an interrupted run can be reviewed and resumed minutes or days afterwards by a different process. That turns approval into a review queue rather than a blocking prompt.

History and knowledge stay joinable, because AnatidSession writes conversation turns into a table inside the same DuckDB file as the memory graph. Calling await session.entities_mentioned() becomes one SQL join against entities, rather than two round-trips to two different stores, and memories_written_here() reports what a given conversation committed to memory.

Model Context Protocol server

pip install "anatid[mcp]"
anatid-mcp --db memory.anatid        # stdio; point Claude Desktop, Claude Code or Cursor at it

That exposes the memory verbs over the Model Context Protocol (MCP), so any MCP client gains persistent, bitemporal, graph-shaped memory. The write side offers remember, relate, supersede, reinforce, forget, prune and rebuild_fts_index. The read side offers recall, context, get, provenance and stats. Those are MCP tool names; the anatid_-prefixed names belong to the Agents SDK integration above. Passing --read-only registers the read tools alone.

Identifiers cross that boundary as decimal strings, never as JSON numbers. anatid identifiers exceed what JavaScript integers carry safely, and a client that parsed them as numbers would silently address the wrong row. Tools accept either spelling on the way in.

One deliberate escape hatch exists: a sql tool, off by default, for questions the verbs do not answer. How many memories per kind, say, or show me the audit trail. It is read-only, and DuckDB enforces that in three layers rather than a regular expression over the query text. DuckDB's own statement classifier admits only SELECT and EXPLAIN, and every statement in the text must pass. A scan of DuckDB's parse tree rejects file-reading functions and base-table names that are not plain identifiers, since DuckDB's replacement scan would otherwise turn SELECT * FROM '/etc/passwd.csv' into an ordinary SELECT. Execution then happens inside BEGIN TRANSACTION READ ONLY on a private cursor that is always rolled back.

from anatid.integrations.mcp import build_server embeds the server in your own process.

Limitations

Everything here is measured, or documented in the source. Behaviour that contradicts the documentation and is absent from this list is a bug, and we would like the report.

area where it stands
Vector search Exact scan by default. An HNSW generation is opt-in
Full-text Journalled writes are searchable at once; rebuilds buy latency
Concurrency One writing process per file, many threads inside it
Isolation Snapshot, with retryable conflicts. Not serializable
Tenancy One file per tenant is the real boundary
Query language The verbs above, plus SQL. No Cypher yet
Maintenance A call you make, not a background thread

Several of those deserve more than a row.

The default vector backend performs an exact scan. Opting into Anatid.open(vector_backend="duckdb_vss") builds a Hierarchical Navigable Small World (HNSW) generation, which measured recall at k of 1.0000 for k=10, and between 0.9982 and 0.9984 for k=50, against the exact oracle at 9,500 and 95,000 rows per tenant, running 2.2 to 2.8 times faster at the larger size. It stays opt-in for three reasons. DuckDB documents HNSW persistence as experimental, with write-ahead-log and crash-recovery caveats. A persisted HNSW index silently loses its ef_search setting across a reopen, which anatid works around by reissuing the setting per connection. And below roughly 15,000 rows per tenant, the exact scan tends to be faster anyway. The 1M and 10M measurements named in the promotion criterion have not been taken. Since 0.1.1, recall(embedding=...) raises BruteForceCeilingError when an exact scan would cover more than BRUTE_FORCE_CEILING = 100_000 rows, unless you pass allow_slow=True.

DuckDB's own full-text index does not update incrementally, and anatid builds incremental behaviour above it rather than exposing that limitation. A write is journalled in its own transaction and merged into the next search, so .bm25_stale reads False and the row is findable. What you still choose is when to pay for a rebuild, either through maintain_indexes() on a policy or rebuild_fts_index() by hand. Merging costs read latency in proportion to the journal rather than the corpus, measured at an extra 2.3 ms for 500 journalled writes over a 100,000-document corpus. With no generation published at all, a search scans the corpus exactly, which is refused above SCAN_CEILING = 100_000 documents per tenant.

An index can be damaged in ways a read cannot afford to detect. Every read checks one cheap invariant per index and falls back to the oracle with HealthReason.damaged_base when it fails. A base that is structurally consistent yet wrong, postings lost from under a document map that still points at them, gets caught by validate() during a rebuild rather than by a read.

One writing process per file is DuckDB's model, and the engine enforces it. A second read-write process cannot even open the file, failing with IO Error: Could not set lock on file. Many threads inside that one process write concurrently, and appends never conflict, measured at zero errors across a 30-second six-thread benchmark with no retry logic.

Isolation is snapshot rather than serializable. Two concurrent updates to the same row abort the second with a retryable ConflictError. anatid does not retry on your behalf, because whether the write should be re-derived from a fresh read depends on what you were trying to do.

Tenant isolation is file-per-tenant. DuckDB offers no row-level or schema-level access control, so a tenant_id column scopes queries while the real boundary is one file per tenant through DatabasePool, enforced by the filesystem. Raw SQL through db.connection sees every tenant in the file, and the docstrings say so.

DuckDB has no AS OF SYSTEM TIME clause. as_of() generates a WHERE clause over valid_from, valid_to, tx_from and tx_to. It reaches back exactly as far as the rows still present, so a hard purge disappears from every historical view as well.

The Compressed Sparse Row (CSR) graph structure still has sharp edges, though fewer than in 0.1. A generation numbers its own vertices, so dense entity identifiers are no longer required of you. A generation is built in full rather than updated in place, so a large journal eventually costs more than the expansion saves, measured at 1.50 ms against 0.88 ms of pure SQL at roughly 550 journal rows. The ratio trigger in MaintenancePolicy exists to prevent that. The in-memory structure is not evicted by DuckDB's object cache, so memory grows with the number of resident generations. The C++ extension remains optional; without it the merge runs in SQL and returns the same rows.

This is v0.2. The API may still move, so pin the version.

Documentation

document what it covers
docs/architecture.md storage layout, the visibility predicate, the derived-index framework, graph paths, the isolation contract, the temporal model, the recall pipeline
docs/design/derived-index-framework.md the design the accelerators are built to, and what shipped against what was deferred
docs/benchmarks.md Phase 0 method, every result, and what the benchmark does not tell you
docs/roadmap.md what comes next, and what is deliberately out of scope
CONTRIBUTING.md how to build it, what we care about in a change, third-party notices
spike/ the Phase 0 evidence, kept read-only

License

MIT. Copyright (c) 2026 anatid contributors. Code adapted from DuckDB (MIT), or from Kuzu and LadybugDB (MIT, Copyright 2022-2025 Kùzu Inc.), carries its original notice alongside ours. See CONTRIBUTING.md.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

anatid-0.2.1.tar.gz (723.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

anatid-0.2.1-py3-none-any.whl (427.0 kB view details)

Uploaded Python 3

File details

Details for the file anatid-0.2.1.tar.gz.

File metadata

  • Download URL: anatid-0.2.1.tar.gz
  • Upload date:
  • Size: 723.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.12.9

File hashes

Hashes for anatid-0.2.1.tar.gz
Algorithm Hash digest
SHA256 f6c2f3694c294e3ad8e77f996a3169928ac5cdb36628ce031233c9e31c3e59e5
MD5 0cdacf155aa219c9e044e3472ef274af
BLAKE2b-256 9efd4b868e89e6368990e74d1d2548f9b726ca87e515d87ea2d063cbdbedcf29

See more details on using hashes here.

File details

Details for the file anatid-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: anatid-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 427.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.12.9

File hashes

Hashes for anatid-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 ee2db8df41d074388263a46a6aa419b0c4467aabb0821abc24df6ad33992713b
MD5 b2e57354854089e0dc31a5d6c04fc843
BLAKE2b-256 0f2670edd2d633b140c58fafc01f6ca19aa99f2c8bca837687ed7576c23fa1ec

See more details on using hashes here.

Release history Release notifications | RSS feed

0.4.1

2 files

0.4.0

2 files

0.3.0

2 files

This release

0.2.1 This release

2 files

0.2.0

2 files

0.1.1

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page