Hierarchical associative memory for AI agents — compress, structure, and navigate agent memory like a human brain
Project description
json-memory
Hierarchical associative memory for AI agents — compress, structure, and navigate agent memory like a human brain.
The Problem
AI agents have limited memory windows. Storing facts as verbose prose wastes tokens and makes retrieval slow:
"User: Alice (@alice on Telegram). Prefers to be called Alice.
Uses they/them pronouns. Timezone is UTC. Platform is Telegram. Prefers
technical precision, especially in coding contexts. Wants a direct, warm..."
~300 chars for basic user info.
The Solution
Store memory as nested JSON with short keys — like synapses in a brain:
{"u":{"n":"Alice","c":"@alice","p":"Alice","g":"they/them","tz":"UTC","plat":"Telegram"}}
~95 chars — same data, 68% smaller.
Access via dotted paths: memory.u.n → "Alice"
Key Features
- 🧠 Hierarchical nesting — organize memory like a semantic tree
- 🗜️ 75% compression — short keys + JSON minification
- ⚡ Sub-millisecond parsing — 0.05ms for 2KB of memory
- 🔗 Synapse-like linking — concepts connect to related concepts
- 📐 Schema validation — define your memory structure once
- 🐍 Zero dependencies — pure Python, stdlib only
Installation
git clone https://github.com/dioncx/json-memory.git
cd json-memory
pip install -e .
Quick Start
from json_memory import Memory
# Create a memory instance
mem = Memory(max_chars=2000)
# Set nested values
mem.set("u.name", "Alice")
mem.set("u.tz", "UTC")
mem.set("bot.binance.restart", "kill && nohup ./bot > log 2>&1")
mem.set("bot.binance.watchlist", ["BNB", "KITE", "AGLD"])
# Get by dotted path
print(mem.get("u.name")) # "Alice"
print(mem.get("bot.binance.rst")) # "kill && nohup ./bot > log 2>&1"
# Export/import
json_str = mem.export() # minified JSON string
mem2 = Memory.from_json(json_str) # reconstruct
# Stats
print(mem.stats())
# {"entries": 4, "chars_used": 142, "chars_max": 2000, "utilization": "7.1%"}
Synapse Mode (Associative Memory)
Like how thinking of "coffee" activates "morning", "energy", "routine":
from json_memory import Synapse
brain = Synapse()
# Define associations
brain.link("trading", ["binance", "strategy", "risk", "signals"])
brain.link("binance", ["api", "demo", "watchlist", "orders"])
brain.link("strategy", ["entry", "exit", "stoploss", "take_profit"])
# Traverse like a brain
results = brain.activate("trading")
# → ["binance", "strategy", "risk", "signals"]
results = brain.activate("trading", depth=2)
# → ["binance", "api", "demo", "watchlist", "orders", "strategy", "entry", "exit", ...]
# Find connections
brain.connections("binance")
# → {"parent": "trading", "children": ["api", "demo", "watchlist", "orders"]}
Personalized Weights
Everyone's brain works differently. Set weights to customize recall order:
# Person A: loves cappuccino
person_a = Synapse()
person_a.link("coffee", ["cappuccino", "americano", "espresso"],
weights={"cappuccino": 0.95, "americano": 0.2, "espresso": 0.5})
# Person B: loves americano
person_b = Synapse()
person_b.link("coffee", ["cappuccino", "americano", "espresso"],
weights={"cappuccino": 0.2, "americano": 0.9, "espresso": 0.4})
person_a.activate("coffee") # → ["cappuccino", "espresso", "americano"]
person_b.activate("coffee") # → ["americano", "espresso", "cappuccino"]
Learning & Decay
Mimic how human memory strengthens with use and decays without:
brain = Synapse()
brain.link("coffee", ["cappuccino", "americano"],
weights={"cappuccino": 0.5, "americano": 0.5})
# User always picks cappuccino → connection strengthens
for _ in range(10):
brain.strengthen("coffee", "cappuccino", boost=0.05)
# User never picks americano → connection decays
for _ in range(10):
brain.weaken("coffee", "americano", decay=0.03)
brain.top_associations("coffee")
# → [("cappuccino", 1.0), ("americano", 0.2)]
brain.get_frequency("coffee", "cappuccino") # → 10 (activation count)
WeightGate — Passive Learning Middleware
Update weights automatically as messages flow through. No tool calls needed.
from json_memory import WeightGate
# Create a gate (disabled by default — opt-in)
gate = WeightGate("synapse.json", enabled=True)
# Set up your concepts
gate.add_concept("coffee", {"cappuccino": 0.9, "americano": 0.3})
gate.add_concept("debug", {"check_logs": 0.9, "ask_user": 0.2})
# Process messages — weights update automatically
gate.process_input("How do I restart the bot?")
# → bot.restart strengthened, unused associations decay
gate.process_output("Run: kill && nohup ./bot > log")
# → Agent's response also updates weights
# After 20 interactions:
gate.top_associations("debug")
# → [("check_logs", 0.95), ("ask_user", 0.18)] ← learned your pattern
Enable/Disable
# Disabled by default (opt-in)
gate = WeightGate("synapse.json") # OFF
gate.enable() # ON
gate.disable() # OFF
gate.toggle() # Toggle
# Context manager (auto-enable, auto-save)
with WeightGate("synapse.json") as gate:
gate.process_conversation(user_msg, agent_response)
# Gate disabled and saved on exit
How It Works
User msg ──→ process_input() ──→ detect concepts ──→ weights ↑/↓
↓
Agent processes
↓
Agent msg ──→ process_output() ──→ detect usage ──→ weights ↑
↓
Response to user
- Mentioned concepts → associations strengthen (+0.05)
- Unused associations → decay (-0.01)
- Agent's response → further strengthens used concepts (+0.025)
- Disabled gate → returns empty dict, no side effects
Compression Benchmarks
| Data Type | Prose | JSON | Savings |
|---|---|---|---|
| User profile (10 fields) | 300 chars | 95 chars | 68% |
| Server config (8 fields) | 250 chars | 120 chars | 52% |
| Bot config (6 fields) | 220 chars | 130 chars | 41% |
| Full memory (50 fields) | 2,200 chars | 1,200 chars | 45% |
Parse speed: 0.05ms for 2KB (tested on commodity hardware)
Comparison
| Feature | Prose Memory | JSON Memory |
|---|---|---|
| Human readable | ✅ Yes | ❌ No (but AI reads it) |
| Structured access | ❌ Scan entire text | ✅ Dotted path lookup |
| Nested hierarchy | ❌ Flat | ✅ Unlimited depth |
| Space efficiency | ❌ Verbose | ✅ 45-75% smaller |
| Parse speed | N/A | ✅ 0.05ms |
| Schema validation | ❌ No | ✅ Yes |
Why Not Just Use [MemGPT/Letta]?
Those are full agent memory frameworks. This is a building block — a lightweight, zero-dependency library for structuring agent memory as JSON. Use it inside your agent, your RAG pipeline, your CLI tool, or your trading bot.
Use Cases
- 🤖 AI Agent memory — compress context windows for LLMs
- 📊 Trading bot state — structured config and position tracking
- 🔧 CLI tools — compact persistent state
- 🎮 Game state — nested world/player/inventory data
- 📱 IoT/Edge — memory-constrained devices
Contributing
PRs welcome! See CONTRIBUTING.md.
License
MIT — see LICENSE.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file json_memory-0.1.2.tar.gz.
File metadata
- Download URL: json_memory-0.1.2.tar.gz
- Upload date:
- Size: 21.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0779131c0cce97db5bd8c0e09170386b1d7657e9a4f703c2a7b86313c856f0bd
|
|
| MD5 |
c1ccfbb1dd38d15d741ffef3d3c56245
|
|
| BLAKE2b-256 |
477ce28354462cb4e3ac4c90d2be26a05c5b1add9f9fe091794935331f833c95
|
File details
Details for the file json_memory-0.1.2-py3-none-any.whl.
File metadata
- Download URL: json_memory-0.1.2-py3-none-any.whl
- Upload date:
- Size: 16.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
162140470e754d99a933d198e852d23e76913f6678b939cb3467b8bb0ae91b32
|
|
| MD5 |
4d19b850049f25b981097137e74abf5e
|
|
| BLAKE2b-256 |
e8e3abd90bce124d3856d366139e2618b44bc746ef37d836d39e1291bbfd9821
|