DSPM Memory

Compress multi-turn LLM conversations by 80%+ while guaranteeing every constraint and decision survives.

The problem

Long conversations eat your context window. Naive truncation drops the constraint from turn 3 that the entire system depends on. DSPM fixes this.

How it works

DSPM converts each conversation turn into typed semantic patches — constraint, decision, code, entity, structure — and compresses them under a fixed token budget. Critical patches (constraints and decisions) are structurally protected: they survive compression even when everything else is trimmed.

Raw conversation (452 tokens, 18 turns) ↓ Semantic extraction → 28 patches, 18 critical ↓ 7-stage compression pipeline ↓ Compressed context (249 tokens) — 100% of criticals intact

The 7-stage pipeline: dedup → slot fusion → delta encoding → causal pruning → utility scoring → shadow selection → adaptive budgeting.

Install

pip install dspm-memory

Requires Python 3.9+. Works with any OpenAI-compatible LLM provider.

Quickstart

from openai import OpenAI
from dspm import DSPMMemory

# Works with OpenAI, Groq, Together, Ollama, or any OpenAI-compatible endpoint
llm = OpenAI(
    api_key="sk-...",
    # base_url="https://api.groq.com/openai/v1"  # uncomment for Groq
)

memory = DSPMMemory(budget=250, llm_client=llm, model="gpt-4o-mini")

memory.add_turn("user", "Build a REST API. Must use PostgreSQL, JWT auth, deadline is Friday.")
memory.add_turn("assistant", "PostgreSQL with SQLAlchemy, JWT via python-jose. Access tokens 15 min.")
memory.add_turn("user", "All PII must be encrypted at rest with AES-256. No exceptions.")
memory.add_turn("assistant", "AES-256 at rest for all PII fields, keys in AWS KMS with quarterly rotation.")

context = memory.get_context(query="What are the hard requirements?")
print(context)
print(memory.stats)

Output:

[CON] Stack: PostgreSQL, JWT auth. Deadline Friday. [CON] Access tokens 15 minutes. [CON] All PII must be encrypted at rest with AES-256. No exceptions. [CON] AES-256 at rest; keys in AWS KMS, quarterly rotation.

Every constraint is present. Every time.

The guarantee

Constraint ([CON]) and decision ([DEC]) patches are structurally protected:

• Never dropped by deduplication, fusion, or pruning
• Under budget pressure, payloads are trimmed numbers-first — thresholds, versions, and units survive longest
• When a constraint is revised mid-conversation (e.g. TTL 60s → 300s), the new value supersedes the old
• A critical is only dropped as a last resort: every critical already at its 2-word floor and budget still cannot hold them

Ablation result: removing the shadow-selection mechanism collapses CRR from 100% to 37.9%, isolating the guarantee to a single identifiable component.

Results

Tested across 7 domains × 40 turns each:

CRR = Critical Retention Rate. TRR = Token Reduction Ratio.

API reference

DSPMMemory(budget, llm_client, model)

Methods

Properties

Supported providers

# OpenAI
llm = OpenAI(api_key="sk-...")

# Groq (free tier available)
llm = OpenAI(base_url="https://api.groq.com/openai/v1", api_key="gsk-...")

# Together AI
llm = OpenAI(base_url="https://api.together.xyz/v1", api_key="...")

# Ollama (local, no key needed)
llm = OpenAI(base_url="http://localhost:11434/v1", api_key="ollama")

Paper

DSPM: A Critical-Retention Approach to Long-Context Memory Compression for LLM Conversations
Dhruv Dubey, 2026
arXiv:2409.XXXXX(Currently under arXiv Under Reiview)

Version history

License

MIT © 2026 Dhruv Dubey