Skip to main content

An agentic memory engine designed for lossless, tiered verbatim storage and multi-hop retrieval.

Project description

EpochDB

EpochDB is an agentic memory engine designed for lossless, tiered verbatim storage and multi-hop retrieval.

Why

I had this idea while playing with LMDB. I wanted to create a memory system that could store conversations in a hybrid way, using in-memory for the most recent conversations and on-disk for older conversations. So, in order to have immutable data, I decided to use Parquet files for the on-disk storage.

Overview

Traditional AI memory systems compress conversations through destructive summarization. EpochDB bypasses this constraint by storing "Unified Memory Atoms"—the raw text intrinsically paired with dense embeddings.

EpochDB uses a tiered architecture reminiscent of CPU caching:

  1. L1: Working Memory: Sub-millisecond HNSW vector index in RAM.
  2. L2: Historical Archive: Cold storage in immutable, time-partitioned .parquet files via PyArrow.

It uniquely handles multi-hop retrieval over time-partitioned data using a Global Entity Index.

How It Works

See how_it_works.md for a detailed technical dive into the architecture.

Benchmarks & Examples

See benchmark.md for traces of EpochDB successfully integrated via LangGraph. Check out example_langgraph.py for the source code.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

epochdb-0.1.0.tar.gz (8.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

epochdb-0.1.0-py3-none-any.whl (9.9 kB view details)

Uploaded Python 3

File details

Details for the file epochdb-0.1.0.tar.gz.

File metadata

  • Download URL: epochdb-0.1.0.tar.gz
  • Upload date:
  • Size: 8.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.3

File hashes

Hashes for epochdb-0.1.0.tar.gz
Algorithm Hash digest
SHA256 3f6675627924915a546e727d2d815dc95e3130a526cfb30c5209221850229b14
MD5 37a82617794c57acd8af615e5659f29e
BLAKE2b-256 3d9ab7e8c6088e402fa112543ba5143927adffe8a1f5261440cbc820d50cd29e

See more details on using hashes here.

File details

Details for the file epochdb-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: epochdb-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 9.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.3

File hashes

Hashes for epochdb-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7c3b8cfebd7e4406e86e8a435ef0768081dab3cb720d9161a67df0e514fd1d9b
MD5 53430d5a265ffdbf011082de37c892f6
BLAKE2b-256 1e5a79ff4c30e0fba9e944442e95016098f3f37872459e9f27a1f98ad1b85772

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page