Skip to main content

Lightweight AI dialogue memory rotation plugin with dual DB (JSON/SQLite) and pluggable summarizer

Project description

dualdb-memory-plugin

PyPI License Build Status


DualDB Memory Plugin is a lightweight memory cycling system for AI dialogue agents, simulating human-like memory transitions from short-term to long-term.
It supports both JSON and SQLite backends and features a pluggable summarizer interface.


📌 Originality & Archival Record

This project was originally developed and published by YZXY6151 in July 2025.

🧾 Design & Originality Declaration
📄 Archive.org Snapshot (EN)
📅 Archived on: 2025-07-22

💻 Source Code Snapshot (Software Heritage)
🔗 Permanent snapshot
🆔 swh:1:snp:20c63a71da5a33884f1615b18fcec904f99de0bb
📅 Archived on: 2025-07-23

📜 License: CC BY-NC-SA 4.0 International

Attribution required. Non-commercial reuse and modification allowed under the license terms.


We welcome contributions, integrations, and community feedback. If you adapt or build upon this work, please preserve authorship and link to the archival records above. the terms of attribution and non-commercial use.


✨ Features

  • Human-like Memory Simulation
    Short-term dialogue entries (active) are rotated to long-term archive (archive) based on:

    • Threshold (number of messages)
    • Keyword triggers
    • Time intervals
  • Pluggable Summarization
    Replaceable summarizer engine. Default is a stub; you can plug in OpenAI, T5, or any local model.

  • Dual Backend Support
    Choose from:

    • JsonStore: File-based storage
    • SQLiteStore: Async + WAL mode for high concurrency
  • Minimal Dependencies
    No external packages required unless using openai.


🚀 Quick Start

1. Install from source

git clone https://github.com/YZXY6151/dualdb-memory-plugin.git
cd dualdb-memory-plugin
pip install -e .


from dualdb_memory.manager import DualDBManager
from dualdb_memory.summarizer_stub import StubSummarizer

manager = DualDBManager(
    storage_type="json",
    active_path="data/active.json",
    archive_path="data/archive.json",
    summarizer=StubSummarizer(),
    threshold=5,
    keywords=["urgent", "important"],
    time_delta=30
)

manager.append("user", "Hello!")
manager.append("assistant", "How can I help?")
context = manager.get_context()
print(context)


## 🔍 When to Use **Recommended for:**

- Chatbots or agents needing **short-to-long memory evolution**
- Projects without **vector DBs or external APIs**
- **Lightweight**, transparent memory workflows
- Educational or experimental AI setups

🛑 **Not ideal if:**

- You need **semantic search** or vector-based retrieval
- You're using large frameworks (e.g., LangChain) with built-in memory
- You require **multi-user**, role-based memory (planned extension)

---

## ⚖️ Design Comparison

| Feature                  | LangChain / MemoryGPT            | **DualDB Memory Plugin**               |
|--------------------------|----------------------------------|----------------------------------------|
| Dependency               | Heavy (pydantic, chroma, openai) | **Minimal** (stdlib only)              |
| Storage Format           | Vector DB / internal             | **JSON / SQLite**                      |
| Rotation Mechanism       | Often manual                     | **Auto** (threshold / keyword / time)  |
| Summarizer Integration   | Hard to customize                | **Pluggable Interface**                |
| Modularity               | Tightly coupled                  | **Loosely coupled**                    |
| Learning Curve           | Medium–High                      | **Low**, quick integration             |

---


## 📘 Full Documentation

Looking for full usage examples, architecture, and test results?

👉 **[See Full Guide → docs/USAGE_AND_TESTS.md](docs/USAGE_AND_TESTS.md)**

> 📎 **Heads up:** If the link below doesn't work on GitHub's homepage,  
>  click into the README file or manually open: `docs/USAGE_AND_TESTS.md`


---

## 🤝 Contributing

Contributions are welcome!

Feel free to open an issue or pull request if you:

- Add new summarizer engines (e.g. T5, local LLMs)
- Encounter bugs or edge cases
- Propose design improvements (e.g. multi-level memory, multi-user support)
- Need streaming / cloud support

---


🧪 Project Status & Friendly Note
ℹ️ Note from the developer:
This project is developed and maintained by an individual beginner in AI system design.
While the memory rotation logic has been carefully implemented and tested in isolation,
it has not yet been integrated or benchmarked with actual AI language models (e.g., OpenAI, LLaMA, etc.).

I’m sharing this plugin as a lightweight, modular base for anyone exploring memory mechanisms in AI dialogue.
If you have feedback, suggestions, or real-world use cases, I’d greatly appreciate your insight!

Feel free to open an Issue or contribute via Pull Request.

Thank you for taking a look 🙏


## 📄 License

Released under the **Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0)** License.  
See [LICENSE](./LICENSE) for full terms.

> This package is officially maintained by **YZXY6151**.  
> Any unofficial versions or derivatives **must** retain attribution and **clearly indicate changes**.  
> Commercial use is **not permitted** without explicit permission.

© 2025 YZXY6151  DualDB Memory Plugin  
All rights reserved under CC BY-NC-SA 4.0. For non-commercial use only.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dualdb_memory_plugin-1.0.0.tar.gz (19.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dualdb_memory_plugin-1.0.0-py3-none-any.whl (20.7 kB view details)

Uploaded Python 3

File details

Details for the file dualdb_memory_plugin-1.0.0.tar.gz.

File metadata

  • Download URL: dualdb_memory_plugin-1.0.0.tar.gz
  • Upload date:
  • Size: 19.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.2

File hashes

Hashes for dualdb_memory_plugin-1.0.0.tar.gz
Algorithm Hash digest
SHA256 89a4ede75eb15dd6b7e8199fc4740dd421e7f0ebd4c2a9c6b7cf006f6c895959
MD5 c53d93c736857a4ee8bc6e7308174038
BLAKE2b-256 9df80458275431b11a67a1be47580146e8b403e5bd2b655bff50f8f03adcb091

See more details on using hashes here.

File details

Details for the file dualdb_memory_plugin-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for dualdb_memory_plugin-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ce65884dea1a1e9a7b1dc04387d470772152c230213df478afe1fbd1a2668573
MD5 bdcbdd1e3d58eca6c0107b9931160b31
BLAKE2b-256 023aef9e5db3ea3eb25507d5e7f556b2c8238df90f64422bc3bccc3d695b43f7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page