Skip to main content

Active Skill Listener & Trainer — structured memory layer for AI coding assistants

Project description

SkillMind

SkillMind

PyPI version PyPI - Downloads PyPI - Python Version License: MIT MCP Integration Website

Active Skill Listener & Trainer — the structured memory layer for AI coding assistants.

Replace flat markdown memory files with a vector-database-backed system that listens, learns, and surfaces only relevant context per conversation.

🌐 Visit skill-mind.com — Documentation, setup guides, and live demos.


The Problem

Current state SkillMind
15+ flat markdown memory files One vector DB with semantic search
Everything loaded into context Only relevant memories surfaced
Manual save/forget Auto-listen, auto-classify, auto-expire
No deduplication Automatic dedup + consolidation
No protection Sanitizer redacts API keys, PII before storing

Quick Start (3 Commands)

# 1. Install
pip install skillmind[pinecone]

# 2. Initialize
skillmind init --backend pinecone

# 3. Import your existing Claude Code memories
skillmind import ~/.claude/projects/*/memory/

That's it. Your memories are now in a vector DB with semantic search.

How It Works

┌────────────┐    ┌────────────┐    ┌─────────────────┐
│  LISTENER   │───▶│  TRAINER    │───▶│  VECTOR STORE    │
│             │    │             │    │                  │
│ • Git hooks │    │ • Classify  │    │ • Chroma (local) │
│ • File watch│    │ • Sanitize  │    │ • Pinecone       │
│ • Convos    │    │ • Dedup     │    │ • Supabase       │
│ • YouTube   │    │ • Merge     │    │ • Qdrant         │
│ • Screen    │    │ • Expire    │    │ • FAISS          │
└────────────┘    └────────────┘    └─────────────────┘
                                            │
                                            ▼
                                    ┌─────────────────┐
                                    │  CLAUDE CODE     │
                                    │  (MCP Server)    │
                                    │  23 tools        │
                                    └─────────────────┘

5 Vector Store Backends

Backend Best for Requires
ChromaDB Solo dev, local, default pip install skillmind[chroma]
Pinecone Multi-device cloud sync API key
Supabase SQL + vectors, team sharing Supabase project
Qdrant Self-hosted or cloud, great filtering Qdrant server
FAISS Offline, air-gapped, fastest pip install skillmind[faiss]

All backends implement the same interface — switch anytime with zero data loss.

23 MCP Tools for Claude Code

Once installed, Claude Code gets these tools:

Memory CRUD

Tool What it does
remember Store memory (auto-classified, sanitized, deduped)
recall Semantic search across all memories
forget Delete a memory
update_memory Edit existing memory
context Generate focused context for current file/topic
consolidate Merge duplicates, expire stale, cleanup
memory_stats Counts by type, backend info
list_memories Filter by type/topic
import_markdown_memories Bulk import from Claude Code markdown files

Video & YouTube Learning

Tool What it does
learn_youtube Extract knowledge from YouTube video
learn_youtube_channel Learn from channel's latest videos
learn_video Learn from local video/screen recording
record_screen Record screen to MP4
screenshot Capture screenshot

Custom Patterns

Tool What it does
add_pattern Create auto-detection regex (e.g. client names, SEO terms)
list_patterns Show all custom patterns
remove_pattern Delete a pattern

Review Queue

Tool What it does
set_review_mode Switch: review (queue first), auto (store directly), off
get_review_mode Show current mode
review_pending Show queued memories waiting for approval
approve_memory Approve single memory → store in vector DB
reject_memory Reject single memory → discard
approve_all_pending Approve all at once
reject_all_pending Clear the queue
edit_pending Edit content/type/topic before approving

MCP Setup (Claude Code settings.json)

{
  "mcpServers": {
    "skillmind": {
      "command": "python",
      "args": ["-m", "skillmind.mcp.server"],
      "env": {
        "PINECONE_API_KEY": "your-key",
        "SKILLMIND_BACKEND": "pinecone"
      }
    }
  }
}

Memory Types

Type What Auto-expires
user Role, preferences, expertise No
feedback Corrections, confirmed approaches No
project Deadlines, client context, status 90 days
reference External URLs, dashboards, wikis No
skill Patterns, workflows, how-tos No

Obsidian Vault Export (Karpathy Wiki Pattern)

Export your entire memory system as an Obsidian vault with interlinked wiki pages, inspired by Andrej Karpathy's LLM wiki approach.

Complete Setup Guide

Step 1: Install SkillMind

# Install with your preferred backend + MCP server
pip install skillmind[pinecone,mcp,youtube]

# Or install everything
pip install skillmind[all]

Step 2: Configure the MCP Server

Add SkillMind to your Claude Code settings.json:

{
  "mcpServers": {
    "skillmind": {
      "command": "python",
      "args": ["-m", "skillmind.mcp.server"],
      "env": {
        "PINECONE_API_KEY": "your-pinecone-key",
        "SKILLMIND_BACKEND": "pinecone",
        "ANTHROPIC_API_KEY": "your-anthropic-key"
      }
    }
  }
}

Or create a .env file in your project root:

PINECONE_API_KEY=your-pinecone-key
SKILLMIND_BACKEND=pinecone
ANTHROPIC_API_KEY=your-anthropic-key

Step 3: Import Existing Memories

If you already have Claude Code markdown memories:

skillmind import

This scans ~/.claude/projects/*/memory/*.md, auto-classifies each memory, deduplicates, and stores them in your vector DB.

Step 4: Install Obsidian (Free)

  1. Download from obsidian.md (Windows/Mac/Linux)
  2. Install and open it
  3. No account required - works 100% offline

Step 5: Export to Obsidian Vault

Via CLI:

# Full export
skillmind export ~/Documents/MyWiki

# Incremental sync (only new memories)
skillmind sync --vault ~/Documents/MyWiki

Via MCP tools (inside Claude Code):

> export all my memories to an Obsidian vault at ~/Documents/MyWiki

Claude Code will call export_obsidian automatically.

Step 6: Open the Vault in Obsidian

  1. Open Obsidian
  2. Click "Open folder as vault"
  3. Select the vault folder (e.g. ~/Documents/MyWiki)
  4. Press Ctrl+G to open the knowledge graph
  5. Graph groups are pre-configured with colors per category

Step 7: Keep it in Sync

Every time you add new memories (via remember, learn_youtube, etc.), sync them:

skillmind sync

Or via MCP: sync_obsidian

What Gets Generated

MyWiki/
├── .obsidian/             # Pre-configured: graph groups, bookmarks, plugins
├── CLAUDE.md              # Wiki maintenance instructions for Claude
├── raw/                   # Drop raw source material here (articles, PDFs)
└── wiki/
    ├── index.md           # Master index by category and topic
    ├── log.md             # Operation history
    ├── skills/            # Skill memories (green in graph)
    ├── references/        # Reference memories (blue in graph)
    ├── feedback/          # Feedback memories (teal in graph)
    ├── projects/          # Project memories (orange in graph)
    ├── users/             # User profile memories (purple in graph)
    └── topics/            # Topic MOC pages (light blue in graph)

Each wiki page includes:

  • YAML frontmatter with Obsidian-native tags, created, updated dates
  • [[Wikilinks]] to related memories across categories
  • Topic and category backlinks
  • #hashtags for quick filtering
  • Confidence scores and source metadata

Graph groups (pre-configured colors):

Category Color Obsidian Query
Skills Green path:wiki/skills
References Blue path:wiki/references
Feedback Teal path:wiki/feedback
Projects Orange path:wiki/projects
Users Purple path:wiki/users
Topics (MOC) Light Blue path:wiki/topics
Index pages Yellow tag:#MOC

Optional: YouTube Learning with Proxy

If YouTube blocks direct connections, add ScraperAPI proxy support:

# In .env
VPN_PROXY_API_KEY=your-scraperapi-key
SCRAPER_Vendor=scraperapi

Then learn from YouTube videos:

skillmind learn-youtube "https://youtube.com/watch?v=..."
skillmind learn-youtube-channel "UCxxxxx" --limit 5

The extracted knowledge is auto-stored as memories and can be synced to your Obsidian vault.

Built-in Sanitizer

API keys, emails, phone numbers, IBANs, and PII are automatically redacted before storing:

Input:  "My Pinecone key is pcsk_2mrRyA_9BSbdn5i..."
Stored: "My Pinecone key is [REDACTED:PINECONE_KEY]"

Configurable allowlists, custom patterns, and name anonymization.

CLI Reference

skillmind init --backend chroma     # Initialize with backend
skillmind remember "content"        # Store a memory
skillmind recall "query"            # Semantic search
skillmind list                      # List all memories
skillmind list --type feedback      # Filter by type
skillmind forget <id>               # Delete
skillmind import                    # Import Claude Code memories
skillmind consolidate               # Cleanup & deduplicate
skillmind context                   # Generate context for current dir
skillmind stats                     # Show statistics
skillmind serve                     # Start MCP server

Installation

# Core + one backend
pip install skillmind[chroma]       # Local (default)
pip install skillmind[pinecone]     # Cloud sync
pip install skillmind[supabase]     # SQL + vectors
pip install skillmind[qdrant]       # Self-hosted
pip install skillmind[faiss]        # Offline

# Add-ons
pip install skillmind[youtube]      # YouTube learning
pip install skillmind[video]        # Screen recording + OCR
pip install skillmind[mcp]          # MCP server for Claude Code

# Everything
pip install skillmind[all]

Architecture

src/skillmind/
├── models.py          # Memory, QueryFilter, QueryResult (Pydantic)
├── config.py          # SkillMindConfig (YAML-based)
├── embeddings.py      # EmbeddingEngine (sentence-transformers | OpenAI)
├── trainer.py         # Auto-classify, dedup, merge, consolidate
├── sanitizer.py       # Redact API keys, PII before storage
├── listener.py        # GitListener, FileListener, ConversationListener
├── context.py         # ContextGenerator — dynamic context injection
├── migration.py       # Import existing Claude Code markdown memories
├── store/
│   ├── base.py            # Abstract MemoryStore interface
│   ├── chroma_store.py    # ChromaDB backend
│   ├── pinecone_store.py  # Pinecone backend
│   ├── supabase_store.py  # Supabase/pgvector backend
│   ├── qdrant_store.py    # Qdrant backend
│   └── faiss_store.py     # FAISS + JSON backend
├── video/
│   ├── youtube_learner.py     # YouTube transcript extraction
│   ├── video_learner.py       # Local video learning
│   └── screen_recorder.py     # Screen capture
├── mcp/
│   └── server.py      # FastMCP server (14 tools)
└── cli/
    └── main.py        # CLI (click-based)

Complementary MCP Tools

SkillMind works great alongside other MCP servers:

MCP Server What it adds Install
Visibly AI MCP SEO skills: keyword research, backlinks, site audit, GSC queries, on-page analysis pip install visiblyai-mcp-server
Notion MCP Read/write Notion pages, databases, todos Built-in
Playwright MCP Browser automation, screenshots, web scraping Built-in

Example: SEO Memory + Skills

# Install both
pip install skillmind[pinecone,mcp] visiblyai-mcp-server
{
  "mcpServers": {
    "skillmind": {
      "command": "python",
      "args": ["-m", "skillmind.mcp.server"],
      "env": { "SKILLMIND_BACKEND": "pinecone", "PINECONE_API_KEY": "..." }
    },
    "visiblyai": {
      "type": "http",
      "url": "https://mcp.visibly-ai.com/mcp",
      "headers": { "Authorization": "Bearer YOUR_KEY" }
    }
  }
}

SkillMind remembers your SEO preferences, client keywords, and audit findings. Visibly AI provides the live SEO data. Together: persistent SEO intelligence.

Contributing

PRs welcome! See CONTRIBUTING.md.

License

MIT — see LICENSE.


Built by Antonio Blago | skill-mind.com

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

skillmind-0.3.1.tar.gz (113.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

skillmind-0.3.1-py3-none-any.whl (78.1 kB view details)

Uploaded Python 3

File details

Details for the file skillmind-0.3.1.tar.gz.

File metadata

  • Download URL: skillmind-0.3.1.tar.gz
  • Upload date:
  • Size: 113.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.8

File hashes

Hashes for skillmind-0.3.1.tar.gz
Algorithm Hash digest
SHA256 83f224498fe472e13907b0e572b1a0cad4a2ce43231d7659f31cc0dd13979daa
MD5 6aa7b2db0aa1c2f49f6ef4d0bc625027
BLAKE2b-256 64334b019b2a948da27acca61575fa88b577fcb74469c5f5083a2a2f6aa53f21

See more details on using hashes here.

File details

Details for the file skillmind-0.3.1-py3-none-any.whl.

File metadata

  • Download URL: skillmind-0.3.1-py3-none-any.whl
  • Upload date:
  • Size: 78.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.8

File hashes

Hashes for skillmind-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 3a5c2291ec19524d416fae78e65281493097cae5a888f27c478ad026861eb47d
MD5 295c28880db6a78b95c6351d4be0fa01
BLAKE2b-256 502dd6e732d55f619c7dd3a81e38d98c67ec62b0c70fbbbcd461e901b419c7b2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page