remark-bridge 0.3.0

Bidirectional sync between reMarkable tablets and an Obsidian knowledge base with intelligent note processing

reMark

Bidirectional sync between reMarkable tablets and an Obsidian knowledge base with multi-engine OCR, intelligent note processing, and automatic action item extraction.

Write on your reMarkable. reMark handles the rest — your handwritten notes become structured, searchable Markdown in Obsidian, complete with tags, summaries, and extracted action items. Optionally push a response PDF back to your tablet.

---

Features

Core sync & processing

• Multi-engine OCR pipeline — reMarkable built-in (MyScript), Google Cloud Vision, or VLM-based recognition with automatic fallback
• Intelligent structuring — raw handwriting becomes clean Markdown with inferred headings, lists, and formatting
• Action item extraction — tasks, questions, follow-ups from both text patterns and pen color annotations
• Auto-tagging and summarization — categorizes and condenses notes
• Real-time sync — WebSocket notifications or configurable cron schedule

Knowledge management

• Obsidian vault integration — YAML frontmatter, wiki-links, Git sync
• Semantic search (RAG) — embed the entire vault and query it with natural language. Backends for Voyage, OpenAI, or local sentence-transformers
• OneNote mirror (v0.3) — write notes in parallel to Microsoft OneNote
• Deletion-aware — notes removed from the tablet are archived in the vault automatically

Response + reverse push

• Response push — auto-generates PDFs or native reMarkable notebooks that answer questions in your notes
• Reverse sync (v0.3) — push Obsidian notes back to the tablet (frontmatter flag, folder-based, or on-demand)
• On-device templates (v0.3) — push structured templates (meeting, daily, project review) to the tablet and extract the filled fields back into frontmatter

Integrations

• Microsoft Outlook — action items → Microsoft To Do, deadlines → Outlook Calendar
• Microsoft Teams (v0.3) — daily/weekly digest Adaptive Cards, meeting ↔ note correlation
• MCP server — interact with your notes directly from Claude Desktop or Claude Code

Web + PWA

• Web dashboard (v0.3) — FastAPI + HTMX + Alpine.js + Tailwind, no build step
• Mobile PWA (v0.3) — installable app with Web Push notifications and quick-entry from your phone
• Start on demand via remark-bridge serve-web

Extensibility

• Plugin system (v0.3) — custom action extractors, OCR backends, note post-processors, sync hooks. Load from a local directory or pip-installed packages.

Operations

• Cost tracking — token usage and USD cost logged per API call
• Health check — remark-bridge doctor verifies config, auth, vault, API keys, and system deps
• Idempotent — SQLite state tracking with WAL mode; notes are never processed twice

Architecture

┌─────────────────┐     reMarkable Cloud API      ┌──────────────────────┐
│  reMarkable      │◄──────────────────────────────►│  reMark              │
│  Paper Pro / rM2 │     (sync 1.5 / JWT auth)     │  (VPS - systemd)     │
└─────────────────┘                                 │                      │
                                                    │  ┌────────────────┐  │
                                                    │  │ sync_engine    │  │
                                                    │  │ ocr_pipeline   │  │
                                                    │  │ note_processor │  │
                                                    │  │ obsidian_write │  │
                                                    │  │ response_push  │  │
                                                    │  └────────────────┘  │
                                                    │         │            │
                                                    │         ▼            │
                                                    │  ┌────────────────┐  │
                                                    │  │ Obsidian Vault │  │
                                                    │  │ (Git-synced)   │  │
                                                    │  └────────────────┘  │
                                                    └──────────────────────┘

Data Flow

1. DETECT    → New/changed notebook on reMarkable Cloud
2. DOWNLOAD  → Fetch .rm files + metadata via sync 1.5 protocol
3. CONVERT   → Extract text (built-in conversion → fallback OCR)
4. PROCESS   → Extract structure, action items, tags
5. STORE     → Write Markdown + frontmatter to Obsidian vault
6. RESPOND   → Generate summary PDF, push back to reMarkable
7. TRACK     → Update sync state DB, commit vault to Git

Requirements

• Python 3.11+
• A reMarkable tablet (Paper Pro or reMarkable 2)
• An Obsidian vault (local or Git-synced)
• An Anthropic API key for note processing
• (Optional) Google Cloud Vision credentials for OCR fallback

VPS Deployment

• Ubuntu 22.04+ or Debian 12+
• 1 GB RAM minimum (2 GB recommended if using VLM OCR)
• 10 GB disk (vault + state + downloaded .rm files)
• Outbound HTTPS to *.remarkable.com, api.anthropic.com, vision.googleapis.com

Installation

From PyPI (recommended)

pip install remark-bridge

From source

git clone https://github.com/BGGBTAC/reMark.git
cd reMark
pip install .

Note: reMark requires libcairo2 for SVG→PNG rendering. On Debian/Ubuntu: sudo apt install libcairo2-dev. On macOS: brew install cairo.

Setup

# Interactive setup — authenticates with reMarkable Cloud,
# creates config, initializes vault structure and state DB
remark-bridge setup

During setup you'll need a one-time code from my.remarkable.com/device/browser/connect.

Configuration

Copy and edit the example config:

cp config.example.yaml config.yaml

Key sections:

Section	What it controls
remarkable	Cloud auth, folder filters, response folder
ocr	Primary/fallback OCR engines, confidence threshold
processing	Model selection, what to extract (actions, tags, summaries)
obsidian	Vault path, folder mapping, Git sync settings
sync	Trigger mode (realtime/scheduled/manual), WebSocket config
response	Response format (PDF/notebook), auto-trigger rules
search	Semantic search — backend, chunking, synthesis
microsoft	Outlook Tasks + Calendar + OneNote + Teams integration
reverse_sync	Obsidian → reMarkable push-back triggers
plugins	Plugin discovery + settings
web	Dashboard host/port, auth, VAPID keys
templates	On-device template engine

See config.example.yaml for the full reference with comments.

Usage

# One-shot sync
remark-bridge sync --once

# Continuous sync (scheduled + realtime based on config)
remark-bridge sync

# Real-time WebSocket watcher only
remark-bridge watch

# Process a specific notebook
remark-bridge process "Meeting Notes 2026-04-13"

# Push a generated response back to the tablet
remark-bridge respond "Meeting Notes 2026-04-13" --format pdf

# Ask your vault a question (semantic search)
remark-bridge ask "what did I decide about the API migration"

# Rebuild the semantic search index
remark-bridge reindex

# Authenticate Microsoft for Outlook/To Do
remark-bridge setup-microsoft

# Run a health check
remark-bridge doctor

# Upload a PDF to your reMarkable
remark-bridge push report.pdf --folder "Work"

# Check sync status + API cost summary
remark-bridge status

# Start MCP server (for Claude Desktop / Claude Code)
remark-bridge serve

# Start the web dashboard + PWA (v0.3)
remark-bridge serve-web

# Push a vault note back to your tablet (v0.3)
remark-bridge push-note "My Vault Note"

# Post a Teams digest (v0.3)
remark-bridge digest --period weekly --teams

# Push an on-device template (v0.3)
remark-bridge template push meeting

# Plugin management (v0.3)
remark-bridge plugins list

# Generate VAPID keys for Web Push (v0.3)
remark-bridge vapid-keys

# One-time import of all existing notebooks
remark-bridge migrate

Web Dashboard + PWA

remark-bridge serve-web  # http://localhost:8080

Routes include /notes, /actions, /ask, /quick-entry, and /settings. When you generate VAPID keys and install the app to your phone's homescreen, Web Push notifications fire for high-priority action items.

Plugin System

Drop a .py file into ~/.config/remark/plugins/ that subclasses one of ActionExtractorHook, OCRBackendHook, NoteProcessorHook, or SyncHook. Plugins are also auto-discovered via the remark_bridge.plugins entry point group.

See src/plugins/examples/at_mention_extractor.py for a reference.

Semantic Search

Enable semantic search by setting search.enabled: true in config.yaml. Three backends are supported:

• local (default) — offline via sentence-transformers, no API costs. Install with pip install 'remark-bridge[local-embeddings]'.
• voyage — highest quality, requires VOYAGE_API_KEY. Install with pip install 'remark-bridge[voyage]'.
• openai — solid quality, requires OPENAI_API_KEY. Install with pip install 'remark-bridge[openai]'.

Embeddings are stored in the same SQLite database as the sync state (via sqlite-vec), so no extra infrastructure is needed.

Microsoft Outlook Integration

Register an app at entra.microsoft.com (Public client, redirect URI https://login.microsoftonline.com/common/oauth2/nativeclient), add its client ID to config.yaml under microsoft.client_id, and run remark-bridge setup-microsoft. Action items will flow into Microsoft To Do; items with deadlines become Outlook Calendar events.

reMarkable Marking Conventions

Use pen colors and text patterns to mark up your notes. reMark detects both, so it works on the monochrome rM2 too (just use text patterns).

Mark	Pen Color	Meaning	Detection
Action item	Red	Task to do	Color filter
Question	Blue	Needs follow-up	Color filter
Important	Yellow highlight	Key info	Color filter
Done	Green	Completed	Color filter
TODO: text	Any	Task	Text pattern
Q: text	Any	Question	Text pattern
! prefix	Any	Priority flag	Text pattern
[ ] checkbox	Any	Task checkbox	Text pattern

Deployment (systemd)

# Install on VPS
sudo apt install libcairo2-dev
pip install remark-bridge

# Run setup
remark-bridge setup

# Copy service files
sudo cp systemd/remarkable-bridge.service /etc/systemd/system/
sudo cp systemd/remarkable-bridge.timer /etc/systemd/system/

# Set your API key in the service file
sudo systemctl edit remarkable-bridge
# Add: Environment=ANTHROPIC_API_KEY=sk-ant-...

# Enable and start
sudo systemctl daemon-reload
sudo systemctl enable --now remarkable-bridge

For timer-based mode (instead of continuous):

sudo systemctl enable --now remarkable-bridge.timer

Project Structure

reMark/
├── src/
│   ├── main.py              # CLI entry point (Click)
│   ├── config.py            # Config loading + validation
│   ├── remarkable/          # reMarkable Cloud interaction
│   │   ├── auth.py          # JWT auth flow
│   │   ├── cloud.py         # Cloud API client (sync 1.5)
│   │   ├── documents.py     # Document listing, download, upload
│   │   ├── websocket.py     # Real-time change notifications
│   │   └── formats.py       # .rm file parsing (wraps rmscene)
│   ├── ocr/                 # Handwriting recognition pipeline
│   │   ├── pipeline.py      # OCR orchestrator (strategy pattern)
│   │   ├── remarkable_builtin.py
│   │   ├── google_vision.py
│   │   ├── vlm.py
│   │   └── renderer.py      # .rm → PNG/SVG rendering
│   ├── processing/          # Intelligent note processing
│   │   ├── structurer.py    # Raw text → structured Markdown
│   │   ├── actions.py       # Action item extraction
│   │   ├── tagger.py        # Auto-tagging
│   │   └── summarizer.py    # Note summarization
│   ├── obsidian/            # Obsidian vault management
│   │   ├── vault.py         # Read/write operations
│   │   ├── frontmatter.py   # YAML frontmatter generation
│   │   ├── templates.py     # Note templates
│   │   └── git_sync.py      # Git commit + push
│   ├── response/            # Push results back to reMarkable
│   │   ├── pdf_generator.py # Generate response PDFs
│   │   ├── notebook_writer.py
│   │   └── uploader.py
│   ├── sync/                # Sync orchestration
│   │   ├── engine.py        # Main sync loop
│   │   ├── state.py         # SQLite state tracking
│   │   ├── scheduler.py     # Cron / interval scheduling
│   │   └── watcher.py       # WebSocket real-time watcher
│   └── mcp/                 # MCP server
│       └── server.py
├── tests/
├── scripts/
├── systemd/
├── vault_template/          # Initial Obsidian vault structure
├── config.example.yaml
├── pyproject.toml
└── LICENSE

Development

git clone https://github.com/BGGBTAC/reMark.git
cd reMark

python3 -m venv .venv
source .venv/bin/activate
pip install -e ".[dev]"

# Run tests
pytest tests/ -v

# Lint
ruff check src/ tests/

License

MIT — see LICENSE.