arXiv Pulse

Intelligent arXiv Literature Tracking System

🌐 Language: 中文文档

arXiv Pulse is a Python package for automated crawling, summarizing, and tracking of the latest research papers from arXiv. It supports all arXiv categories and provides a modern web interface for a professional literature management experience.

📸 Screenshots

✨ Key Features

• 🌐 Web Interface: Modern FastAPI + Vue 3 + Element Plus interface with real-time SSE streaming
• 🚀 One-Command Start: Simply run pulse serve to start the service
• 📝 Web Configuration: First-time setup wizard, all settings stored in database
• 🤖 AI Auto-Processing: Automatic translation, AI summarization, and figure extraction
• 💬 AI Chat Assistant: Ask questions about papers with context-aware AI assistant
• 🔍 Smart Search: Natural language queries with AI-powered keyword parsing
• 📁 Paper Collections: Create, edit, and delete collections to organize important papers
• 🛒 Paper Basket: Select multiple papers for batch operations
• 🔒 Secure by Default: Localhost-only binding, explicit confirmation for remote access
• 🌍 Multilingual Support: UI in Chinese/English, translation to multiple languages

🆕 What's New in 1.2.0

• Enhanced UI Components: Redesigned buttons, switches, selects, dialogs with refined shadows and transitions
• Paper Index Numbers: Visual index numbers on paper cards for easy reference
• Back-to-Top Button: Quick navigation with scroll-aware floating button
• Tooltips for Floating Buttons: Helpful labels on hover for all floating action buttons
• Recent Papers AI Search: Search within recent papers using natural language
• Sync Page Improvements: Better spacing, help icons with tooltips
• SQLite WAL Mode: Concurrent read/write operations for better performance
• Bug Fixes: Form submission, pagination visibility, index preservation during search

🚀 Quick Start

Installation

pip install arxiv-pulse

Start Service

# Create data directory
mkdir my_papers && cd my_papers

# Start web service (background mode by default)
pulse serve .

# Or specify port
pulse serve . --port 3000

# Foreground mode (see logs in terminal)
pulse serve . -f

Then visit http://localhost:8000

Service Management

pulse status .          # Check service status
pulse stop .            # Stop service
pulse restart .         # Restart service
pulse stop . --force    # Force stop (SIGKILL)

Remote Access (SSH Tunnel)

By default, the service only accepts localhost connections for security. For remote access, use SSH tunnel:

# On server
pulse serve .

# On your computer
ssh -L 8000:localhost:8000 user@server

# Then visit http://localhost:8000

This provides encrypted connection without exposing your API keys.

First-Time Setup

1. Visit http://localhost:8000
2. Follow the setup wizard:
   • Step 1: Configure AI API (OpenAI/DeepSeek key, model, endpoint)
   • Step 2: Select research fields
   • Step 3: Set sync parameters
   • Step 4: Start initial sync

🔒 Security

arXiv Pulse is designed with security in mind:

• Localhost-only by default: Service binds to 127.0.0.1, inaccessible from external networks
• No plaintext credentials: API keys stored in local SQLite database, never transmitted
• Explicit remote access: Opening to non-localhost requires a flag with security warning

For remote access, we recommend:

1. SSH Tunnel (easiest): ssh -L 8000:localhost:8000 user@server
2. VPN: WireGuard, OpenVPN, or Tailscale
3. Reverse Proxy: Nginx/Caddy with HTTPS

# If you must open to network (not recommended)
pulse serve . --host 0.0.0.0 --allow-non-localhost-access-with-plaintext-transmission-risk

📖 Daily Usage

Pages

Features

• Search: Use natural language like "DFT calculations for battery materials"
• Filter: Click "Filter Fields" to select research areas
• AI Chat: Click the chat icon (bottom-right) to ask questions
• Paper Basket: Click basket icon on cards to collect papers for batch operations
• Settings: Click gear icon to modify API key, language, and sync options

📁 Project Structure

arxiv_pulse/
├── core/                   # Core infrastructure (Config, Database, Lock)
├── models/                 # SQLAlchemy ORM models
├── services/               # Business logic (AI, translation, papers)
├── crawler/                # ArXiv API crawler
├── ai/                     # Paper summarizer, report generator
├── search/                 # AI-powered search engine
├── cli/                    # Command-line interface
├── web/                    # FastAPI web application
│   ├── app.py             # FastAPI app
│   ├── api/               # API endpoints
│   └── static/            # Vue 3 frontend (components, stores, i18n)
└── i18n/                   # Backend translations

Data Directory/
├── data/arxiv_papers.db    # SQLite database
└── web.log                 # Service log

For detailed architecture, see DEV.md.

🔧 API Endpoints

🧪 Research Fields

arXiv Pulse supports all arXiv categories. Simply select your fields of interest in the Settings page. Pre-configured options include:

You can also add custom search queries for any topic on arXiv.

🐛 Troubleshooting

Q: Port already in use?

pulse serve . --port 3000

Q: Service shows "not running" but port is occupied?

pulse stop . --force
# Or remove stale lock
rm .pulse.lock

Q: How to reinitialize?

rm data/arxiv_papers.db
pulse serve .

Q: AI not responding?

• Check API key in Settings
• Check console for errors (F12 → Console)
• Try foreground mode to see logs: pulse serve . -f

📄 License

GPL-3.0 - see LICENSE for details.

🙏 Acknowledgments

This project was developed by OpenCode, an AI coding agent.

• Yang Li - For 500+ iterations of requirements discussions, design decisions, and testing feedback. This project would not exist without your patience and vision.
• GLM-5 - For providing the core intelligence that powers OpenCode. ~200 million tokens consumed in bringing this project to life.
• arXiv.org - For the open API
• Computational materials science community - For inspiration and use cases

arXiv Pulse - Making arXiv literature tracking simple and efficient!