Skip to main content

Q1-calibre academic peer-review simulation MCP server — Reviewer #2 at your service.

Project description

Q1-Reviewer-MCP Logo

Q1-Reviewer-MCP

"Get rejected by us before you get rejected by them."

PyPI Version Python License MCP

An AI-powered MCP server that simulates a ruthless Q1 journal Reviewer #2 — so your manuscript gets torn apart before it ever reaches the real one.


🎯 What Is This?

Q1-Reviewer-MCP is a Model Context Protocol (MCP) server that turns Claude into a merciless academic peer reviewer. It reads your .docx manuscript, applies a battle-tested Q1 Red Flag Matrix, and produces a professionally formatted .docx decision letter — complete with color-coded severity ratings.

Think of it as having a permanently angry Reviewer #2 living inside your AI assistant, catching the exact issues that get manuscripts rejected from Nature, Cell, Plant Physiology, and other Q1 journals.

The Problem It Solves

Academic authors routinely receive "Major Revision" or "Reject" decisions due to preventable issues:

  • 🔴 Overclaiming in the Discussion ("We proved that...")
  • 🔴 Causal language without mechanistic evidence
  • 🟠 Weak knowledge-gap framing in the Introduction
  • 🟠 Insufficient biological replicates (n < 3)
  • 🟡 Missing statistical test justification
  • 🟡 No limitations paragraph

These issues are invisible to the author but predictable to an experienced reviewer. Q1-Reviewer catches them before submission.


✨ Features

🔬 Q1 Red Flag Matrix

Embedded review criteria covering:

  • Overclaiming detection — flags "prove", "perfectly", "definitively" in biological contexts
  • Causal language audit — catches "X causes Y" when only correlation data exists
  • Introduction analysis — detects missing knowledge gap statements
  • Methodology audit — flags n<3 replicates, missing normality tests, absent controls
  • Discussion audit — catches new data, excessive speculation, missing limitations
  • Results verification — ensures claims reference figures/tables

📄 Professional Output

Decision letters that look like real journal reviews:

  • Color-coded severity — 🔴 Critical (red), 🟠 Major (orange), 🟢 Positive (green)
  • Structured format — Editor Decision → Concerns → Revisions → Strengths
  • Times New Roman, justified — academic standard formatting
  • Issue-level guidance — THE FLAW → THE Q1 STANDARD → THE DIRECTION
  • Saved as .docx — ready to share with co-authors

🧠 3-Tier Section Detection

Handles any manuscript format:

  • Tier 1: Word Heading styles (most reliable)
  • Tier 2: Bold/uppercase keyword matching (no styles? no problem)
  • Tier 3: Full-text fallback (unstructured? we'll still review it)

🌍 Smart Language Detection

Designed for scientific manuscripts:

  • Multi-section sampling for accuracy
  • Filters Latin taxonomic names (Arabidopsis thaliana, E. coli)
  • Won't mistake in vitro or et al. for non-English text

🏗️ Architecture

Q1-Reviewer-MCP follows the Tool-as-Data-Fetcher pattern — the MCP server is purely a filesystem operator. All analytical intelligence lives in the host LLM (Claude), guided by the Q1 Red Flag Matrix embedded in tool descriptions.

┌─────────────────────────────────────────────────────────────┐
│                     HOST LLM (Claude)                        │
│   ┌─────────────────────────────────────────────────────┐   │
│   │              Q1 Red Flag Matrix                      │   │
│   │   (Embedded in tool descriptions — auto-injected)    │   │
│   └─────────────────────────────────────────────────────┘   │
│              Reasons, analyzes, generates critique           │
└──────────────────────────┬──────────────────────────────────┘
                           │ MCP Protocol (stdio)
┌──────────────────────────┼──────────────────────────────────┐
│            Q1-Reviewer-MCP Server (Python)                   │
│   ┌──────────────────┐   ┌───────────────────────────────┐  │
│   │ parse_manuscript_ │   │ generate_docx_report()        │  │
│   │ sections()        │   │ Writes formatted .docx        │  │
│   │ Reads .docx       │   │ decision letter to disk       │  │
│   └──────────────────┘   └───────────────────────────────┘  │
│                                                              │
│   📁 manuscript_v1.docx  →  📄 Q1_Review_Report.docx       │
└──────────────────────────────────────────────────────────────┘

Why this design?

  • 🧠 All intelligence upgrades automatically — when Claude improves, reviews improve
  • 💰 Zero server-side LLM costs — no API calls from the server
  • 🧪 Easy to test — server only does file I/O
  • 🔒 Secure — no ports, no HTTP, no authentication (stdio only)

📦 Installation

Prerequisites

  • Python 3.10+
  • Claude Desktop or Cursor (any MCP-compatible host)

Install from PyPI

pip install q1-reviewer-mcp

Install from Source

git clone https://github.com/ZaEyAsa/Q1-reviewer-mcp.git
cd Q1-reviewer-mcp
pip install -e .

⚙️ Configuration

Claude Desktop

Add to your Claude Desktop config file:

  • Windows: %APPDATA%\Claude\claude_desktop_config.json
  • macOS: ~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "q1-reviewer": {
      "command": "python",
      "args": ["-m", "q1_reviewer.server"]
    }
  }
}

Note: If python isn't in your PATH, use the full path (e.g., "C:\\Python313\\python.exe" on Windows).

Cursor

Add the same configuration in Cursor Settings → MCP Servers.

Verify Installation

After restarting Claude Desktop, you should see three tools available:

  • parse_manuscript_sections — reads your manuscript
  • generate_docx_report — writes the review report
  • compare_revisions — compares V1 review with V2 manuscript (Phase 3)

🚀 Usage

Quick Start

  1. Open Claude Desktop
  2. Provide your manuscript path:
Please review my manuscript at:
C:/Users/me/Desktop/my_paper_v1.docx

Save the review report to the same directory.
  1. Claude will:
    • 📖 Read and parse your manuscript sections
    • 🔬 Apply the Q1 Red Flag Matrix
    • 📝 Generate a detailed critique
    • 💾 Save a formatted .docx decision letter

What You'll Get

A professional .docx report containing:

Section Description
Editor Decision Overall verdict (Accept / Minor Revision / Major Revision / Reject)
Critical Concerns 🔴 Issues that would likely cause immediate rejection
Major Concerns 🟠 Significant issues requiring substantial revision
Minor Concerns Issues that should be addressed but aren't dealbreakers
Recommended Revisions Numbered action items for the author
Positive Aspects 🟢 Strengths of the manuscript (yes, we're fair too)

Example Output

Each issue follows the structured format:

issue_1: Pervasive Overclaiming

THE FLAW: The manuscript uses "proved" and "definitively demonstrated" in the Discussion, which are absolute claims inappropriate for biological research.

THE Q1 STANDARD: Q1 journals expect hedged language that reflects the inherent uncertainty of experimental biology. Only mathematical proofs allow "prove."

THE DIRECTION: Replace absolute claims with "suggest", "indicate", or "support the hypothesis that."


🔍 Q1 Red Flag Matrix

The review engine applies these rule categories:

🔴 Overclaiming Rules (click to expand)
  • Flags absolute language: "prove", "perfect", "completely", "definitively", "undoubtedly"
  • Context-aware: accepts in mathematical/structural biology proofs
  • Flags causal language ("X causes Y") when only correlation data is presented
  • Suggests appropriate alternatives: "indicate", "suggest", "demonstrate"
📝 Introduction Audit Rules
  • Detects missing knowledge gap statements
  • Flags overpromising scope (claims vs. actual methodology)
  • Checks for the critical sentence: "However, [specific gap] remains unknown"
🔬 Methodology Audit Rules
  • Statistical test justification required
  • Normality test reference for parametric tests
  • Biological replicates: n ≥ 3 or power analysis
  • Negative controls in functional assays
  • Units on all numerical measurements
💬 Discussion Audit Rules
  • New data in Discussion (must appear in Results first)
  • Speculation depth limit (max 2 inferential steps)
  • Mandatory limitations paragraph
  • Data-claim alignment check

📁 Project Structure

q1-reviewer-mcp/
├── src/q1_reviewer/
│   ├── server.py                  # MCP server entry point
│   ├── tools/
│   │   ├── parse.py               # 📖 parse_manuscript_sections()
│   │   ├── report.py              # 📝 generate_docx_report()
│   │   └── compare.py             # 🔄 compare_revisions() [Phase 3]
│   ├── formatting/
│   │   └── docx_builder.py        # .docx formatting engine
│   └── utils/
│       ├── section_splitter.py    # 3-tier section detection
│       └── lang_check.py          # Language detection
├── tests/
│   ├── test_parse.py              # 34 unit tests
│   ├── test_report.py             # 15 unit tests
│   ├── test_e2e.py                # End-to-end pipeline test
│   └── fixtures/                  # Test manuscripts
├── config/
│   └── claude_desktop_config.json # Example config
├── logo-q1-reviewer-mcp.png       # Project logo
├── pyproject.toml
├── requirements.txt
├── LICENSE
└── CHANGELOG.md

🧪 Testing

# Run all tests (49 tests)
python -m pytest tests/ -v

# Run specific modules
python -m pytest tests/test_parse.py -v    # Section parsing tests
python -m pytest tests/test_report.py -v   # Report generation tests

# Run end-to-end pipeline test
python tests/test_e2e.py

🗺️ Roadmap

Phase Name Status Description
1 The Overclaim Detector Complete MVP: parse .docx, apply Red Flag Matrix, generate .docx report
2 The Full Reviewer 🔜 Planned Full-section analysis (Intro, Methods, Results) with per-issue severity scoring
3 The Editor 📋 Designed V1↔V2 revision comparison with LLM-as-a-Judge scoring

🔧 Tech Stack

Component Technology
Language Python 3.10+
MCP Framework Official MCP Python SDK (FastMCP)
Document I/O python-docx
Language Detection langdetect
Transport stdio
Host Client Claude Desktop / Cursor

🤝 Contributing

Contributions are welcome! Please:

  1. Fork the repository
  2. Create a feature branch (git checkout -b feature/amazing-feature)
  3. Run the tests (python -m pytest tests/ -v)
  4. Commit your changes (git commit -m 'Add amazing feature')
  5. Push to the branch (git push origin feature/amazing-feature)
  6. Open a Pull Request

📄 License

This project is licensed under the MIT License — see the LICENSE file for details.


👤 Author

ZaEyAsaGitHub


🌟 Related Projects

  • Q1-Crafter-MCP — AI-powered academic writing assistant (the writing companion to Q1-Reviewer)

Because every manuscript deserves a Reviewer #2 before it meets the real one.

Built with ❤️ for the academic community

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

q1_reviewer_mcp-0.1.0.tar.gz (35.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

q1_reviewer_mcp-0.1.0-py3-none-any.whl (25.2 kB view details)

Uploaded Python 3

File details

Details for the file q1_reviewer_mcp-0.1.0.tar.gz.

File metadata

  • Download URL: q1_reviewer_mcp-0.1.0.tar.gz
  • Upload date:
  • Size: 35.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for q1_reviewer_mcp-0.1.0.tar.gz
Algorithm Hash digest
SHA256 80dc1980f94bb09e61428ca6d75a973951ff2e4cc1a22fb27c4533da3ec97178
MD5 d4ee5946eaa70ce484044484c9f116e1
BLAKE2b-256 bb51e4bf2a0e185bc02a17effce2e3b48cf9867e7ba2c1609268e9db2a09c8c7

See more details on using hashes here.

File details

Details for the file q1_reviewer_mcp-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for q1_reviewer_mcp-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a16380f6715d6ed2b3cc41c7bf860664ed1ddcb72eca6a6844050874fb8df2fa
MD5 35ce44b4dd324fa0dfea42901cf14a2e
BLAKE2b-256 24c8febb6b059e396600ff81306600b08efeed9a28d5a7803ff41a0f68a9ebc9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page