Skip to main content

Scholarx

CLI or API | MCP

PyPI - Version MCP Server PyPI - Downloads GitHub Repo stars GitHub forks GitHub contributors PyPI - License GitHub GitHub last commit (by committer) GitHub pull requests GitHub closed pull requests GitHub issues GitHub top language GitHub language count GitHub repo size GitHub repo file count (file type) PyPI - Wheel PyPI - Implementation

Version: 2.2.0

Documentation — Installation, deployment, usage across the API, CLI, MCP, and agent interfaces are maintained in the official documentation.


Overview

Scholarx is a production-grade Agent and Model Context Protocol (MCP) server designed to interface directly with Universal Research Paper API — single entry point for arXiv, PMC, bioRxiv, medRxiv, PsyArXiv, OSF, and Semantic Scholar.


Key Features

  • Consolidated Action-Routed MCP Tools: Minimizes token overhead and eliminates tool bloat in LLM contexts by grouping methods into optimized, togglable tool modules.
  • Enterprise-Grade Security: Complete support for Eunomia policies, OIDC token delegation, and granular execution context tracking.
  • Integrated Graph Agent: Built-in Pydantic AI agent supporting the Agent Control Protocol (ACP) and standard Web interfaces (AG-UI).
  • Native Telemetry & Tracing: Out-of-the-box OpenTelemetry exports and native Langfuse tracing.

CLI or API

This agent wraps the Universal Research Paper API — single entry point for arXiv, PMC, bioRxiv, medRxiv, PsyArXiv, OSF, and Semantic Scholar API. The operator can interact with it programmatically or via its integrated execution entrypoints.

Detailed instructions on how to use the underlying API wrappers, extended schema bindings, and developer SDK references are maintained in docs/index.md.


MCP

This server use dynamic Action-Routed tools to optimize token overhead and maximize IDE compatibility.

Available MCP Tools

The table below is auto-generated from the MCP server — do not edit by hand.

Condensed action-routed tools (default — MCP_TOOL_MODE=condensed)

MCP Tool Toggle Env Var Description
sx_info DISCOVERYTOOL Get metadata about sources and categories.
sx_search SEARCHTOOL Search for research papers across all configured sources.
sx_storage STORAGETOOL Manage offline PDF storage and background downloads.

Verbose 1:1 API-mapped tools (MCP_TOOL_MODE=verbose or both)

11 per-operation tools — one per public API method (click to expand)
MCP Tool Toggle Env Var Description
scholarx_download_paper SCHOLAR_X_CLIENTTOOL Download a paper's full PDF synchronously.
scholarx_download_papers SCHOLAR_X_CLIENTTOOL Download many papers in parallel with bounded concurrency.
scholarx_download_urls SCHOLAR_X_CLIENTTOOL Download arXiv PDFs directly by id/URL with bounded concurrency.
scholarx_get_download_status SCHOLAR_X_CLIENTTOOL Get the status of a queued download job.
scholarx_get_paper SCHOLAR_X_CLIENTTOOL Retrieve a single paper from a specific source.
scholarx_get_queue_status SCHOLAR_X_CLIENTTOOL Get the status of all queued downloads.
scholarx_get_recent_papers SCHOLAR_X_CLIENTTOOL Retrieve recently published papers.
scholarx_get_source_status SCHOLAR_X_CLIENTTOOL Get the status of all configured sources.
scholarx_list_categories SCHOLAR_X_CLIENTTOOL List available categories for each source.
scholarx_queue_download SCHOLAR_X_CLIENTTOOL Queue a paper for background downloading.
scholarx_search SCHOLAR_X_CLIENTTOOL Search across all configured sources with deduplication.

3 action-routed tool(s) (default) · 11 verbose 1:1 tool(s). Each is enabled unless its <DOMAIN>TOOL toggle is set false; MCP_TOOL_MODE selects the surface (condensed default · verbose 1:1 · both). Auto-generated — do not edit.

Detailed tool schemas, parameter shapes, and validation constraints are preserved in docs/usage.md.

Dynamic Tool Selection & Visibility

This MCP server supports dynamic toolset selection and visibility filtering at runtime. This allows the operator to restrict the set of exposed tools to prevent blowing up the LLM's context window.

The operator can configure tool filtering via multiple input channels:

  • CLI Arguments: Pass --tools or --toolsets (or their disabled counterparts --disabled-tools and --disabled-toolsets) during startup.
  • Environment Variables: Define standard environment variables:
    • MCP_ENABLED_TOOLS / MCP_DISABLED_TOOLS
    • MCP_ENABLED_TAGS / MCP_DISABLED_TAGS
  • HTTP SSE Request Headers: Pass custom headers during transport initialization:
    • x-mcp-enabled-tools / x-mcp-disabled-tools
    • x-mcp-enabled-tags / x-mcp-disabled-tags
  • HTTP SSE Request Query Parameters: Append query parameters directly to the operator's transport connection URL:
    • ?tools=tool1,tool2
    • ?tags=tag1

When query strings or parameters are supplied, an LLM-free Knowledge Graph resolution layer (using DynamicToolOrchestrator) matches query intents against known tool tags, names, or descriptions, with safe fallback and automated 24-hour background cache refreshing.


MCP Configuration Examples

Install the connector-focused [mcp] extra. Examples use scholarx[mcp] to add FastMCP / FastAPI through agent-connector-sdk; the required Agent Connector SDK core still carries epistemic-graph[full]. The [agent-runtime] extra additionally enables model orchestration.

stdio Transport (local IDEs — Cursor, Claude Desktop, VS Code)

{
  "mcpServers": {
    "scholarx-mcp": {
      "command": "uvx",
      "args": [
        "--from",
        "scholarx[mcp]",
        "scholarx-mcp"
      ],
      "env": {
        "MCP_TOOL_MODE": "intent",
        "DISCOVERYTOOL": "True",
        "NCBI_API_KEY": "your_ncbi_api_key_here",
        "OSF_TOKEN": "your_osf_token_here",
        "S2_API_KEY": "your_s2_api_key_here",
        "SEARCHTOOL": "True",
        "STORAGETOOL": "True"
      }
    }
  }
}

Runtime references require an alias-aware launcher such as Arbora. Other launchers must omit those entries and inject the resolved values through their own runtime secret boundary.

Streamable-HTTP Transport (networked / production)

{
  "mcpServers": {
    "scholarx-mcp": {
      "command": "uvx",
      "args": [
        "--from",
        "scholarx[mcp]",
        "scholarx-mcp",
        "--transport",
        "streamable-http",
        "--port",
        "8000"
      ],
      "env": {
        "TRANSPORT": "streamable-http",
        "HOST": "127.0.0.1",
        "PORT": "8000",
        "MCP_TOOL_MODE": "intent",
        "DISCOVERYTOOL": "True",
        "NCBI_API_KEY": "your_ncbi_api_key_here",
        "OSF_TOKEN": "your_osf_token_here",
        "S2_API_KEY": "your_s2_api_key_here",
        "SEARCHTOOL": "True",
        "STORAGETOOL": "True"
      }
    }
  }
}

Alternatively, connect to a pre-deployed Streamable-HTTP instance by url:

{
  "mcpServers": {
    "scholarx-mcp": {
      "url": "http://localhost:8000/scholarx-mcp/mcp"
    }
  }
}

Run a reviewed container image as a least-privilege stdio child (no listener or published port):

docker run -i --rm \
  --read-only \
  --cap-drop=ALL \
  --security-opt=no-new-privileges \
  --pids-limit=256 \
  --tmpfs /tmp:rw,noexec,nosuid,nodev,size=64m \
  -e TRANSPORT=stdio \
  -e MCP_TOOL_MODE=intent \
  -e DISCOVERYTOOL=True \
  -e NCBI_API_KEY=your_ncbi_api_key_here \
  -e OSF_TOKEN=your_osf_token_here \
  -e S2_API_KEY=your_s2_api_key_here \
  -e SEARCHTOOL=True \
  -e STORAGETOOL=True \
  registry.example.invalid/scholarx@sha256:<digest> scholarx-mcp

For containerized network HTTP, supply an authenticated TLS ingress (or direct server TLS), exact MCP_ALLOWED_HOSTS, and an exact trusted-proxy CIDR policy through the operator-owned deployment profile. The generator does not emit an unauthenticated non-loopback listener.

Auto-generated from the code-read env surface (MCP_TOOL_MODE + package vars) — do not edit.

Additional Deployment Options

scholarx can run as a local stdio process or container, or behind a remote network boundary. The Deployment guide carries the detailed transport contract.

  • Local container — launch a reviewed immutable image as a least-privilege stdio child with no listener or published port.
  • Remote URL — connect through an operator-supplied authenticated HTTPS ingress. Keep its URL, outbound identity references, trust profile, and exact MCP_ALLOWED_HOSTS in AgentConfig.

Agent

This repository features a fully integrated Pydantic AI Graph Agent. It communicates over the Agent Control Protocol (ACP) and interacts smoothly with the Agent Web UI (AG-UI) and Terminal interface.

Running the Agent CLI

To start the interactive command-line agent:

# Set credentials
export SCHOLARX_STORAGE_DIR="your_value"
export DEBUG="your_value"
export PYTHONUNBUFFERED="your_value"
export SERVICENOW_INSTANCE="your_value"
export SERVICENOW_USERNAME="your_value"
export OSF_TOKEN="your_value"
export S2_API_KEY="your_value"
export NCBI_API_KEY="your_value"
export SERVICENOW_PASSWORD="your_value"

# Run the agent server
scholarx-agent --provider openai --model-id gpt-4o

Docker Compose Orchestration

version: '3.8'

services:
  scholarx-mcp:
    image: example/scholarx@sha256:<digest>
    container_name: scholarx-mcp
    hostname: scholarx-mcp
    restart: always
    env_file:
      - ../.env
    environment:
      - PYTHONUNBUFFERED=1
      - HOST=0.0.0.0
      - PORT=8004
      - TRANSPORT=streamable-http
    ports:
      - "8004:8004"
    healthcheck:
      test: ["CMD", "python3", "-c", "import urllib.request; urllib.request.urlopen('http://localhost:8004/health')"]
      interval: 30s
      timeout: 10s
      retries: 3
      start_period: 10s
    logging:
      driver: json-file
      options:
        max-size: "10m"
        max-file: "3"

    image: example/scholarx@sha256:<digest>
    container_name: scholarx-agent
    hostname: scholarx-agent
    restart: always
    depends_on:
      - scholarx-mcp
    env_file:
      - ../.env
    command: [ "scholarx-agent" ]
    environment:
      - PYTHONUNBUFFERED=1
      - HOST=0.0.0.0
      - PORT=9600
      - MCP_URL=http://scholarx-mcp:8004/mcp
      - PROVIDER=${PROVIDER:-openai}
      - MODEL_ID=${MODEL_ID:-gpt-4o}
      - ENABLE_WEB_UI=True
      - ENABLE_OTEL=True
    ports:
      - "9600:9600"
    healthcheck:
      test: ["CMD", "python3", "-c", "import urllib.request; urllib.request.urlopen('http://localhost:9600/health')"]
      interval: 30s
      timeout: 10s
      retries: 3
      start_period: 10s
    logging:
      driver: json-file
      options:
        max-size: "10m"
        max-file: "3"

Detailed graph node architecture explanations, custom skill configurations, and agentic trace guides are available in docs/deployment.md.


Security & Governance

Built directly upon the enterprise-ready agent-connector-sdk core, standard security parameters are fully supported:

Access Control & Policy Enforcement

  • Eunomia Policies: Fine-grained, policy-driven tool authorization. Supports none, local embedded (mcp_policies.json), or centralized remote modes.
  • OIDC Token Delegation: Compliant with RFC 8693 token exchange for flowing authenticating user credentials from Web UI / ACP → Agent → MCP.
  • Scoped Credentials: Execution context runs restricted to the specific caller identity.

Runtime Security Grid

Feature Feature Enablement
Tool Guard Sensitivity inspection with human-in-the-loop validation Enabled by default
Prompt Injection Defense Input scanning, repetition monitoring, and recursive loop blocks Enabled by default
Context Safety Guard Stuck-loop detectors and contextual overflow preemptive alerts Enabled by default

Environment Variables

Package environment variables

Variable Example Description
HOST 127.0.0.1
PORT 8004
TRANSPORT stdio options: stdio, streamable-http, sse
AUTH_TYPE none options: none, static, jwt, oauth-proxy, oidc-proxy, remote-oauth
DEFAULT_AGENT_NAME ScholarX Agent
ENABLE_OTEL True
OTEL_EXPORTER_OTLP_ENDPOINT http://localhost:8080/api/public/otel
OTEL_EXPORTER_OTLP_PUBLIC_KEY secret-injected
OTEL_EXPORTER_OTLP_SECRET_KEY secret-injected
OTEL_EXPORTER_OTLP_PROTOCOL http/protobuf
EUNOMIA_TYPE none options: none, embedded, remote
EUNOMIA_POLICY_FILE mcp_policies.json
EUNOMIA_REMOTE_URL http://eunomia-server:8000
DEBUG False
PYTHONUNBUFFERED 1
OSF_TOKEN secret-injected OSF / PsyArXiv
S2_API_KEY secret-injected Semantic Scholar
NCBI_API_KEY secret-injected PubMed Central (NCBI E-utilities)
SEARCHTOOL True
DISCOVERYTOOL True
STORAGETOOL True

Inherited agent-connector-sdk variables (apply to every connector)

Variable Example Description
MCP_TOOL_MODE intent Tool surface: intent | condensed | verbose | both
MCP_ENABLED_TOOLS — Comma-separated tool allow-list
MCP_DISABLED_TOOLS — Comma-separated tool deny-list
MCP_ENABLED_TAGS — Comma-separated tag allow-list
MCP_DISABLED_TAGS — Comma-separated tag deny-list
MCP_CLIENT_AUTH — Outbound MCP child auth: oidc-client-credentials | basic | none
OIDC_CLIENT_ID — OIDC client id (service-account auth)
OIDC_CLIENT_SECRET_REF secret://identity/oidc-client-secret Runtime secret reference for the OIDC service account
MCP_BASIC_AUTH_USERNAME — HTTP Basic username (MCP_CLIENT_AUTH=basic)
MCP_BASIC_AUTH_PASSWORD_REF secret://identity/mcp-basic-password Runtime secret reference for HTTP Basic auth (MCP_CLIENT_AUTH=basic)
MCP_URL http://localhost:8000/mcp URL of the MCP server the agent connects to
PROVIDER openai LLM provider for the agent
MODEL_ID gpt-4o Model id for the agent
ENABLE_WEB_UI True Serve the AG-UI web interface

21 package + 14 inherited variable(s). Auto-generated from .env.example + the shared agent-connector-sdk set — do not edit.

The application can be configured using the following environment variables:

Variable Type Default Description
HOST String 0.0.0.0 Host IP address to bind the servers to.
PORT Integer 8004 Port number to run the servers on.
TRANSPORT String stdio MCP transport type (stdio, streamable-http, sse).
AUTH_TYPE String none Authentication type for access control (none, basic, custom).
DEFAULT_AGENT_NAME String ScholarX Agent Custom show name for the Pydantic AI Graph Agent.
ENABLE_OTEL Boolean True Enable OpenTelemetry tracing and exports.
EUNOMIA_TYPE String none Eunomia policy evaluation mode (none, embedded, remote).
EUNOMIA_POLICY_FILE String mcp_policies.json Path to the local Eunomia policy configuration file.
EUNOMIA_REMOTE_URL String Centralized Eunomia server endpoint.
SCHOLARX_STORAGE_DIR String ~/.local/share/scholarx/papers Directory path where downloaded PDF papers are cached.
DEBUG Boolean False Enable verbose debugging mode.
PYTHONUNBUFFERED Integer 1 Forces stdout and stderr to be unbuffered.
SERVICENOW_INSTANCE String ServiceNow instance base URL.
SERVICENOW_USERNAME String ServiceNow account username.
SERVICENOW_PASSWORD String ServiceNow account password.
OSF_TOKEN String API Access Token for OSF integration.
S2_API_KEY String Semantic Scholar API Key to bypass public rate limits.
NCBI_API_KEY String NCBI API Key for PubMed Central (PMC) queries.
SEARCHTOOL Boolean True Toggle to enable/disable Search MCP tool category.
DISCOVERYTOOL Boolean True Toggle to enable/disable Discovery MCP tool category.
STORAGETOOL Boolean True Toggle to enable/disable Storage MCP tool category.

Installation

Pick the extra that matches what the operator want to run:

Extra Installs Use when
scholarx[mcp] Connector-focused MCP server (agent-connector-sdk — FastMCP/FastAPI + epistemic-graph[full]) The operator only run the MCP server (smallest install / image)
scholarx[all] Everything (mcp + agent) Development / both surfaces
# Connector-focused MCP server (includes the shared graph engine)
uv pip install "scholarx[mcp]"

# Agent runtime (adds model orchestration to the shared graph engine)

# Everything (development)
uv pip install "scholarx[all]"      # or: python -m pip install "scholarx[all]"

Container images (:mcp)

One multi-stage docker/Dockerfile builds the MCP-only image (--target mcp):

Image tag Build target Contents Entrypoint
example/scholarx:mcp --target mcp scholarx[mcp] — connector-focused, includes epistemic-graph[full]; no model-orchestration stack scholarx-mcp
docker build --target mcp   -t example/scholarx:mcp    docker/   # connector-focused MCP server

agent (immutable agent digest) with a co-located :mcp sidecar.

Knowledge-graph database (epistemic-graph)

Agent Connector SDK core dependency (epistemic-graph[full]). The [mcp] extra keeps deployments can use the bundled engine. For production or shared state, run epistemic-graph as a dedicated database service and configure the runtime to use it. Deployment recipes (single-node + Raft HA), connection configuration, and architecture diagrams are documented in the epistemic-graph deployment guide.


Documentation

The complete documentation is published as the official documentation site and is the recommended reference for installation, deployment, and day-to-day operation.

Page Contents
Installation pip, source, extras, prebuilt Docker image
Deployment run the MCP server and the agent, Compose, Caddy + Technitium, env config
Usage the MCP tools, the ScholarXClient API, the CLI
Overview ecosystem role, enterprise readiness, architecture
Concepts concept registry (CONCEPT:SX-*)
Coverage Report per-source coverage and verification

AGENTS.md is the canonical contributor/agent guidance.


Repository Owners

GitHub followers GitHub User's stars


Contribute

Contributions are welcome! Please ensure code quality by running local checks before submitting pull requests:

  • Format code using ruff format .
  • Lint code using ruff check .
  • Validate type-safety with mypy .
  • Ran test suites using pytest

Governed capability contract

This package ships a compact canonical skill surface with specialist procedures kept as referenced workflows. The current MCP tools, skill metadata, connector_manifest.yml, ontology, mappings, shapes, fixtures, migrations, tool-schema fingerprints, and certification metadata form one versioned capability contract. Validate them together; do not rely on stale tool names or historical per-task skill wrappers.

Runtime endpoints, credentials, certificate trust, tenant identity, retention, and observability policy are deployment inputs and are never packaged values. See Configuration, trust, and privacy before enabling a network transport, connector ingestion, Arbora delegation, or trace export.

Metadata

Release files for scholarx 2.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for scholarx 2.2.0
File Interpreter ABI Platform
scholarx-2.2.0-py3-none-any.whl Python 3 none any Details

Release files / scholarx-2.2.0-py3-none-any.whl

Download URL scholarx-2.2.0-py3-none-any.whl
Size 88.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
4747d945816331ce747466287a4a905d9cb5b4a576c9da26cdf4f46946448f0c
BLAKE2b-256 checksum
How to use checksums
f05f6e560b689d2b02e5b9dc1ab019892e0d1e7dd34b43f53016bd10c18cac0b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.14.4

Release history Release notifications | RSS feed

2.3.2

2 release files

2.3.1

1 release file

2.3.0

1 release file

2.2.1

1 release file

This release

2.2.0 This release

1 release file

1.0.1

2 release files

0.30.0

2 release files

0.28.0

2 release files

0.27.0

2 release files

0.26.0

2 release files

0.20.0

2 release files

0.18.0

2 release files

0.16.0

2 release files

0.11.0

2 release files

0.8.1

2 release files

0.8.0

2 release files

0.7.0

2 release files

0.6.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page