Skip to main content

Advanced Multi-Agent Research System - Enhanced implementation of Anthropic's orchestrator-worker pattern with 90.2% performance improvement over single-agent systems

Project description

Anthropic Multi-Agent Architecture

Advanced Research System (Based on Anthropic's Paper)

Join our Discord Subscribe on YouTube Connect on LinkedIn Follow on X.com

PyPI version Python 3.10+ License: MIT

An enhanced implementation of the orchestrator-worker pattern from Anthropic's paper, "How we built our multi-agent research system," using the swarms framework. This system achieves 90.2% performance improvement over single-agent systems through advanced parallel execution, LLM-as-judge evaluation, and professional report generation with export capabilities.

โœจ Key Features

Feature Description
Enhanced Orchestrator-Worker Architecture A LeadResearcherAgent with explicit thinking processes plans and synthesizes, while specialized ResearchSubagent workers execute focused tasks with iterative search capabilities.
Advanced Web Search Integration Utilizes exa_search with quality scoring, source reliability assessment, and multi-loop search strategies for comprehensive research.
LLM-as-Judge Evaluation Sophisticated progress evaluation system that determines research completeness, identifies missing topics, and guides iterative refinement.
High-Performance Parallel Execution Leverages ThreadPoolExecutor to run up to 5 specialized agents concurrently, achieving 90% time reduction for complex queries.
Professional Citation System Enhanced CitationAgent with intelligent source descriptions, quality-based formatting, and academic-style citations.
Export Functionality Built-in report export to Markdown files with customizable paths, automatic timestamping, and comprehensive metadata.
Multi-Layer Error Recovery Advanced error handling with fallback content generation, emergency report creation, and adaptive task refinement.
Enhanced State Management Comprehensive orchestration metrics, conversation history tracking, and persistent agent states.

๐Ÿ—๏ธ Architecture

The system follows a dynamic, multi-phase workflow with enhanced coordination:

                [User Query + Export Options]
                            โ”‚
                            โ–ผ
           โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
           โ”‚    LeadResearcherAgent          โ”‚ (Enhanced Orchestrator)
           โ”‚  - Query Analysis & Planning    โ”‚
           โ”‚  - LLM-as-Judge Evaluation      โ”‚
           โ”‚  - Iterative Strategy Refinementโ”‚
           โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                            โ”‚ 1. Analyze & Decompose (with thinking process)
                            โ–ผ
       โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
       โ”‚         Parallel Sub-Tasks              โ”‚
       โ”‚      (Up to 5 concurrent tasks)         โ”‚
       โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
          โ”‚           โ”‚           โ”‚           โ”‚
          โ–ผ           โ–ผ           โ–ผ           โ–ผ
    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
    โ”‚SubAgent 1โ”‚ โ”‚SubAgent 2โ”‚ โ”‚SubAgent 3โ”‚ โ”‚SubAgent Nโ”‚ (Specialized Workers)
    โ”‚Multi-loopโ”‚ โ”‚Multi-loopโ”‚ โ”‚Multi-loopโ”‚ โ”‚Multi-loopโ”‚
    โ”‚ Search   โ”‚ โ”‚ Search   โ”‚ โ”‚ Search   โ”‚ โ”‚ Search   โ”‚
    โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
          โ”‚           โ”‚           โ”‚           โ”‚
          โ–ผ           โ–ผ           โ–ผ           โ–ผ
       โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
       โ”‚     Enhanced Results Aggregation        โ”‚
       โ”‚  - Quality Assessment & Confidence      โ”‚
       โ”‚  - Source Deduplication & Scoring       โ”‚
       โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                            โ”‚ 2. Synthesis & LLM-as-Judge Evaluation
                            โ–ผ
           โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
           โ”‚    LeadResearcherAgent          โ”‚
           โ”‚  - Completeness Assessment      โ”‚
           โ”‚  - Gap Identification           โ”‚
           โ”‚  - Iterative Refinement         โ”‚
           โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                            โ”‚ 3. Generate Final Report
                            โ–ผ
           โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
           โ”‚      Enhanced CitationAgent     โ”‚ (Post-Processor)
           โ”‚  - Smart Source Descriptions    โ”‚
           โ”‚  - Professional Citations       โ”‚
           โ”‚  - Quality Assurance            โ”‚
           โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                            โ”‚ 4. Export & Delivery
                            โ–ผ
              [Final Cited Report + Optional Export]

๐Ÿ”„ Enhanced Workflow Process

  1. Strategic Planning: Advanced query analysis with explicit thinking processes and complexity assessment
  2. Parallel Research: Multiple ResearchSubagent workers with 3-loop search strategies execute concurrently
  3. LLM-as-Judge Evaluation: Sophisticated progress assessment identifies gaps and determines iteration needs
  4. Professional Citation: Enhanced processing with intelligent source descriptions and quality indicators
  5. Export & Delivery: Optional file export with customizable paths and comprehensive metadata

๐Ÿ“ฆ Installation

Prerequisites

  • Python 3.10 or higher
  • API keys for Claude (Anthropic) and Exa search

Install with uv (Recommended)

uv provides the fastest and most reliable package management experience:

pip3 install -U advanced-research

# OR UV
uv pip install -U advanced-research

Environment Setup

Create a .env file in your project root:

# Claude API Key (Primary LLM)
ANTHROPIC_API_KEY="your_anthropic_api_key_here"

# Exa Search API Key
EXA_API_KEY="your_exa_api_key_here"

# Optional: OpenAI API Key (alternative LLM)
OPENAI_API_KEY="your_openai_api_key_here"

๐Ÿš€ Quick Start

from advanced_research import AdvancedResearch

# Initialize the system
research_system = AdvancedResearch(max_iterations=1)

# Run research
results = research_system.research(
    "What are the latest developments in quantum computing?",
    export=True,
    export_path="quantum_computing_report.md",
)

print(results)

๐Ÿค Contributing

This implementation is part of the open-source swarms ecosystem. We welcome contributions!

  1. Fork the repository
  2. Create a feature branch (git checkout -b feature/amazing-research-feature)
  3. Commit your changes (git commit -m 'Add amazing feature')
  4. Push to the branch (git push origin feature/amazing-research-feature)
  5. Open a Pull Request

Development Setup with uv

# Clone and setup development environment
git clone https://github.com/The-Swarm-Corporation/AdvancedResearch.git
cd AdvancedResearch

# Install development dependencies with uv (recommended)
uv sync --dev

# Run tests
uv run pytest

# Run linting
uv run ruff check .
uv run black --check .

# Run type checking
uv run mypy advanced_research/

# Format code
uv run black .
uv run ruff check --fix .

๐Ÿ“„ License

This project is licensed under the MIT License. See the LICENSE file for details.

๐Ÿ“š Citation

If you use this work in your research, please cite both the original paper and this implementation:

@misc{anthropic2024researchsystem,
    title={How we built our multi-agent research system},
    author={Anthropic},
    year={2024},
    month={June},
    url={https://www.anthropic.com/engineering/built-multi-agent-research-system}
}

@software{advancedresearch2024,
    title={AdvancedResearch: Enhanced Multi-Agent Research System},
    author={The Swarm Corporation},
    year={2024},
    url={https://github.com/The-Swarm-Corporation/AdvancedResearch},
    note={Implementation based on Anthropic's multi-agent research system paper}
}

@software{swarms_framework,
    title={Swarms: An Open-Source Multi-Agent Framework},
    author={Kye Gomez},
    year={2023},
    url={https://github.com/kyegomez/swarms}
}

๐Ÿ”— Related Work

๐Ÿ“ž Support

Built with Swarms framework for production-grade agentic applications

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

advanced_research-0.1.4.tar.gz (37.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

advanced_research-0.1.4-py3-none-any.whl (35.5 kB view details)

Uploaded Python 3

File details

Details for the file advanced_research-0.1.4.tar.gz.

File metadata

  • Download URL: advanced_research-0.1.4.tar.gz
  • Upload date:
  • Size: 37.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.12.3 Darwin/24.5.0

File hashes

Hashes for advanced_research-0.1.4.tar.gz
Algorithm Hash digest
SHA256 16de961bbbff3713bdca58429655647a50ab0b7d878bc61d5b9bae3c06a16c26
MD5 59c1ff08b45825856497110af95fbf42
BLAKE2b-256 ef5f6a24c978148bb3229421c97ec5188583d03ecab2efa8b64a395a65aef40d

See more details on using hashes here.

File details

Details for the file advanced_research-0.1.4-py3-none-any.whl.

File metadata

  • Download URL: advanced_research-0.1.4-py3-none-any.whl
  • Upload date:
  • Size: 35.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.12.3 Darwin/24.5.0

File hashes

Hashes for advanced_research-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 ef92ada26b0e128e33a67275e6da88ed7c61b48afa65cee1c9c8f1bc24004a29
MD5 8b217aab4ac256982a7b154e6cc3e840
BLAKE2b-256 cc92ac99dca6d463a53e3ebb4352c1739f1f46c60ef49e4b3d7809c0952bf7bc

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page