Skip to main content

Multi-agent research competition orchestrator for autoresearch

Project description

autoevolve

Multi-agent research competition orchestrator for autoresearch. Run parallel AI agents with different strategies and cross-pollinate winning ideas.

Install

pip install autoevolve

Usage

# Initialize a 3-agent competition
autoevolve init --agents 3 --tag mar15

# Check who's winning
autoevolve status
autoevolve leaderboard --detailed

# Spread winning ideas to all agents
autoevolve pollinate

# Export results
autoevolve export --format json -o evolve-results.json

How It Works

  1. init creates a git worktree per agent in a sibling directory, each with a different research strategy
  2. Each agent works independently in its worktree directory using autojudge + autosteer
  3. leaderboard ranks agents by best val_bpb with keep rate tracking
  4. pollinate writes the leader's best experiments to evolve-hints.md in each agent's worktree
  5. Agents incorporate hints and continue competing
  6. cleanup removes worktrees, branches, and config when done

Built-in Strategies

Strategy Approach
Architecture First Explore model structure before tuning
Hyperparams First Sweep learning rates and schedules first
Optimizer First Tune Muon/Adam parameters first
Regularization First Explore weight decay, dropout, z-loss
Efficiency First Maximize compute efficiency to run more experiments
Radical Bold, unconventional changes

Strategies are assigned round-robin. With 3 agents, you get 3 different strategies competing.

Commands

Command Description
autoevolve init --agents N --tag TAG Create N agent worktrees
autoevolve init ... --worktree-dir DIR Place worktrees in custom directory
autoevolve status Quick overview with current leader
autoevolve leaderboard Ranked table with keep rates
autoevolve leaderboard --detailed Full trajectories + strategy effectiveness
autoevolve pollinate Cross-pollinate winning ideas
autoevolve export --format json|tsv Export results for analysis
autoevolve cleanup Remove worktrees, branches, and config

Requirements

  • Python >= 3.10
  • A git repository with autoresearch set up
  • Multiple compute environments (one per agent)

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

autoevolve-1.1.0.tar.gz (12.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

autoevolve-1.1.0-py3-none-any.whl (12.7 kB view details)

Uploaded Python 3

File details

Details for the file autoevolve-1.1.0.tar.gz.

File metadata

  • Download URL: autoevolve-1.1.0.tar.gz
  • Upload date:
  • Size: 12.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for autoevolve-1.1.0.tar.gz
Algorithm Hash digest
SHA256 92a305b5ee1a0815d28e11e0e3133a76c8b6fbcac7355041bcd53a16fa8a7ce5
MD5 1d3cd549d3be3654eecf52d823b787b4
BLAKE2b-256 537f3f89a952b25bd5eeaf87f94490a394ceeb56ce323b583a1788ae6e871096

See more details on using hashes here.

File details

Details for the file autoevolve-1.1.0-py3-none-any.whl.

File metadata

  • Download URL: autoevolve-1.1.0-py3-none-any.whl
  • Upload date:
  • Size: 12.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for autoevolve-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 47eb18c625fc48816442b3433c42276bdde354471df6b01a3ce271d1f34c542e
MD5 b535fc486e1e56714878be6f3a8938cb
BLAKE2b-256 53dfa3c4e2e3216a7bd843fe891f1e535533a4abdf24bb3ee736e6f98b53cde0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page