Skip to main content

Assess and bootstrap git repositories for AI-assisted development with automated remediation and continuous learning

Project description

AgentReady Repository Scorer

codecov Tests

Assess git repositories against evidence-based attributes for AI-assisted development readiness.

๐Ÿ“š Research-Based Assessment: AgentReady's attributes are derived from comprehensive research analyzing 50+ authoritative sources including Anthropic, Microsoft, Google, ArXiv, and IEEE/ACM. Each attribute is backed by peer-reviewed research and industry best practices. View full research report โ†’

Overview

AgentReady evaluates your repository across multiple dimensions of code quality, documentation, testing, and infrastructure to determine how well-suited it is for AI-assisted development workflows. The tool generates comprehensive reports with:

  • Overall Score & Certification: Platinum/Gold/Silver/Bronze based on comprehensive attribute assessment
  • Interactive HTML Reports: Filter, sort, and explore findings with embedded guidance
  • Version-Control-Friendly Markdown: Track progress over time with git-diffable reports
  • Actionable Remediation: Specific tools, commands, and examples to improve each attribute
  • Schema Versioning: Backwards-compatible report format with validation and migration tools

Quick Start

Container (Recommended)

# Login to GitHub Container Registry (required for private image)
podman login ghcr.io

# Pull container
podman pull ghcr.io/ambient-code/agentready:latest

# Create output directory
mkdir -p ~/agentready-reports

# Assess AgentReady itself
git clone https://github.com/ambient-code/agentready /tmp/agentready
podman run --rm \
  -v /tmp/agentready:/repo:ro \
  -v ~/agentready-reports:/reports \
  ghcr.io/ambient-code/agentready:latest \
  assess /repo --output-dir /reports

# Assess your repository
# For large repos, add -i flag to confirm the size warning
podman run --rm \
  -v /path/to/your/repo:/repo:ro \
  -v ~/agentready-reports:/reports \
  ghcr.io/ambient-code/agentready:latest \
  assess /repo --output-dir /reports

# Open reports
open ~/agentready-reports/report-latest.html

See full container documentation โ†’

Python Package

# Install
pip install agentready

# Assess AgentReady itself
git clone https://github.com/ambient-code/agentready /tmp/agentready
agentready assess /tmp/agentready

# Create virtual environment
python3 -m venv .venv
source .venv/bin/activate  # On Windows: .venv\Scripts\activate

# Install dependencies
pip install -e ".[dev]"

Run Directly via uv (Optional, No Install Required)

If you use uv, you can run AgentReady directly from GitHub without cloning or installing:

uvx --from git+https://github.com/ambient-code/agentready agentready -- assess .

To install it as a reusable global tool:

uv tool install --from git+https://github.com/ambient-code/agentready agentready

After installing globally:

agentready assess .

Harbor CLI (for Benchmarks)

Harbor is required for running Terminal-Bench evaluations:

# AgentReady will prompt to install automatically, or install manually:
uv tool install harbor

# Alternative: Use pip if uv is not available
pip install harbor

# Verify installation
harbor --version

Skip automatic checks: If you prefer to skip the automatic Harbor check (for advanced users):

agentready benchmark --skip-preflight --subset smoketest

Assessment Only

For one-time analysis without infrastructure changes:

# Assess current repository
agentready assess .

# Assess another repository
agentready assess /path/to/your/repo

# Specify custom configuration
agentready assess /path/to/repo --config my-config.yaml

# Custom output directory
agentready assess /path/to/repo --output-dir ./reports

Example Output

Assessing repository: myproject
Repository: /Users/username/myproject
Languages detected: Python (42 files), JavaScript (18 files)

Evaluating attributes...
[โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘] 23/25 (2 skipped)

Overall Score: 72.5/100 (Silver)
Attributes Assessed: 23/25
Duration: 2m 7s

Reports generated:
  HTML: .agentready/report-latest.html
  Markdown: .agentready/report-latest.md

Features

Evidence-Based Attributes

Evaluated across 13 categories:

  1. Context Window Optimization: CLAUDE.md files, concise docs, file size limits
  2. Documentation Standards: README structure, inline docs, ADRs
  3. Code Quality: Cyclomatic complexity, file length, type annotations, code smells
  4. Repository Structure: Standard layouts, separation of concerns
  5. Testing & CI/CD: Coverage, test naming, pre-commit hooks
  6. Dependency Management: Lock files, freshness, security
  7. Git & Version Control: Conventional commits, gitignore, templates
  8. Build & Development: One-command setup, dev docs, containers
  9. Error Handling: Clear messages, structured logging
  10. API Documentation: OpenAPI/Swagger specs
  11. Modularity: DRY principle, naming conventions
  12. CI/CD Integration: Pipeline visibility, branch protection
  13. Security: Scanning automation, secrets management

Tier-Based Scoring

Attributes are weighted by importance:

  • Tier 1 (Essential): 50% of total score - CLAUDE.md, README, types, layouts, lock files
  • Tier 2 (Critical): 30% of total score - Tests, commits, build setup
  • Tier 3 (Important): 15% of total score - Complexity, logging, API docs
  • Tier 4 (Advanced): 5% of total score - Security scanning, performance benchmarks

Missing essential attributes (especially CLAUDE.md at 10% weight) has 10x the impact of missing advanced features.

Interactive HTML Reports

  • Filter by status (Pass/Fail/Skipped)
  • Sort by score, tier, or category
  • Search attributes by name
  • Collapsible sections with detailed evidence
  • Color-coded score indicators
  • Certification ladder visualization
  • Works offline (no CDN dependencies)

Customization

Create .agentready-config.yaml to customize weights:

weights:
  claude_md_file: 0.15      # Increase importance (default: 0.10)
  test_coverage: 0.05       # Increase importance (default: 0.03)
  conventional_commits: 0.01  # Decrease importance (default: 0.03)
  # Other attributes use defaults, rescaled to sum to 1.0

excluded_attributes:
  - performance_benchmarks  # Skip this attribute

output_dir: ./custom-reports

CLI Reference

# Assessment commands
agentready assess PATH                   # Assess repository at PATH
agentready assess PATH --verbose         # Show detailed progress
agentready assess PATH --config FILE     # Use custom configuration
agentready assess PATH --output-dir DIR  # Custom report location

# Configuration commands
agentready --validate-config FILE        # Validate configuration
agentready --generate-config             # Create example config

# Research report management
agentready research-version              # Show bundled research version
agentready research validate FILE        # Validate research report
agentready research init                 # Generate new research report
agentready research add-attribute FILE   # Add attribute to report
agentready research bump-version FILE    # Update version
agentready research format FILE          # Format research report

# Utility commands
agentready --version                     # Show tool version
agentready --help                        # Show help message

Architecture

AgentReady follows a library-first design:

  • Models: Data entities (Repository, Assessment, Finding, Attribute)
  • Assessors: Independent evaluators for each attribute category
  • Services: Scanner (orchestration), Scorer (calculation), LanguageDetector
  • Reporters: HTML and Markdown report generators
  • CLI: Thin wrapper orchestrating assessment workflow

Development

Run Tests

# Run all tests with coverage
pytest

# Run specific test suite
pytest tests/unit/
pytest tests/integration/
pytest tests/contract/

# Run with verbose output
pytest -v -s

Code Quality

# Format code
black src/ tests/

# Sort imports
isort src/ tests/

# Lint code
flake8 src/ tests/ --ignore=E501

# Run all checks
black . && isort . && flake8 .

Project Structure

src/agentready/
โ”œโ”€โ”€ cli/              # Click-based CLI entry point
โ”œโ”€โ”€ assessors/        # Attribute evaluators (13 categories)
โ”œโ”€โ”€ models/           # Data entities
โ”œโ”€โ”€ services/         # Core logic (Scanner, Scorer)
โ”œโ”€โ”€ reporters/        # HTML and Markdown generators
โ”œโ”€โ”€ templates/        # Jinja2 HTML template
โ””โ”€โ”€ data/             # Bundled research report and defaults

tests/
โ”œโ”€โ”€ unit/             # Unit tests for individual components
โ”œโ”€โ”€ integration/      # End-to-end workflow tests
โ”œโ”€โ”€ contract/         # Schema validation tests
โ””โ”€โ”€ fixtures/         # Test repositories

Research Foundation

All attributes are derived from evidence-based research with 50+ citations from:

  • Anthropic (Claude Code documentation, engineering blog)
  • Microsoft (Code metrics, Azure DevOps best practices)
  • Google (SRE handbook, style guides)
  • ArXiv (Software engineering research papers)
  • IEEE/ACM (Academic publications on code quality)

See src/agentready/data/RESEARCH_REPORT.md for complete research report.

License

MIT License - see LICENSE file for details.

Contributing

Contributions welcome! Please ensure:

  • All tests pass (pytest)
  • Code is formatted (black, isort)
  • Linting passes (flake8)
  • Test coverage >80%

Support

  • Documentation: See /docs directory
  • Issues: Report at GitHub Issues
  • Questions: Open a discussion on GitHub

Quick Start: pip install -e ".[dev]" && agentready assess . - Ready in <5 minutes!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentready-2.20.1.tar.gz (309.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentready-2.20.1-py3-none-any.whl (364.4 kB view details)

Uploaded Python 3

File details

Details for the file agentready-2.20.1.tar.gz.

File metadata

  • Download URL: agentready-2.20.1.tar.gz
  • Upload date:
  • Size: 309.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for agentready-2.20.1.tar.gz
Algorithm Hash digest
SHA256 b2670e84225cf7303890155b504602af15713ce7a8a895e6c48b142cdfb88e74
MD5 70fadc3797b61fcf9197636e16610733
BLAKE2b-256 d2f7dd7ed18e9e13d29a6cb342ffa6c248b56aaf5364d5d76e736de07135f660

See more details on using hashes here.

Provenance

The following attestation bundles were made for agentready-2.20.1.tar.gz:

Publisher: release.yml on ambient-code/agentready

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file agentready-2.20.1-py3-none-any.whl.

File metadata

  • Download URL: agentready-2.20.1-py3-none-any.whl
  • Upload date:
  • Size: 364.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for agentready-2.20.1-py3-none-any.whl
Algorithm Hash digest
SHA256 ef72ca7f40b946774c924b63a2b01fc21ede1f97a9c1da62cd2f0b6aab58e472
MD5 8d019dad1011fb06320e96e49227eda9
BLAKE2b-256 3c94bb7a6b955a80bec9a5826f6e0453441170789aa4c2433d24d1f4b5c2555f

See more details on using hashes here.

Provenance

The following attestation bundles were made for agentready-2.20.1-py3-none-any.whl:

Publisher: release.yml on ambient-code/agentready

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page