Skip to main content

Assess and bootstrap git repositories for AI-assisted development with automated remediation and continuous learning

Project description

AgentReady Repository Scorer

codecov Tests

Assess git repositories against evidence-based attributes for AI-assisted development readiness.

๐Ÿ“š Research-Based Assessment: AgentReady's attributes are derived from comprehensive research analyzing 50+ authoritative sources including Anthropic, Microsoft, Google, ArXiv, and IEEE/ACM. Each attribute is backed by peer-reviewed research and industry best practices. View full research report โ†’

Overview

AgentReady evaluates your repository across multiple dimensions of code quality, documentation, testing, and infrastructure to determine how well-suited it is for AI-assisted development workflows. The tool generates comprehensive reports with:

  • Overall Score & Certification: Platinum/Gold/Silver/Bronze based on comprehensive attribute assessment
  • Interactive HTML Reports: Filter, sort, and explore findings with embedded guidance
  • Version-Control-Friendly Markdown: Track progress over time with git-diffable reports
  • Actionable Remediation: Specific tools, commands, and examples to improve each attribute
  • Schema Versioning: Backwards-compatible report format with validation and migration tools

Quick Start

Container (Recommended)

# Login to GitHub Container Registry (required for private image)
podman login ghcr.io

# Pull container
podman pull ghcr.io/ambient-code/agentready:latest

# Create output directory
mkdir -p ~/agentready-reports

# Assess AgentReady itself
git clone https://github.com/ambient-code/agentready /tmp/agentready
podman run --rm \
  -v /tmp/agentready:/repo:ro \
  -v ~/agentready-reports:/reports \
  ghcr.io/ambient-code/agentready:latest \
  assess /repo --output-dir /reports

# Assess your repository
# For large repos, add -i flag to confirm the size warning
podman run --rm \
  -v /path/to/your/repo:/repo:ro \
  -v ~/agentready-reports:/reports \
  ghcr.io/ambient-code/agentready:latest \
  assess /repo --output-dir /reports

# Open reports
open ~/agentready-reports/report-latest.html

See full container documentation โ†’

Python Package

# Install
pip install agentready

# Assess AgentReady itself
git clone https://github.com/ambient-code/agentready /tmp/agentready
agentready assess /tmp/agentready

# Create virtual environment
python3 -m venv .venv
source .venv/bin/activate  # On Windows: .venv\Scripts\activate

# Install dependencies
pip install -e ".[dev]"

Run Directly via uv (Optional, No Install Required)

If you use uv, you can run AgentReady directly from GitHub without cloning or installing:

uvx --from git+https://github.com/ambient-code/agentready agentready -- assess .

To install it as a reusable global tool:

uv tool install --from git+https://github.com/ambient-code/agentready agentready

After installing globally:

agentready assess .

Harbor CLI (for Benchmarks)

Harbor is required for running Terminal-Bench evaluations:

# AgentReady will prompt to install automatically, or install manually:
uv tool install harbor

# Alternative: Use pip if uv is not available
pip install harbor

# Verify installation
harbor --version

Skip automatic checks: If you prefer to skip the automatic Harbor check (for advanced users):

agentready benchmark --skip-preflight --subset smoketest

Assessment Only

For one-time analysis without infrastructure changes:

# Assess current repository
agentready assess .

# Assess another repository
agentready assess /path/to/your/repo

# Specify custom configuration
agentready assess /path/to/repo --config my-config.yaml

# Custom output directory
agentready assess /path/to/repo --output-dir ./reports

Example Output

Assessing repository: myproject
Repository: /Users/username/myproject
Languages detected: Python (42 files), JavaScript (18 files)

Evaluating attributes...
[โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘โ–‘] 23/25 (2 skipped)

Overall Score: 72.5/100 (Silver)
Attributes Assessed: 23/25
Duration: 2m 7s

Reports generated:
  HTML: .agentready/report-latest.html
  Markdown: .agentready/report-latest.md

Features

Evidence-Based Attributes

Evaluated across 13 categories:

  1. Context Window Optimization: CLAUDE.md files, concise docs, file size limits
  2. Documentation Standards: README structure, inline docs, ADRs
  3. Code Quality: Cyclomatic complexity, file length, type annotations, code smells
  4. Repository Structure: Standard layouts, separation of concerns
  5. Testing & CI/CD: Coverage, test naming, pre-commit hooks
  6. Dependency Management: Lock files, freshness, security
  7. Git & Version Control: Conventional commits, gitignore, templates
  8. Build & Development: One-command setup, dev docs, containers
  9. Error Handling: Clear messages, structured logging
  10. API Documentation: OpenAPI/Swagger specs
  11. Modularity: DRY principle, naming conventions
  12. CI/CD Integration: Pipeline visibility, branch protection
  13. Security: Scanning automation, secrets management

Tier-Based Scoring

Attributes are weighted by importance:

  • Tier 1 (Essential): 55% of total score - Test execution, types, CLAUDE.md, CI gates, verification, README, layout, lock files, dependency security
  • Tier 2 (Critical): 27% of total score - Enforcement, commits, build setup, patterns
  • Tier 3 (Important): 14% of total score - Design intent, complexity, logging, API docs
  • Tier 4 (Advanced): 4% of total score - Code smells, templates, containers, progressive disclosure

Missing essential attributes (especially test execution at 10% weight) has 10x the impact of missing advanced features.

Interactive HTML Reports

  • Filter by status (Pass/Fail/Skipped)
  • Sort by score, tier, or category
  • Search attributes by name
  • Collapsible sections with detailed evidence
  • Color-coded score indicators
  • Certification ladder visualization
  • Works offline (no CDN dependencies)

Customization

Create .agentready-config.yaml to customize weights:

weights:
  claude_md_file: 0.15      # Increase importance (default: 0.07)
  test_execution: 0.15      # Increase importance (default: 0.10)
  conventional_commits: 0.01  # Decrease importance (default: 0.03)
  # Other attributes use defaults, rescaled to sum to 1.0

excluded_attributes:
  - container_setup         # Skip this attribute

output_dir: ./custom-reports

CLI Reference

# Assessment commands
agentready assess PATH                   # Assess repository at PATH
agentready assess PATH --verbose         # Show detailed progress
agentready assess PATH --config FILE     # Use custom configuration
agentready assess PATH --output-dir DIR  # Custom report location

# Configuration commands
agentready --validate-config FILE        # Validate configuration
agentready generate-config               # Create example config

# Research report management
agentready research-version              # Show bundled research version
agentready research validate FILE        # Validate research report
agentready research init                 # Generate new research report
agentready research add-attribute FILE   # Add attribute to report
agentready research bump-version FILE    # Update version
agentready research format FILE          # Format research report

# Utility commands
agentready --version                     # Show tool version
agentready --help                        # Show help message

Architecture

AgentReady follows a library-first design:

  • Models: Data entities (Repository, Assessment, Finding, Attribute)
  • Assessors: Independent evaluators for each attribute category
  • Services: Scanner (orchestration), Scorer (calculation), LanguageDetector
  • Reporters: HTML and Markdown report generators
  • CLI: Thin wrapper orchestrating assessment workflow

Development

Run Tests

# Run all tests with coverage
pytest

# Run specific test suite
pytest tests/unit/
pytest tests/integration/
pytest tests/contract/

# Run with verbose output
pytest -v -s

Code Quality

# Format code
black src/ tests/

# Sort imports
isort src/ tests/

# Lint code
flake8 src/ tests/ --ignore=E501

# Run all checks
black . && isort . && flake8 .

Project Structure

src/agentready/
โ”œโ”€โ”€ cli/              # Click-based CLI entry point
โ”œโ”€โ”€ assessors/        # Attribute evaluators (13 categories)
โ”œโ”€โ”€ models/           # Data entities
โ”œโ”€โ”€ services/         # Core logic (Scanner, Scorer)
โ”œโ”€โ”€ reporters/        # HTML and Markdown generators
โ”œโ”€โ”€ templates/        # Jinja2 HTML template
โ””โ”€โ”€ data/             # Bundled research report and defaults

tests/
โ”œโ”€โ”€ unit/             # Unit tests for individual components
โ”œโ”€โ”€ integration/      # End-to-end workflow tests
โ”œโ”€โ”€ contract/         # Schema validation tests
โ””โ”€โ”€ fixtures/         # Test repositories

Research Foundation

All attributes are derived from evidence-based research with 50+ citations from:

  • Anthropic (Claude Code documentation, engineering blog)
  • Microsoft (Code metrics, Azure DevOps best practices)
  • Google (SRE handbook, style guides)
  • ArXiv (Software engineering research papers)
  • IEEE/ACM (Academic publications on code quality)

See src/agentready/data/RESEARCH_REPORT.md for complete research report.

License

MIT License - see LICENSE file for details.

Contributing

Contributions welcome! Please ensure:

  • All tests pass (pytest)
  • Code is formatted (black, isort)
  • Linting passes (flake8)
  • Test coverage >80%

Support

  • Documentation: See /docs directory
  • Issues: Report at GitHub Issues
  • Questions: Open a discussion on GitHub

Quick Start: pip install -e ".[dev]" && agentready assess . - Ready in <5 minutes!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentready-2.33.0.tar.gz (345.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentready-2.33.0-py3-none-any.whl (405.8 kB view details)

Uploaded Python 3

File details

Details for the file agentready-2.33.0.tar.gz.

File metadata

  • Download URL: agentready-2.33.0.tar.gz
  • Upload date:
  • Size: 345.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for agentready-2.33.0.tar.gz
Algorithm Hash digest
SHA256 1914ce44da821b2e7fdec3069f09e921bd5d6d4c3f659b382a63a0f2b90eeb79
MD5 57db3610866db3cfda781a30d4bf7dab
BLAKE2b-256 473aff755f38503ed3eea93a44e0d2e784900ea555fa4ca69e46192f967e98be

See more details on using hashes here.

Provenance

The following attestation bundles were made for agentready-2.33.0.tar.gz:

Publisher: release.yml on ambient-code/agentready

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file agentready-2.33.0-py3-none-any.whl.

File metadata

  • Download URL: agentready-2.33.0-py3-none-any.whl
  • Upload date:
  • Size: 405.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for agentready-2.33.0-py3-none-any.whl
Algorithm Hash digest
SHA256 aeedcb48857fe10d6473733775e8de6b3abcb0e4dfd891f5c9986b7895477b4f
MD5 794efa6c6dd01815e2fa8c4bfba57de7
BLAKE2b-256 c98da491d1fed600efabdb2d96731fac3018b716bb3e9e8b54e030fba0c671bd

See more details on using hashes here.

Provenance

The following attestation bundles were made for agentready-2.33.0-py3-none-any.whl:

Publisher: release.yml on ambient-code/agentready

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page