Skip to main content

AI Impact Assessment for Code Changes

Project description

CheckodAI

AI Impact Assessment for code changes - understand what Copilot changed before you commit it.

Overview

CheckodAI is a Python CLI tool that helps developers understand the scope and implications of their code changes by analyzing git diffs and extracting modified symbols (functions, classes, variables). It can optionally use a local LLM (Ollama) to assess the risk of each change.

Privacy

CheckodAI runs entirely locally.

  • No code is uploaded
  • No cloud calls required
  • No telemetry
  • Works offline with local LLM (Ollama)

All analysis happens on your machine.

Key Features:

  • 🚀 Local-first: Runs entirely on your machine - no cloud calls
  • 🔍 Symbol-level analysis: Detects changed functions, classes, and variables
  • 🏷️ Change type detection: Identifies what type of change (added, removed, modified, signature changed)
  • 💡 Impact summaries: Human-readable recommendations for each changed symbol
  • 🤖 AI-powered risk assessment: Uses local Ollama for intelligent impact analysis
  • 🛡️ Commit guard: Advisory warnings for HIGH risk changes (non-blocking)
  • 🎯 CLI-first interface: Simple checkod assess command
  • 📊 Summary reports: Clear output of what changed and risk levels
  • ⚡ Graceful fallback: Works without Ollama using heuristic analysis

Installation

Prerequisites

  • Python 3.8+
  • Git
  • Ollama (optional, for AI risk assessment)

Quick Start

Install from PyPI:

pip install checkod-ai

Run assessment on your repository:

checkod assess

Optional: Install Ollama for AI Risk Assessment

Ollama enables intelligent risk scoring. Install and configure:

# macOS / Linux
curl -fsSL https://ollama.ai/install.sh | sh

# Or use Homebrew (macOS)
brew install ollama

# Pull the model
ollama pull llama3

# Start the server (runs on localhost:11434)
ollama serve

Usage

Basic Commands

Analyze changes in the current repository:

checkod assess

Analyze a specific repository:

checkod assess --repo /path/to/repo

Skip AI risk assessment:

checkod assess --no-risk

Example Output

🔍 Starting Impact Assessment...

📊 Changed Symbols (3 detected):
  • calculateDiscount
  • OrderStatus
  • userTier

📈 Change Summary:
  Functions: 1 function added
  Classes: 1 class added
  Variables: 1 variable added

================================================================================
📋 Impact Summary
================================================================================
You changed: calculateDiscount()
Change Type: function added
Risk Level: MEDIUM

This may affect:
  • checkout_service (logic flow)
  • /api/orders (user-facing behavior)
  • test_checkout (test coverage)

Recommended Actions:
  • Write unit tests for calculateDiscount
  • Test integration with checkout service
  • Document function parameters and return type

With Ollama running, you'll also get AI-powered risk assessment:

================================================================================
🤖 AI Risk Assessment (powered by local Ollama)
================================================================================
Symbol: calculateDiscount
────────────────────────────────
Risk Classification: MEDIUM

Reason: Used in multiple modules; requires testing and code review.

Validation Steps:
• Test discount calculation across pricing tiers
• Verify integration with checkout service
• Add regression tests if coverage is low

How It Works

  1. Reads git diff - Gets all staged and unstaged changes
  2. Extracts symbols - Finds functions, classes, and variables
  3. Detects change type - Identifies what kind of change was made
  4. Assesses risk - Uses local AI (Ollama) or heuristics
  5. Generates recommendations - Suggests testing and review actions
  6. Advisory warnings - HIGH risk changes trigger warnings

Documentation

  • DOCS.md - Complete documentation including architecture, development, and detailed guides
  • CONTRIBUTING.md - How to contribute
  • LICENSE - MIT License

Development

For development setup and contributing:

# Clone repository
git clone <repository-url>
cd checkod

# Create virtual environment
python3 -m venv venv
source venv/bin/activate

# Install in development mode
pip install -e .

# Run tests
pytest

# Code quality
black .
flake8 .
mypy checkod

See DOCS.md for architecture and detailed development information.

License

MIT License - See LICENSE file for details

Author

Anup Moncy - n93181165@gmail.com

  • Integration with CI/CD
  • Web-based dashboard

Note: This is an early-stage project. The API and behavior are subject to change.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

checkod_ai-0.1.1.tar.gz (20.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

checkod_ai-0.1.1-py3-none-any.whl (21.4 kB view details)

Uploaded Python 3

File details

Details for the file checkod_ai-0.1.1.tar.gz.

File metadata

  • Download URL: checkod_ai-0.1.1.tar.gz
  • Upload date:
  • Size: 20.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.6

File hashes

Hashes for checkod_ai-0.1.1.tar.gz
Algorithm Hash digest
SHA256 98fa9e27a6e956dfd88c0a7f62ab268984b8127197361190e9c50c20984e87ad
MD5 316d28e7eafa2a6dd5370d8f748ab8b7
BLAKE2b-256 27372a9793976cca63883981de2c346d9506a6b5f572287304425d925423bc8e

See more details on using hashes here.

File details

Details for the file checkod_ai-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: checkod_ai-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 21.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.6

File hashes

Hashes for checkod_ai-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 87f3f7419ec5a31571a2fe2baf504ed76a89100555f82b3339776343d45d86da
MD5 becb36dd436a2141c0e95891bc6a0681
BLAKE2b-256 77b69dda97dc9e26c00e0beb60167eddd1809807a0df029321eea12e8fb03da7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page