Skip to main content

AI Code Quality Guard — detect common failure patterns in AI-generated code

Project description

AIGuard

AI Code Quality Guard - catch the bugs AI leaves behind.

CI PyPI Python License: MIT Release

AI-generated code is "almost right" - it compiles, passes linting, follows conventions... but has subtle bugs that are harder to find than writing it yourself. 66% of developers say this is their #1 frustration with AI coding tools.

AIGuard is a static analysis tool that catches the specific patterns where AI-generated code goes wrong: shallow error handling, hallucinated imports, copy-paste duplication, missing validation, placeholder code disguised as complete - and now malicious content hidden in AI agent prompts and skill files.

AIGuard demo

$ aiguard scan ./src

src/api/handlers.py
  E       12  Bare 'except:' catches all exceptions including KeyboardInterrupt  AIG001
  W       34  Functions 'get_users' and 'get_admins' are 92% similar             AIG005
  W       67  Public function 'process' has 4 params but no input validation     AIG006

src/utils/helpers.py
  I       5   Variable 'data' is too generic - use a descriptive name            AIG010
  W       22  Function 'transform' has only 'pass' - placeholder code            AIG007

  ┌─────────────────── AI Code Health Score ───────────────────┐
  │  ████████████████████████████░░░░░░░░░░░░  72/100  ~       │
  └────────────────────────────────────────────────────────────┘

Prompt Security Scanner (NEW)

People blindly trust AI agent prompts, skills, and .md config files - but they can contain hidden malicious instructions. AIGuard now scans markdown files for threats that are invisible to human reviewers.

AIGuard Prompt Security Scanner demo

# Scan a prompt/skill file for hidden threats
aiguard scan agent-instructions.md

# Scan all markdown files in a directory
aiguard scan ./prompts/

What it catches:

  • Prompt injection - "ignore previous instructions", role hijacking, stealth commands
  • Hidden content - zero-width Unicode characters, invisible HTML (display:none), base64-encoded payloads
  • Data exfiltration - curl sending secrets, reading .ssh/.env/credentials, leaking $API_KEY
  • Dangerous commands - rm -rf, curl | bash, reverse shells, chmod 777, untrusted package installs

Installation / Package Name

  • PyPI package: ai-guard-cli
  • CLI command: aiguard

Quick Start

pip install ai-guard-cli
# Scan a directory
aiguard scan ./src

# Scan a single file
aiguard scan app.py

# Only scan changed lines (vs last commit)
aiguard scan --diff HEAD

# Only scan changed lines (vs main branch)
aiguard scan --diff main

# Only scan staged files (for pre-commit hooks)
aiguard scan --staged

# JSON output for CI pipelines
aiguard scan ./src --format json

# SARIF for GitHub Code Scanning
aiguard scan ./src --format sarif --output results.sarif

# Fail CI if score is below 70
aiguard scan ./src --fail-under 70

Detection Rules

Python Code Quality (AIG001-AIG010)

Rule Name What It Catches Severity
AIG001 shallow-error-handling Bare except:, catching Exception, empty handlers Error
AIG002 tautological-code if True, unreachable code after return, x == x Warning
AIG003 over-commenting # Initialize the variable for x = 0 (AI loves this) Info
AIG004 hallucinated-imports Imports that don't exist in your environment Error
AIG005 copy-paste-duplication Near-identical functions with minor variations Warning
AIG006 missing-input-validation Public functions with params but no guards Warning
AIG007 placeholder-code pass/.../NotImplementedError disguised as done Warning
AIG008 complex-one-liners Nested comprehensions, chained ternaries Warning
AIG009 unused-variables Assigned but never referenced Info
AIG010 generic-naming data, result, temp, val - meaningless names Info

Prompt Security (AIG011-AIG014)

Rule Name What It Catches Severity
AIG011 prompt-injection "Ignore previous instructions", role hijacking, stealth commands Error
AIG012 hidden-content Zero-width Unicode chars, invisible HTML, base64 payloads, suspicious comments Error
AIG013 data-exfiltration curl/wget leaking secrets, reading .ssh/.env/credentials Error
AIG014 dangerous-commands rm -rf, curl | bash, reverse shells, chmod 777, untrusted installs Error

List all rules:

aiguard list-rules

Configuration

Generate a config file:

aiguard init

This creates .aiguard.yml:

rules:
  AIG001:
    enabled: true
    severity: error
  AIG003:
    enabled: true
    max_comment_ratio: 0.6
  AIG005:
    enabled: true
    similarity_threshold: 0.85

ignore:
  - "tests/**"
  - "migrations/**"

score:
  fail_threshold: 60
  weights:
    error: 10
    warning: 3
    info: 1

Pre-commit Hook

Add AIGuard to your pre-commit config so it runs on every commit:

# .pre-commit-config.yaml
repos:
  - repo: https://github.com/GurjotSinghAulakh/aiguard
    rev: v0.4.0
    hooks:
      - id: aiguard                  # Python code quality
        args: ["--fail-under", "60"]
      - id: aiguard-prompt-scan      # Prompt/markdown security
        args: ["--fail-under", "80"]

Then install:

pip install pre-commit
pre-commit install

Now AIGuard runs automatically on every git commit - scanning Python code for quality issues and markdown files for hidden threats.

Diff Mode (Only Scan New Code)

The killer feature for existing projects - only flag issues in new or changed code, not the entire codebase:

# Issues introduced since last commit
aiguard scan --diff HEAD

# Issues introduced vs main branch (perfect for PR checks)
aiguard scan --diff main

# Issues in staged files only (same as pre-commit)
aiguard scan --staged

This means you can adopt AIGuard on any codebase without drowning in existing issues.

GitHub Actions

Add to your workflow:

# .github/workflows/aiguard.yml
name: AI Code Quality
on: [push, pull_request]

jobs:
  aiguard:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: GurjotSinghAulakh/aiguard@v1
        with:
          path: './src'
          fail-under: '70'

Findings appear as inline annotations on your PRs via GitHub Code Scanning (SARIF).

Output Formats

Format Use Case Flag
terminal Local development (default) --format terminal
json CI pipelines, custom tooling --format json
sarif GitHub Code Scanning --format sarif

Writing Custom Rules (Plugins)

Create a detector in your own package:

from aiguard.detectors import register
from aiguard.detectors.base import BaseDetector
from aiguard.models import Finding, Language, Severity

@register
class MyCustomDetector(BaseDetector):
    rule_id = "CUSTOM001"
    rule_name = "my-custom-rule"
    description = "Detects my specific pattern"
    severity = Severity.WARNING
    languages = (Language.PYTHON,)

    def detect(self, source, ast_tree, file_path):
        findings = []
        # Your detection logic using ast_tree
        return findings

Register via entry points in your pyproject.toml:

[project.entry-points."aiguard.detectors"]
my_rule = "my_package:MyCustomDetector"

Why AIGuard?

Traditional linters (pylint, ruff, eslint) catch syntax-level issues. AI-generated code passes all of those. The bugs are at a higher level:

  • The error handling exists but is shallow (catches everything, does nothing)
  • The code works but is copy-pasted 5 times with minor changes
  • The function has parameters but never validates them
  • The import looks right but the package doesn't exist
  • The code looks complete but it's just pass with a docstring

AIGuard catches these patterns because they are specific to how AI generates code.

Contributing

We welcome contributions! See CONTRIBUTING.md for details.

Good first issues are labeled good first issue.

License

MIT License. See LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ai_guard_cli-0.4.0.tar.gz (1.3 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ai_guard_cli-0.4.0-py3-none-any.whl (54.7 kB view details)

Uploaded Python 3

File details

Details for the file ai_guard_cli-0.4.0.tar.gz.

File metadata

  • Download URL: ai_guard_cli-0.4.0.tar.gz
  • Upload date:
  • Size: 1.3 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for ai_guard_cli-0.4.0.tar.gz
Algorithm Hash digest
SHA256 f6dceb60aadb821f5aefa17fe62df233ae23a3de7d8d19350767e8878db966fd
MD5 a6c76f30230a45074055280288ef0cfd
BLAKE2b-256 2ba320684910ae006e0fd22a870ad44a809228a62fe07d8833528457c481fb60

See more details on using hashes here.

Provenance

The following attestation bundles were made for ai_guard_cli-0.4.0.tar.gz:

Publisher: release.yml on GurjotSinghAulakh/aiguard

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ai_guard_cli-0.4.0-py3-none-any.whl.

File metadata

  • Download URL: ai_guard_cli-0.4.0-py3-none-any.whl
  • Upload date:
  • Size: 54.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for ai_guard_cli-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 c785b7a9b5309ff3fa2c94de8df1775563b4681389ac34acee02b4cbcfffccfb
MD5 1bebfe17abf09fee8b03035b084f57e9
BLAKE2b-256 e47350b7fb0c88843327936b1b4c7eea5bd31b767e4c3174e83b7a72668c563c

See more details on using hashes here.

Provenance

The following attestation bundles were made for ai_guard_cli-0.4.0-py3-none-any.whl:

Publisher: release.yml on GurjotSinghAulakh/aiguard

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page