Skip to main content

CVE-style advisory database and static scanner for AI agent security risks

Project description

AgentFort

Static security scanner for AI agent codebases. Analyzes repositories and MCP config files against a CVE-style advisory database — no live agent interaction required.

What it does

  • Scans Python repos for dangerous patterns: eval(), exec(), shell=True, hardcoded API keys
  • Parses MCP config files (claude_desktop_config.json, .mcp.json) for shell execution tools, overly broad filesystem access, and unverified npx/uvx packages
  • Detects agent framework imports (LangChain, CrewAI, AutoGen, OpenAI, Anthropic, etc.) and cross-references against known vulnerabilities
  • Queries OSV.dev live for real CVEs against every detected package — findings stay current without any database updates
  • Produces risk scores, terminal reports, Markdown, and JSON output
  • Exits with code 1 on critical findings — CI pipeline friendly

Install

# From repo root (inside a virtualenv)
pip install agentfort

# Or dev install from repo root
pip install -e .

Usage

# Scan a repo
agentfort scan --repo /path/to/your/agent-project

# Scan just an MCP config file
agentfort scan --mcp-config ~/.config/claude/claude_desktop_config.json

# JSON output (clean stdout, progress on stderr)
agentfort scan --repo . --format json

# Markdown report to file
agentfort scan --repo . --format md --output report.md

# Only show high and above
agentfort scan --repo . --min-severity high

# Disable CI exit code
agentfort scan --repo . --no-fail-on-critical

# Skip OSV live lookup (air-gapped / CI without outbound)
agentfort scan --repo . --offline

# Browse advisories
agentfort advisories list
agentfort advisories list --severity critical
agentfort advisories show AGSA-001

GitHub Actions

Add AgentFort to any CI pipeline with one step. The action installs agentfort from PyPI and runs a full scan — failing the build on critical findings by default.

- name: AgentFort Security Scan
  uses: NeuronKnight/agentfort-action@v1
  with:
    repo-path: '.'           # directory to scan (default: .)
    min-severity: 'low'      # critical | high | medium | low (default: low)
    fail-on-critical: 'true' # fail build on critical findings (default: true)
    offline: 'false'         # skip OSV.dev live CVE lookup (default: false)

Full workflow example:

name: Security Scan

on: [push, pull_request]

jobs:
  scan:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: NeuronKnight/agentfort-action@v1
        with:
          min-severity: high
          fail-on-critical: 'true'

Note: NeuronKnight/agentfort-action is the planned standalone Action repo. Until it's published, use the local action from this repo: uses: ./.github/actions/agentfort.

Live CVE lookup (OSV.dev)

Every scan queries OSV.dev in parallel for known CVEs against every package detected in the repo. No database to update — findings reflect OSV's current state on each run.

  • Results are capped at 5 CVEs per package (highest severity first) to avoid noise from very old pinned versions
  • Uses GHSA severity labels (database_specific.severity) for accurate critical/high/medium/low mapping
  • Falls back silently if the network is unreachable — use --offline to skip the lookup entirely
# Scan with live CVEs (default)
agentfort scan --repo .

# Air-gapped / no outbound network
agentfort scan --repo . --offline

Ignoring paths

Create .agentfortignore in your repo root to exclude directories or files from scanning. Uses gitignore-style glob patterns:

# .agentfortignore

# Ignore generated code
generated/

# Ignore vendor directory
vendor/

# Ignore specific file pattern
*.pb.py

The scanner skips any file whose path matches a pattern. Useful for:

  • Vendored code you don't control
  • Test fixtures that intentionally contain vulnerable patterns
  • Generated files with no manual security surface

Advisory database

14 static advisories covering structural/behavioral risks from the OWASP Agentic Top 10. Package CVEs are handled live by OSV.dev (see above).

ID Severity Risk
AGSA-001 Critical LangChain ShellTool unrestricted shell execution
AGSA-002 Critical MCP server exposes shell execution tool
AGSA-003 Critical eval()/exec() in agent tool handler
AGSA-005 Critical AutoGen/CrewAI code execution without confirmation
AGSA-004 High Hardcoded API key or secret in MCP config
AGSA-006 High MCP filesystem server with overly broad path (/, ~)
AGSA-007 High subprocess with shell=True or os.system()
AGSA-008 High Agent tool writes to arbitrary file paths
AGSA-010 High Prompt injection via unvalidated tool output
AGSA-013 High OpenAI Assistants file_search/code_interpreter without scope restriction
AGSA-009 Medium MCP server loaded via unverified npx/uvx package
AGSA-012 Medium Secrets exposed via os.environ in tool scope
AGSA-014 Medium Non-PyPI/non-npm dependency as framework component
AGSA-015 Medium System prompt in user-accessible config location

Risk score

0–100. Each finding adds: critical=40, high=15, medium=5, low=1. Capped at 100.

Output formats

Terminal (default) — Rich panels with color-coded severity table and detail panels for critical/high findings.

JSON — Machine-readable. Progress messages go to stderr so stdout is clean for piping:

agentfort scan --repo . --format json 2>/dev/null | jq '.findings[] | select(.severity=="critical")'

Markdown — Full report with summary table and per-finding sections, suitable for GitHub issues or PR comments.

Project structure

agentfort/                  # project root
├── agentfort/              # Python package
│   ├── cli.py              # Click CLI entry point
│   ├── models.py           # Finding, ScanResult dataclasses
│   ├── db/
│   │   ├── advisory.py     # Advisory loader and index
│   │   └── data/           # AGSA-001.yaml … AGSA-015.yaml
│   ├── scanner/
│   │   ├── frameworks.py   # requirements.txt / pyproject.toml / package.json
│   │   ├── mcp.py          # MCP config file scanner
│   │   ├── osv.py          # Live CVE lookup via OSV.dev API
│   │   ├── patterns.py     # Python source pattern scanner
│   │   └── secrets.py      # Hardcoded credential scanner
│   └── report/
│       └── formatter.py    # Terminal, Markdown, JSON renderers
└── pyproject.toml

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agentfort-0.1.4.tar.gz (29.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agentfort-0.1.4-py3-none-any.whl (34.8 kB view details)

Uploaded Python 3

File details

Details for the file agentfort-0.1.4.tar.gz.

File metadata

  • Download URL: agentfort-0.1.4.tar.gz
  • Upload date:
  • Size: 29.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for agentfort-0.1.4.tar.gz
Algorithm Hash digest
SHA256 1b4b86de8809f5aa6f3f026bbe4236831057e56e596458dd6e170e7517e301b1
MD5 5ceaefb68ddd5fefbb936e959387e300
BLAKE2b-256 21bb7e003aeb2a71cfe86906058656747b0cbc50e5e3e48f0305caabaad87502

See more details on using hashes here.

File details

Details for the file agentfort-0.1.4-py3-none-any.whl.

File metadata

  • Download URL: agentfort-0.1.4-py3-none-any.whl
  • Upload date:
  • Size: 34.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for agentfort-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 ebe398cc3a15607dee496d1bf5587a88bf918f6e376eba21a8706c6f69bf953e
MD5 93e91965daf0ce72ffcd88cdabd8b7ba
BLAKE2b-256 2c82351c7f34186502bdf71f02acb45d5d41771bd2a556167d18637b8cc1353e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page