Skip to main content

VIPI — Visual Prompt Injection Scanner for Images

Animated VIPI logo reveal

Scan images for prompt injections before an AI agent reads them.
A Python CLI and GitHub Action. Runs fully local or with hosted providers.

Python 3.12 PyPI version OS Support: macOS | Linux | Windows

Images can carry instructions that people overlook but AI models read. VIPI finds the text in an image, including text that standard OCR misses, and checks it for prompt injections. It scans single images, folders and committed image changes.

  • CI/CD and AI code review: scan pull-request images before AI triage tools or coding assistants read them.
  • Image ingestion: scan uploaded or collected images before they enter an AI pipeline.
  • Agents with image input: check screenshots before an agent decides or acts on them.

VIPI scans an image before it reaches an AI agent. Clean images continue to the agent; for images with findings, your workflow reports, blocks or allows them.

Quick start

Requires Python 3.12 and uv.

Local: images never leave your machine.

uv tool install --python 3.12 'vipi-scanner[ocr,detector-local]'
vipi setup --ocr-mode balanced
vipi scan image.png --ocr-mode balanced --output report.json

Cloud: hosted OCR and decisions. Set GOOGLE_CLOUD_API_KEY and OPENAI_API_KEY in the environment or an ignored .env (example).

uv tool install --python 3.12 'vipi-scanner[ocr]'
vipi setup --modus cloud
vipi scan image.png --modus cloud --output report.json

Run setup with the same options you scan with. A bare vipi setup also downloads the large quality model. If vipi is not on PATH, run uv tool update-shell and restart the terminal.

Models at a glance

Every scan runs up to three steps; step 2 runs only when the OCR result is uncertain. The mode decides who provides the models.

Step Local quality (default) Local balanced Local speed Cloud
1 · Read text PaddlePaddle PP-OCRv6 Medium
or Small · Tiny
PaddlePaddle PP-OCRv6 Small
or Medium · Tiny
PaddlePaddle PP-OCRv6 Tiny
or Medium · Small
Google Cloud Vision
or OpenAI · Mistral
2 · Verify OCR visually Cloudflare Clef 27B
or Liquid AI d1 3B
Liquid AI d1 3B
or Cloudflare Clef 27B
Liquid AI d1 3B
or Cloudflare Clef 27B
OpenAI Decisions API
or TypeSafe Jev
3 · Detect injections Cloudflare Clef 27B
or Liquid AI d1 3B · Meta Prompt Guard 2
Liquid AI d1 3B
or Cloudflare Clef 27B · Meta Prompt Guard 2
Liquid AI d1 3B
or Cloudflare Clef 27B · Meta Prompt Guard 2
OpenAI Decisions API
or TypeSafe Jev
Memory ¹ ~128 GB RAM ~24 GB RAM ~24 GB RAM ~8 GB RAM

¹ Untested planning estimates for CPU-only use with the defaults. GPU alternatives, disk space, model IDs and pinned revisions are in Models and hardware.

Usage

vipi scan label.png screenshot.jpg
vipi scan ./images --verbose --output report.json
vipi scan ./images --exclude 'generated/' --exclude '*.webp'
vipi scan . --diff origin/main --output report.json
vipi scan image.png --modus cloud --detector openai --threshold 90
Format Extensions Notes
PNG .png Static images only; animated PNGs are rejected
JPEG .jpg, .jpeg EXIF orientation is applied
WebP .webp Static images only; animated WebPs are rejected

Extensions are matched case-insensitively. Local inputs are limited to 40 megapixels; hosted inputs follow provider limits. Other file types in scanned folders or diffs are skipped and listed in the report.

A score at or above the threshold (default 80/100) is a finding. Scores are not calibrated probabilities, and a score below the threshold does not prove an image is safe. Cloud scans can make additional billable requests.

Exit code Result
0 Scan complete, no findings
1 Injection found, every image completed
2 Error or incomplete scan; wins over findings

Every option, credential and report field is in the CLI reference.

GitHub Actions

Scan the images a pull request adds or changes. This example uses the local balanced profile with Meta Prompt Guard as the injection detector:

name: VIPI image scan
on:
  pull_request:
    branches: [main]
permissions:
  contents: read
jobs:
  scan:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
        with:
          fetch-depth: 0
      - uses: EnXan/VIPI@v0.6.0
        with:
          modus: local
          ocr-mode: balanced
          detector: prompt-guard
        env:
          HF_TOKEN: ${{ secrets.HF_TOKEN }}
      - uses: actions/upload-artifact@043fb46d1a93c77aae656e7c1c64a875d1fc6a0a # v7.0.1
        if: always()
        with:
          name: vipi-report
          path: vipi-report.json

The runner needs enough memory for the chosen models, and Prompt Guard requires accepted model terms on Hugging Face. Fork PRs normally get no secrets. For hosted models, set modus: cloud and the provider keys; see Action inputs.

Documentation

License

VIPI's code, documentation and assets use the Apache License 2.0. Models, dependencies, datasets and provider marks keep their own terms.

Metadata

Release files for vipi-scanner 0.6.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vipi-scanner 0.6.0
File Size Uploaded Provenance Actions
vipi_scanner-0.6.0.tar.gz 207.4 kB Without provenance Details for vipi_scanner-0.6.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for vipi-scanner 0.6.0
File Interpreter ABI Platform Actions
vipi_scanner-0.6.0-py3-none-any.whl Python 3 none any Details for vipi_scanner-0.6.0-py3-none-any.whl

Total release size: 325.7 kB

Release files / vipi_scanner-0.6.0.tar.gz

Download URL vipi_scanner-0.6.0.tar.gz
Size 207.4 kB
Tags Source
SHA-256 checksum
How to use checksums
a9a0ea26cb5274a61f1861cee583c1d7a627be861bc8a343af0cef23f667294c
BLAKE2b-256 checksum
How to use checksums
df7c89c2c886b63e71cb9e8b95bc1b1d049a682e8443e56019532ad4b7ad5969
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.13.5 {"installer":{"name":"uv","version":"0.13.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / vipi_scanner-0.6.0-py3-none-any.whl

Download URL vipi_scanner-0.6.0-py3-none-any.whl
Size 118.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
64a44cb816ab14d44bf92bdb96a4d249447e5f19424548fbdf3c584e88a4c8ed
BLAKE2b-256 checksum
How to use checksums
5c2e73f5162fd4bd7559773a2cae4dc44a03d1f3386924234f1f799f6af22284
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.13.5 {"installer":{"name":"uv","version":"0.13.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Security for vipi-scanner 0.6.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page