Skip to main content

AI eyes that roll through video footage — watch, understand, turn into code actions.

Project description

eyeroll

CI PyPI Python License: MIT

AI eyes that roll through video footage — watch, understand, act.

eyeroll is a Claude Code plugin that analyzes screen recordings, Loom videos, YouTube links, and screenshots, then helps coding agents fix bugs, build features, and create skills.

Install

# Add the plugin to Claude Code
/plugin marketplace add mnvsk97/eyeroll
/plugin install eyeroll@mnvsk97-eyeroll

# Install the CLI
pip install eyeroll[gemini]      # Gemini Flash API (recommended)
pip install eyeroll[openai]      # OpenAI GPT-4o + OpenRouter/Groq/Grok/Cerebras
pip install eyeroll              # Ollama only (local, no API key) — requires Pillow
pip install eyeroll[all]         # everything

Setup

/eyeroll:init

Picks your backend, configures API key, and generates codebase context — all in one step.

Commands

Command What it does
/eyeroll:init Set up eyeroll — pick backend, configure API key, generate .eyeroll/context.md
/eyeroll:watch <url> Analyze a video and present a structured summary
/eyeroll:fix <url> Watch a bug video → diagnose → fix the code → raise a PR
/eyeroll:history List past video analyses

Usage

In Claude Code

You: /eyeroll:watch https://loom.com/share/abc123
     → Analyzes video, presents: what's shown, the bug, key evidence, suggested fix

You: /eyeroll:fix https://loom.com/share/abc123
     → Watches video, greps codebase, finds the bug, fixes it, raises a PR

You: watch this tutorial and create a skill from it: ./demo.mp4
     → video-to-skill activates, watches video, generates SKILL.md

You: /eyeroll:history
     → Lists past analyses with timestamps and sources

Standalone CLI

eyeroll watch https://loom.com/share/abc123
eyeroll watch ./bug.mp4 --context "checkout broken after PR #432"
eyeroll watch ./bug.mp4 -cc .eyeroll/context.md --parallel 4
eyeroll watch ./bug.mp4 --backend ollama -m qwen3-vl:2b
eyeroll watch ./bug.mp4 --backend groq
eyeroll watch ./bug.mp4 --backend openrouter -m anthropic/claude-3.5-sonnet
eyeroll watch ./bug.mp4 --backend openai-compat --base-url https://my-server/v1
eyeroll watch ./bug.mp4 --no-context               # skip auto-discovery of codebase context
eyeroll watch ./bug.mp4 --no-cost                   # suppress cost estimate
eyeroll watch ./bug.mp4 --scene-threshold 50        # tune scene-change sensitivity
eyeroll watch ./bug.mp4 --min-audio-confidence 0.6  # stricter audio filtering
eyeroll history

How it works

/eyeroll:watch https://loom.com/share/abc123
    ↓
1. Preflight check (verify backend is reachable, detect capabilities)
    ↓
2. Download video (yt-dlp)
    ↓
3. Choose strategy:
   - Gemini API key: direct upload via File API (up to 2GB)
   - Gemini service account: direct upload (up to 20MB)
   - OpenAI / OpenRouter / Groq: multi-frame batch (all frames in one call)
   - Ollama: frame-by-frame (one frame per call)
    ↓
4. Transcribe audio if present
    ↓
5. Cache intermediates (reuse on next run)
    ↓
6. Synthesize report with codebase context:
   - Metadata: intent, category, confidence, scope, repo guess, handoff recommendation
   - Bug, feature, question, docs, tutorial, review, or notes sections as appropriate
   - Agent handoff only when a code/docs/test/config change is actually useful
   - Search patterns and verification steps for coding agents when relevant
    ↓
7. Present summary to user
    ↓
/eyeroll:fix goes further:
   → grep codebase → read files → implement fix → run tests → PR

Backends

Backend Strategy Audio API Key Cost Best for
gemini Direct upload (up to 2GB) Yes GEMINI_API_KEY ~$0.15 Best quality (gemini-2.5-flash)
openai Multi-frame batch Whisper OPENAI_API_KEY ~$0.20 Existing OpenAI users
ollama Frame-by-frame No None Free Privacy, offline
openrouter Multi-frame batch No OPENROUTER_API_KEY varies Model variety
groq Multi-frame batch No GROQ_API_KEY cheap Low latency
grok Multi-frame batch No GROK_API_KEY varies xAI models
cerebras Multi-frame batch No CEREBRAS_API_KEY cheap Fast inference
openai-compat Multi-frame batch No any env var varies Custom/self-hosted endpoints

Ollama runs locally. Install and start Ollama separately, then eyeroll can pull the selected model on first use.

Codebase context

eyeroll automatically discovers codebase context from files like CLAUDE.md, AGENTS.md, CURSOR.md, and .eyeroll/context.md (disable with --no-context). You can also run /eyeroll:init to generate .eyeroll/context.md manually.

Without context, all file paths in the report are labeled as hypotheses.

Caching

eyeroll caches frame analyses and transcripts in ~/.eyeroll/cache/ (global). Same video = no re-analysis. Different --context re-runs only the cheap synthesis step. Legacy local .eyeroll/cache/ is still checked for backward compatibility.

eyeroll watch video.mp4                    # full analysis (~15s)
eyeroll watch video.mp4 -c "new context"   # instant — cached frames
eyeroll watch video.mp4 --no-cache         # force fresh

Cost estimates

eyeroll prints a cost estimate to stderr after each analysis. Disable with --no-cost. Ollama runs are always free.

Plugin structure

eyeroll/
  commands/              ← slash commands
    init.md              ← /eyeroll:init
    watch.md             ← /eyeroll:watch
    fix.md               ← /eyeroll:fix
    history.md           ← /eyeroll:history
  skills/                ← background skills
    video-to-skill/      ← activated by "create a skill from this video"
  eyeroll/               ← Python CLI package
    cli.py, watch.py, analyze.py, extract.py, backend.py, context.py, cost.py, history.py
  tests/                 ← unit, pipeline, server, MCP, and integration tests

Supported inputs

Input Formats
Video .mp4, .webm, .mov, .avi, .mkv, .flv, .ts, .m4v, .wmv, .3gp, .mpg, .mpeg
Image .png, .jpg, .jpeg, .gif, .webp, .bmp, .tiff, .heic, .avif
URL YouTube, Loom, Vimeo, Twitter/X, Reddit, 1000+ sites via yt-dlp

Development

git clone https://github.com/mnvsk97/eyeroll.git
cd eyeroll
pip install -e '.[dev,all,server]'
pytest                                                    # unit tests
pytest tests/test_integration.py -v -m integration        # real API tests

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

eyeroll-0.6.0.tar.gz (5.0 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

eyeroll-0.6.0-py3-none-any.whl (45.7 kB view details)

Uploaded Python 3

File details

Details for the file eyeroll-0.6.0.tar.gz.

File metadata

  • Download URL: eyeroll-0.6.0.tar.gz
  • Upload date:
  • Size: 5.0 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for eyeroll-0.6.0.tar.gz
Algorithm Hash digest
SHA256 6fff1c28d7b4ad202d711e9ae030eaf3284c6d6d4be6364fd9b75da389793b6e
MD5 1d314f838451fb602b91fb424e06c089
BLAKE2b-256 50b3f80fd26671ca436ca3b48479204592cc9140a571331592ab62baabd62f58

See more details on using hashes here.

Provenance

The following attestation bundles were made for eyeroll-0.6.0.tar.gz:

Publisher: ci.yml on mnvsk97/eyeroll

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file eyeroll-0.6.0-py3-none-any.whl.

File metadata

  • Download URL: eyeroll-0.6.0-py3-none-any.whl
  • Upload date:
  • Size: 45.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for eyeroll-0.6.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a2259cf0cd703b5338f04bb212d2f0743ab1635e5c9ca858aa0e1bda21b0a2dd
MD5 d38b67f648aae11e10b5dc123eb7b744
BLAKE2b-256 5a2d989885d3c5b8cdc08a91a9cee12884306d2db3a5baaf1139e7a6cbc67c69

See more details on using hashes here.

Provenance

The following attestation bundles were made for eyeroll-0.6.0-py3-none-any.whl:

Publisher: ci.yml on mnvsk97/eyeroll

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page