Skip to main content

VidAI

VidAI

Record, understand and improve your videos — by talking to Claude.

status: under development PyPI vidai-rec python 3.10+ Linux 50 tests passing

VidAI is a video plugin for Claude Code. Say vidai, answer a few questions, and record. While you record, VidAI measures small, useful statistics ("anchors") and applies live effects; you can talk to it ("VidAI, zoom in", "VidAI, add a title that says Hello"). Afterwards Claude uses the anchors to edit the video and exports a YouTube-ready file. Everything runs locally and for free.


How it works

VidAI flow: brief, anchor setup, record, live, anchors, understand, edit plan, render

Generated by assets/flowchart/flowchart.js (pure Node → SVG → PNG via headless Chrome): node assets/flowchart/flowchart.js


What it can do now

🎙️ Brief Claude asks what the video is about, the language, style, length and sections, then decides what to track
🎥 Record Its own recorder: camera, screen, or screen + camera, with mic · live preview · countdown · crash-safe files
📊 Live anchors Pauses, speech (speech-to-text), text on screen (OCR), motion, scene changes, active window, markers
🗣️ Voice “VidAI record / stop / mark / mistake / new section … / important / zoom in / zoom out / captions on” — anything else goes to Claude (English for now)
✨ Live effects Text, logos, arrows and boxes, zoom, blur, live captions — plus new effects Claude writes on the spot (e.g. an object that follows your hand)
🤔 Thinking icon A little animated VidAI eye bounces in the corner while Claude works on your request
🧠 Instant models Teach it something during the recording (“VidAI label yes”), correct it (“VidAI wrong”); it learns immediately
✂️ Editing Remove pauses and failed takes, add titles, arrows, zooms, subtitles, chapters, audio clean-up — without touching the original
⚡ Fast Renders in parallel chunks split inside silences; hot loops in C
📺 YouTube export MP4 + subtitles (.srt) + a description with chapters

Quick start

pip install vidai-rec

Working on VidAI itself (tests, Claude Code skill and MCP config included):

git clone https://github.com/AlsammanAlsamman/VidAI && cd VidAI
python3 -m venv .venv && .venv/bin/pip install -e ".[all]"
.venv/bin/python -m pytest -q        # optional: run the tests

Then open Claude Code inside the folder and say vidai:

claude
> vidai

Claude interviews you, opens the VidAI Recorder, and edits the video when you are done. Prefer the terminal? vidai studio · vidai analyze video.mkv · vidai plan video.mkv remove_gaps · vidai render video.mkv

Requirements: Linux (X11), a webcam and mic (PipeWire/PulseAudio), gcc for the C speed-ups (optional). ffmpeg is bundled; the speech model downloads on first use.


Coming next

  • Speech-based editing: remove filler words, keep the best take automatically
  • Built-in tracking: hands, face, objects — effects that follow them
  • Arabic voice commands and on-screen text
  • More layouts, transitions and music

Release files for vidai-rec 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vidai-rec 0.2.1
File Size Uploaded
vidai_rec-0.2.1.tar.gz 726.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for vidai-rec 0.2.1
File Interpreter ABI Platform
vidai_rec-0.2.1-py3-none-any.whl Python 3 none any Details

Total release size: 1.4 MB

Release files / vidai_rec-0.2.1.tar.gz

Download URL vidai_rec-0.2.1.tar.gz
Size 726.1 kB
Tags Source
SHA-256 checksum
How to use checksums
42ccc837a6329cef5f4d52e9b2b329e00c5396011170a1f71c1a6b40bda9d22d
BLAKE2b-256 checksum
How to use checksums
057edd57f90a838725d126117491d384d33bf5d4ce838797e35b82c6cec36c2c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / vidai_rec-0.2.1-py3-none-any.whl

Download URL vidai_rec-0.2.1-py3-none-any.whl
Size 721.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
fbd135cb6612a49aecb985d12ad691e482b470158fbf4bf6c3bd525af3d55ad4
BLAKE2b-256 checksum
How to use checksums
3addc5dba4b1856b745140c48d7cffd5688724af24be6b76efc61862472b353e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release history Release notifications | RSS feed

This release

0.2.1 This release

2 release files

0.2.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page