VidAI
Record, understand and improve your videos — by talking to Claude.
VidAI is a video plugin for Claude Code. Say vidai, answer a few questions, and record. While you record,
VidAI measures small, useful statistics ("anchors") and applies live effects; you can talk to it
("VidAI, zoom in", "VidAI, add a title that says Hello"). Afterwards Claude uses the anchors to edit the
video and exports a YouTube-ready file. Everything runs locally and for free.
How it works
Generated by assets/flowchart/flowchart.js (pure Node → SVG → PNG via headless Chrome): node assets/flowchart/flowchart.js
What it can do now
| 🎙️ Brief | Claude asks what the video is about, the language, style, length and sections, then decides what to track |
| 🎥 Record | Its own recorder: camera, screen, or screen + camera, with mic · live preview · countdown · crash-safe files |
| 📊 Live anchors | Pauses, speech (speech-to-text), text on screen (OCR), motion, scene changes, active window, markers |
| 🗣️ Voice | “VidAI record / stop / mark / mistake / new section … / important / zoom in / zoom out / captions on” — anything else goes to Claude (English for now) |
| ✨ Live effects | Text, logos, arrows and boxes, zoom, blur, live captions — plus new effects Claude writes on the spot (e.g. an object that follows your hand) |
| 🤔 Thinking icon | A little animated VidAI eye bounces in the corner while Claude works on your request |
| 🧠 Instant models | Teach it something during the recording (“VidAI label yes”), correct it (“VidAI wrong”); it learns immediately |
| ✂️ Editing | Remove pauses and failed takes, add titles, arrows, zooms, subtitles, chapters, audio clean-up — without touching the original |
| 🌱 Learns you | Remembers misheard phrases you corrected, turns Claude's solutions into instant shortcuts, keeps your sizes and hand choices, and reads its lessons before every new video |
| 🔐 Asks first | “Master, I need to install … Say VidAI confirm” — or say “VidAI, take all actions” for full access |
| ⚡ Fast | Renders in parallel chunks split inside silences; hot loops in C |
| 📺 YouTube export | MP4 + subtitles (.srt) + a description with chapters |
Quick start
pip install vidai-rec
Working on VidAI itself (tests, Claude Code skill and MCP config included):
git clone https://github.com/AlsammanAlsamman/VidAI && cd VidAI
python3 -m venv .venv && .venv/bin/pip install -e ".[all]"
.venv/bin/python -m pytest -q # optional: run the tests
Then open Claude Code inside the folder and say vidai:
claude
> vidai
Claude interviews you, opens the VidAI Recorder, and edits the video when you are done.
Prefer the terminal? vidai studio · vidai analyze video.mkv · vidai plan video.mkv remove_gaps · vidai render video.mkv
Requirements: Linux (X11), a webcam and mic (PipeWire/PulseAudio), gcc for the C speed-ups (optional).
ffmpeg is bundled; the speech model downloads on first use.
Coming next
- Speech-based editing: remove filler words, keep the best take automatically
- Built-in tracking: hands, face, objects — effects that follow them
- Arabic voice commands and on-screen text
- More layouts, transitions and music
Metadata
Release files for vidai-rec 0.3.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| vidai_rec-0.3.0.tar.gz | 751.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| vidai_rec-0.3.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 1.5 MB
Release files / vidai_rec-0.3.0.tar.gz
| Download URL | vidai_rec-0.3.0.tar.gz |
|---|---|
| Size | 751.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
0aa1b6c4e2977127cceac1f5cd44adc07c6416e4a583466a1cbd52e431356a69
|
|
BLAKE2b-256 checksum How to use checksums |
b84146a3125f5f59e3927529b8180c533e54348801eb61b41fd818055a7f1c54
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
Release files / vidai_rec-0.3.0-py3-none-any.whl
| Download URL | vidai_rec-0.3.0-py3-none-any.whl |
|---|---|
| Size | 745.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
1ab91cb8bae5b620f1e2d52e830f6c05d6d57cbb9d56c1ab64a99c1065730a88
|
|
BLAKE2b-256 checksum How to use checksums |
857a248fc6d1bc882901e38795fb8bc53b3b31a38fa8f0cd8444aa89173fee08
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|