Skip to main content

VidAI

VidAI

Record, understand and improve your videos — by talking to Claude.

A YouTuber records while VidAI robots run the camera, bring a new wig on request and paint a new background live

status: under development PyPI vidai-rec python 3.10+ Linux 61 tests passing

VidAI is a video plugin for Claude Code. Say vidai, answer a few questions, and record. While you record, VidAI measures small, useful statistics ("anchors") and applies live effects; you can talk to it ("VidAI, zoom in", "VidAI, add a title that says Hello"). Afterwards Claude uses the anchors to edit the video and exports a YouTube-ready file. Everything runs locally and for free.


How it works

VidAI flow: brief, anchor setup, record, live, anchors, understand, edit plan, render

Generated by assets/flowchart/flowchart.js (pure Node → SVG → PNG via headless Chrome): node assets/flowchart/flowchart.js


What it can do now

🎙️ Brief Claude asks what the video is about, the language, style, length and sections, then decides what to track
🎥 Record Its own recorder: camera, screen, or screen + camera, with mic · live preview · countdown · crash-safe files
📊 Live anchors Pauses, speech (speech-to-text), text on screen (OCR), motion, scene changes, active window, markers
🗣️ Voice “VidAI record / stop / mark / mistake / new section … / important / zoom in / zoom out / captions on” — anything else goes to Claude (English for now)
✨ Live effects Text, logos, arrows and boxes, zoom, blur, live captions — plus new effects Claude writes on the spot (e.g. an object that follows your hand)
🤔 Thinking icon A little animated VidAI eye bounces in the corner while Claude works on your request
🧠 Instant models Teach it something during the recording (“VidAI label yes”), correct it (“VidAI wrong”); it learns immediately
✂️ Editing Remove pauses and failed takes, add titles, arrows, zooms, subtitles, chapters, audio clean-up — without touching the original
🌱 Learns you Remembers misheard phrases you corrected, turns Claude's solutions into instant shortcuts, keeps your sizes and hand choices, and reads its lessons before every new video
🔐 Asks first “Master, I need to install … Say VidAI confirm” — or say “VidAI, take all actions” for full access
⚡ Fast Renders in parallel chunks split inside silences; hot loops in C
📺 YouTube export MP4 + subtitles (.srt) + a description with chapters

Quick start

pip install vidai-rec

Working on VidAI itself (tests, Claude Code skill and MCP config included):

git clone https://github.com/AlsammanAlsamman/VidAI && cd VidAI
python3 -m venv .venv && .venv/bin/pip install -e ".[all]"
.venv/bin/python -m pytest -q        # optional: run the tests

Then open Claude Code inside the folder and say vidai:

claude
> vidai

Claude interviews you, opens the VidAI Recorder, and edits the video when you are done. Prefer the terminal? vidai studio · vidai analyze video.mkv · vidai plan video.mkv remove_gaps · vidai render video.mkv

Requirements: Linux (X11), a webcam and mic (PipeWire/PulseAudio), gcc for the C speed-ups (optional). ffmpeg is bundled; the speech model downloads on first use.


Coming next

  • Speech-based editing: remove filler words, keep the best take automatically
  • Built-in tracking: hands, face, objects — effects that follow them
  • Arabic voice commands and on-screen text
  • More layouts, transitions and music

Metadata

Release files for vidai-rec 0.3.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vidai-rec 0.3.0
File Size Uploaded
vidai_rec-0.3.0.tar.gz 751.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for vidai-rec 0.3.0
File Interpreter ABI Platform
vidai_rec-0.3.0-py3-none-any.whl Python 3 none any Details

Total release size: 1.5 MB

Release files / vidai_rec-0.3.0.tar.gz

Download URL vidai_rec-0.3.0.tar.gz
Size 751.1 kB
Tags Source
SHA-256 checksum
How to use checksums
0aa1b6c4e2977127cceac1f5cd44adc07c6416e4a583466a1cbd52e431356a69
BLAKE2b-256 checksum
How to use checksums
b84146a3125f5f59e3927529b8180c533e54348801eb61b41fd818055a7f1c54
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / vidai_rec-0.3.0-py3-none-any.whl

Download URL vidai_rec-0.3.0-py3-none-any.whl
Size 745.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
1ab91cb8bae5b620f1e2d52e830f6c05d6d57cbb9d56c1ab64a99c1065730a88
BLAKE2b-256 checksum
How to use checksums
857a248fc6d1bc882901e38795fb8bc53b3b31a38fa8f0cd8444aa89173fee08
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release history Release notifications | RSS feed

0.4.0

2 release files

This release

0.3.0 This release

2 release files

0.2.1

2 release files

0.2.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page