Skip to main content

VidAI

VidAI

Record, understand and improve your videos — by talking to Claude.

status: under development PyPI vidai-rec python 3.10+ Linux 50 tests passing

VidAI is a video plugin for Claude Code. Say vidai, answer a few questions, and record. While you record, VidAI measures small, useful statistics ("anchors") and applies live effects; you can talk to it ("VidAI, zoom in", "VidAI, add a title that says Hello"). Afterwards Claude uses the anchors to edit the video and exports a YouTube-ready file. Everything runs locally and for free.


How it works

VidAI flow: brief, anchor setup, record, live, anchors, understand, edit plan, render

Generated by assets/flowchart/flowchart.js (pure Node → SVG → PNG via headless Chrome): node assets/flowchart/flowchart.js


What it can do now

🎙️ Brief Claude asks what the video is about, the language, style, length and sections, then decides what to track
🎥 Record Its own recorder: camera, screen, or screen + camera, with mic · live preview · countdown · crash-safe files
📊 Live anchors Pauses, speech (speech-to-text), text on screen (OCR), motion, scene changes, active window, markers
🗣️ Voice “VidAI record / stop / mark / mistake / new section … / important / zoom in / zoom out / captions on” — anything else goes to Claude (English for now)
✨ Live effects Text, logos, arrows and boxes, zoom, blur, live captions — plus new effects Claude writes on the spot (e.g. an object that follows your hand)
🤔 Thinking icon A little animated VidAI eye bounces in the corner while Claude works on your request
🧠 Instant models Teach it something during the recording (“VidAI label yes”), correct it (“VidAI wrong”); it learns immediately
✂️ Editing Remove pauses and failed takes, add titles, arrows, zooms, subtitles, chapters, audio clean-up — without touching the original
⚡ Fast Renders in parallel chunks split inside silences; hot loops in C
📺 YouTube export MP4 + subtitles (.srt) + a description with chapters

Quick start

pip install vidai-rec

Working on VidAI itself (tests, Claude Code skill and MCP config included):

git clone https://github.com/AlsammanAlsamman/VidAI && cd VidAI
python3 -m venv .venv && .venv/bin/pip install -e ".[all]"
.venv/bin/python -m pytest -q        # optional: run the tests

Then open Claude Code inside the folder and say vidai:

claude
> vidai

Claude interviews you, opens the VidAI Recorder, and edits the video when you are done. Prefer the terminal? vidai studio · vidai analyze video.mkv · vidai plan video.mkv remove_gaps · vidai render video.mkv

Requirements: Linux (X11), a webcam and mic (PipeWire/PulseAudio), gcc for the C speed-ups (optional). ffmpeg is bundled; the speech model downloads on first use.


Coming next

  • Speech-based editing: remove filler words, keep the best take automatically
  • Built-in tracking: hands, face, objects — effects that follow them
  • Arabic voice commands and on-screen text
  • More layouts, transitions and music

Made by AlsammanAlsamman · sammanmahmoud@gmail.com

Release files for vidai-rec 0.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vidai-rec 0.2.0
File Size Uploaded
vidai_rec-0.2.0.tar.gz 726.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for vidai-rec 0.2.0
File Interpreter ABI Platform
vidai_rec-0.2.0-py3-none-any.whl Python 3 none any Details

Total release size: 1.4 MB

Release files / vidai_rec-0.2.0.tar.gz

Download URL vidai_rec-0.2.0.tar.gz
Size 726.1 kB
Tags Source
SHA-256 checksum
How to use checksums
64746ec13481aaed2188116e0ad39e3efe5b136d64816ce8078b53abf2e77778
BLAKE2b-256 checksum
How to use checksums
3d22b6ca531c5196c10b2e290055ccc2134ef2ca634672ebba896650b4acd605
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / vidai_rec-0.2.0-py3-none-any.whl

Download URL vidai_rec-0.2.0-py3-none-any.whl
Size 721.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
660136b550726f6f089a3a0aef69d9e588c1901cebf9eb6acd54d89be08e2877
BLAKE2b-256 checksum
How to use checksums
7c2eba49a9420337984fbe61bdfb03bc688f782083f9a7dedfd0c5a2f5185cde
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release history Release notifications | RSS feed

0.2.1

2 release files

This release

0.2.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page