Skip to main content

Extract video frames as descriptive text flows for LLM consumption

Project description

video2flow

Extract video frames as descriptive text flows for LLM consumption.

Claude, GPT-4o, Gemini and other multimodal models can see images but not video. video2flow bridges the gap: extract frames → generate timestamped descriptions → feed the text flow to any LLM.

Installation

pip install video2flow

Usage

# Extract frames from a video
video2flow extract video.mp4 -o frames/ --fps 1

# Quick description (without vision API)
video2flow describe video.mp4 --max-frames 10

# Full pipeline
video2flow pipeline video.mp4 -o video_flow/

LLM Integration

Pass the output JSON to any LLM:

import json
flow = json.loads(open("video_flow/flow.json").read())
prompt = flow["usage"]["example_prompt"]
# Then: response = llm.invoke(prompt)

For detailed vision understanding, send image files directly to a multimodal model alongside the flow transcript.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

video2flow-0.3.0-cp313-cp313-win_amd64.whl (209.7 kB view details)

Uploaded CPython 3.13Windows x86-64

File details

Details for the file video2flow-0.3.0-cp313-cp313-win_amd64.whl.

File metadata

  • Download URL: video2flow-0.3.0-cp313-cp313-win_amd64.whl
  • Upload date:
  • Size: 209.7 kB
  • Tags: CPython 3.13, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.14

File hashes

Hashes for video2flow-0.3.0-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 40c4e4efa90c6e76fbb05b025ce35b22cf692e92fa9c0d202928f06868d2589e
MD5 0e4762e83ac1dfe1b61e940f78bb1692
BLAKE2b-256 28d1080f630bdf51fbfcaec33a307a13d8644f0dfa8bc664e0651bfcf6f4b09d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page