ffmperative 0.0.1

No project description provided

FFMPerative

Devilishly Simple Video Processing

Large Language Models (LLMs) with Tools can perform complex tasks from natural language prompts. Based on HuggingFace's Agents & Tools, our agent is equipped with a suite of tools for common video processing workflows like:

• Get Video Metadata
• Extract Frame at Frame Number
• Make a Video from a Directory of Images
• Horizontal/Vertical Flip
• Crop Video to Bounding Box
• Speed Up Video by X
• Compress a GIF/Video
• Resize or convert a GIF/Video
• Adjust Audio Levels

Install

Ensure you have ffmpeg installed. On Debian, you can use:

sudo apt-get install ffmpeg

Pypi

Install from pypi with:

pip install ffmperative

Install from source

Clone this repo and install using pip

git clone https://github.com/remyxai/FFMPerative.git 
cd FFMPerative/
pip install .

Quickstart

Getting started is easy, import the library and call the ffmp function.

from ffmperative import ffmp

ffmp(prompt="crop video '/path/to/video.mp4' to 200,200,400,400 before writing to '/path/to/video_cropped.mp4', then double the speed of that video and write to '/path/to/video_cropped_fast.mp4'")

CLI

You can also call FFMPerative from the command line, try:

ffmp do --prompt="sample the 5th frame from /path/to/video.mp4"

Roadmap

• Basic Video Tools
• Release to PyPI after Agents are Added to Transformers
• Release LLM checkpoint fine-tuned to use ffmp Tools

Contributing

• We'll gladly review pull requests aimed at improving the library of simple image and video processing tools.
• Interested in contributing to data/templates for specializing an LLM for video processing workflows, ping us!

Resources:

• Huggingface Transformers Agents
• ffmpeg-python
• RemyxAI Classifier Agent