Python3 Implementation for 'Visual Rhythm and Beat' SIGGRAPH 2018
Project description
visbeat3
This is a migration of visbeat from Python2 to Python3. Head over to an example notebook on Colab!
This work presents a visual analogue for musical rhythm derived from an analysis of motion in video, and shows that alignment of visual rhythm with its musical counterpart results in the appearance of dance. You can visit the official project page and demos for more infos.
Install
$ pip3 install visbeat3
Usage
import os
import time
import matplotlib
import matplotlib.pyplot as plt
import numpy as np
import visbeat3 as vb
source_video = vb.PullVideo(name='video', source_location='./data/01.mp4')
# You can also directly specify an audio
# source_audio = vb.Audio('./data/all star.mp3')
source_audio = vb.PullVideo(name='audio', source_location='./data/02.mp4')
synch_video_beat = 0
synch_audio_beat = 0
nbeats = 32
output_path = './result.mp4'
# If source_audio is from an audio file, use target=source_audio
warped = vb.Dancify(source_video=source_video,
target=source_audio.getAudio(),
synch_video_beat=synch_video_beat,
synch_audio_beat=synch_audio_beat,
force_recompute=True,
warp_type='quad',
nbeats=nbeats,
output_path=output_path)
Used By
video-bgm-generation: video background music generation.
Reference
@inproceedings{davis2018visual,
title={Visual rhythm and beat},
author={Davis, Abe and Agrawala, Maneesh},
booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops},
pages={2532--2535},
year={2018}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
visbeat3-1.0.1.tar.gz
(22.5 MB
view hashes)
Built Distribution
visbeat3-1.0.1-py3-none-any.whl
(333.7 kB
view hashes)