Skip to main content

A Python CLI package for voice over subtitles, with the ability to embed in video, audio ducking, and dynamic voice changer for a single track; auto translating; download and upload to YouTube supports

Project description

Package for voice over subtitles:

  • with the ability to embed in video,
  • audio ducking,
  • dynamic voice changer for a single track. Add --voice-set-anchor at the beginning of the subtitle line. (Applies to all subsequent ones)

pip install -U FastDub


Install for Ubuntu

sudo apt update -y && sudo apt upgrade -y

sudo apt install python3 python3-pip ffmpeg espeak libxml2-dev libxslt1-dev

; libxml for translator functions

sudo python3 -m pip install -U pip setuptools wheel

sudo python3 -m pip install -U FastDub

Install all dependencies

pip install FastDub[ALL] # default

Youtube support

Youtube argument group

pip install FastDub[YT]

Process all videos from a channel

To get the channel id if it only has a username, run the JS code in the browser console:

document.querySelector("body>link").href

Then, in the input parameter, you can pass a link to the channel (with an id, not with a username) or a string of the format "c/CHANNEL_ID"

For example:

python -m fastdub -i "c/UCi-5OZ2tYuwMLIcEyOsbdRA" -yt

YouTube Search argument group

That the input data was a request to YouTube, they must begin with "?".

For Example:

python -m fastdub -i "?#python" -yt -yts-l 5

YouTube Upload argument group

pip install FastDub[YTU]

To download, you need to go to credentials (Create a new project if needed) > + Create credentials > OAuth Client ID > Desktop App

After filling in the required fields, DOWNLOAD JSON format and save to a working folder under the name client_secrets.json

  • Specifying the -ytu-ps argument as non-private may result in processing errors, but this was not observed during testing.

  • Please note that video uploads require a large amount of quota ( default has 10,000 per day)

Subtitles translate

Translate argument group

pip install FastDub[TR]

Usage

python -m fastdub --help

usage: fastdub [-h] [-rc {0,1,2}] [-ra | --cleanup-audio | -n-ra | --no-cleanup-audio] [-ev | --export-video | -n-ev | --no-export-video]
               [-l LANGUAGE] [-tc THREADS_COUNT] -i INPUT [-vf VIDEO_FORMAT] [-sf SUBTITLES_FORMAT] [-En EXCLUDE [EXCLUDE ...]]
               [-Eu EXCLUDE_UNDERSCORE] [-sc | --sidechain | -n-sc | --no-sidechain] [-sc-args SIDECHAIN_FFMPEG_PARAMS]
               [-sc-lvl SIDECHAIN_LEVEL_SC]
               [-v {microsoft irina desktop - russian,microsoft zira desktop - english united states),microsoft david desktop - english (united s
tates,aleksandr-hq,arina,artemiy,evgeniy-eng,evgeniy-rus,lyubov,marianna,mikhail,pavel,tatiana,victoria,vitaliy,volodymyr,vsevolod,yuriy}]       
               [-a ALIGN] [-v-set-a VOICE_SET_ANCHOR] [-ll {trace,debug,verbose,info,warning,error,fatal,panic,quiet}]
               [-y | --confirm | -n-y | --no-confirm] [-af AUDIO_FORMAT] [-wm WATERMARK] [-tb | --traceback | -n-tb | --no-traceback] [-yt]      
               [-ak API_KEYS [API_KEYS ...]] [-yts] [-yts-l YOUTUBE_SEARCH_LIMIT] [-yts-rg YOUTUBE_SEARCH_REGION] [-ytu]
               [-ytu-ps {private,public,unlisted}] [-ytu-t] [-tr] [--rewrite-srt | --no-rewrite-srt]
               [-ts {alibaba,apertium,argos,baidu,bing,caiyun,cloudYi,deepl,elia,google,iciba,iflytek,iflyrec,itranslate,judic,languageWire,lingv
anex,niutrans,mglip,modernMt,myMemory,papago,qqFanyi,qqTranSmart,reverso,sogou,sysTran,tilde,translateCom,translateMe,utibet,volcEngine,yandex,ye
ekit,youdao}]

fastdub is a tool for dubbing videos by subtitle files.

options:
  -h, --help            show this help message and exit
  -rc {0,1,2}, --remove-cache {0,1,2}
                        Remove all cache (_cached_texts directory) files
                                0 - No remove cache
                                1 - Delete cache before voice acting
                                2 - Delete cache after voice acting (default)
  -ra, --cleanup-audio, -n-ra, --no-cleanup-audio
                        Remove result audio if video exists (default True) (default: True)
  -ev, --export-video, -n-ev, --no-export-video
  -l LANGUAGE, --language LANGUAGE
                        Subtitles language (ru)
  -tc THREADS_COUNT, --threads-count THREADS_COUNT
                        Process count to download (pass to cpu count, < 2 to disable)
                                *N = N * cpu count

Input:
  -i INPUT, --input INPUT
                        Input directory/YouTube Playlist/Video URL.
  -vf VIDEO_FORMAT, --video-format VIDEO_FORMAT
                        Video format (default: .mp4).
  -sf SUBTITLES_FORMAT, --subtitles-format SUBTITLES_FORMAT
                        Subtitles format (default: .srt).

Input Exclude:
  -En EXCLUDE [EXCLUDE ...], --exclude EXCLUDE [EXCLUDE ...]
                        Exclude <name> (glob)
  -Eu EXCLUDE_UNDERSCORE, --exclude-underscore EXCLUDE_UNDERSCORE
                        Exclude files starts with underscore

Audio Ducking:
  -sc, --sidechain, -n-sc, --no-sidechain
                        Enable audio side chain compress (ducking) (default: True)
  -sc-args SIDECHAIN_FFMPEG_PARAMS, --sidechain-ffmpeg-params SIDECHAIN_FFMPEG_PARAMS
                        sidechain FFMpeg parameters (default '')
  -sc-lvl SIDECHAIN_LEVEL_SC, --sidechain-level-sc SIDECHAIN_LEVEL_SC
                        Set sidechain gain. Range is between 0.015625 and 64. (default 0.8)

Voicer:
  -v {microsoft irina desktop - russian,microsoft zira desktop - english (united states),microsoft david desktop - english (united states),aleksa
ndr-hq,arina,artemiy,evgeniy-eng,evgeniy-rus,lyubov,marianna,mikhail,pavel,tatiana,victoria,vitaliy,volodymyr,vsevolod,yuriy}, --voice {microsoft
 irina desktop - russian,microsoft zira desktop - english (united states),microsoft david desktop - english (united states),aleksandr-hq,arina,ar
temiy,evgeniy-eng,evgeniy-rus,lyubov,marianna,mikhail,pavel,tatiana,victoria,vitaliy,volodymyr,vsevolod,yuriy}
                        SAPI voice for voice acting.
  -a ALIGN, --align ALIGN
                        Audio fit align (divisor)
                                1 = right
                                2 = center (default)
  -v-set-a VOICE_SET_ANCHOR, --voice-set-anchor VOICE_SET_ANCHOR
                        Anchor indicating voice actor change (default "!:")

FFMpeg Output:
  -ll {trace,debug,verbose,info,warning,error,fatal,panic,quiet}, --loglevel {trace,debug,verbose,info,warning,error,fatal,panic,quiet}
                        FFMpegWrapper loglevel
  -y, --confirm, -n-y, --no-confirm
                        Don't ask for confirmation (default: True)
  -af AUDIO_FORMAT, --audio-format AUDIO_FORMAT
                        Out audio files format (default wav)
  -wm WATERMARK, --watermark WATERMARK
                        Add watermark to output video

Terminal Output:
  -tb, --traceback, -n-tb, --no-traceback
                        Show debug traceback (default: False)

YouTube:
  -yt, --youtube
  -ak API_KEYS [API_KEYS ...], --api-keys API_KEYS [API_KEYS ...]
                        Youtube API key/s

YouTube Search:
  -yts, --youtube-search
                        The input data is a query for searching on YouTube. (Adds "?" at the start of input)
  -yts-l YOUTUBE_SEARCH_LIMIT, --youtube-search-limit YOUTUBE_SEARCH_LIMIT
                        Sets limit to the number of results. Defaults to 20.
  -yts-rg YOUTUBE_SEARCH_REGION, --youtube-search-region YOUTUBE_SEARCH_REGION
                        Sets the result region. Defaults to "US".

YouTube Upload:
  -ytu, --youtube-upload
                        yt_upload video to YouTube channel after voice acting.
  -ytu-ps {private,public,unlisted}, --privacy-status {private,public,unlisted}
                        Video privacy status (If not private, errors are possible)
  -ytu-t, --youtube-upload-translate
                        Translate title and description on upload. (+ Arguments from translate argument group)

Translate:
  -tr, --translate      Translate input subtitles files
  --rewrite-srt, --no-rewrite-srt
                        Rewrite input subtitles files.
                        If not, add "_" to the beginning of the original subtitle file. (default: False)
  -ts {alibaba,apertium,argos,baidu,bing,caiyun,cloudYi,deepl,elia,google,iciba,iflytek,iflyrec,itranslate,judic,languageWire,lingvanex,niutrans,
mglip,modernMt,myMemory,papago,qqFanyi,qqTranSmart,reverso,sogou,sysTran,tilde,translateCom,translateMe,utibet,volcEngine,yandex,yeekit,youdao}, 
--translate-service {alibaba,apertium,argos,baidu,bing,caiyun,cloudYi,deepl,elia,google,iciba,iflytek,iflyrec,itranslate,judic,languageWire,lingv
anex,niutrans,mglip,modernMt,myMemory,papago,qqFanyi,qqTranSmart,reverso,sogou,sysTran,tilde,translateCom,translateMe,utibet,volcEngine,yandex,ye
ekit,youdao}
                        Subtitle translation service. (default google)

If the voice set after "!:" is not selected during voiceover, clear the cache with the -rc argument

Example

python -m fastdub -i DirToDub -v "Yuriy" --no-sidechain -sf vtt -vf mkv

All files in the folder will be voices (*.mkv, *.vtt)

Default is mp4 video and srt subtitles.

Then: name and name2 will be announced, and the results will be saved to a folder with the appropriate name.

YT Example

python -m fastdub -yt -i https://youtu.be/DD5UKQggXTc -v "Yuriy" -l ru

YouTube Search Example

python -m fastdub -yt -yts -i "#annoyingorange" -l ru

Translate Example

python -m fastdub -i DirToDub -tr -ts iciba -l ru

Default service is Google.

Other

The fastdub.utils module stores helper functions.

python -m pydoc -w fastdub

You can write your issues on GitHub in English or in Russian.


CHANGELOG

3.6.0

General

  • Bugfix

Audio Processing

  • sidechain теперь намного быстрее, используя FFMpeg

CLI

  • Аргумент --sidechain-ffmpeg-params см. FFMpeg Documentation
  • Отдельный --sidechain-level-sc см. level_sc выше.

3.5.2

Translator

  • Теперь не вызовет ошибки при отсутствии интернета.

Subtitles

  • Исправлены возможные различия формата .srt (возможная . вместо ,)

3.5.1

Subtitles

  • Исправлены возможные проблемы с разными кодировками (добавлен модуль chardet)

3.5.0

Voiceover Process

  • Добавлен аргумент --export-video (-ev): BooleanOptionalAction, если False (--no-export-video, -n-ev) экспортирует только аудио

3.4.2

  • Незначительные улучшения и оптимизации.

Subtitles

  • Класс TimeLabel теперь не является подклассом Line

3.4.1

  • Исправлена документация

3.4.0

General

  • Добавлена возможность накладывания водяного знака на видео (см. аргумент --watermark)

CLI

  • Bugfix
  • Аргумент --watermark. В него передаётся текст водяного знака.
  • Теперь, при запуске с консоли, показывается мини-баннер FastDub.

Voiceover Process

  • Bugfix
  • Теперь подогнанное аудио (которое начинается на '_') всегда удаляется, т.к это временный файл

FFMpeg Wrapper

  • Добавлен метод класса FFMpegWrapper.get_video_duration_s, который используется в FFMpegWrapper.get_video_duration_ms
  • В видео результат включаются: озвученное аудио, оригинальное аудио, субтитры, оригинальные субтитры (если есть)

Submodules

Translator

  • Теперь используется последняя версия модула translators

3.3.0

General

  • Реализован класс GlobalSettings

Audio Processing

  • Функция calc_speed_change_ffmpeg_arg по расчету аргумента -af ffmpeg для изменения скорости изменена.

    Значительно ускорена с применением другого алгоритма.

  • Оптимизирована функция side_chain.

Voiceover Process

  • Подгон длины аудио и TTS теперь объеденины в один процесс для увеличения производительности.
  • Теперь создаётся подпапка _result/_working_dir в которой сохраняются отдельные уже подогнанные строки субтитров. После чего все части склеиваются ffmpeg-ом. Значительно уменьшено потребление памяти.
  • moviepy больше не является зависимость, вместо этого парсится вывод ffmpeg

FFMpeg Wrapper

  • Теперь все аргументы преобразуются в строки перед вызовом check_call

3.2.0

CLI

  • Опущены необязательные type=str аргументы.
  • Изменена логика BooleanOptionalAction, теперь доступно как --no- так и -n- отрицание.
  • Аргумент --cleanup-audio теперь BooleanOptionalAction (по умолчанию True), --cleanup-level удалён.
  • Аргумент --voice-set-anchor (по умолчанию так же !:).
  • Аргумент --audio-format для выходного аудио (по умолчанию wav).
  • Аргумент --sidechain переименован в --side-chain.
  • Добавлено сокращение аргументу --traceback - -tb.

Voiceover Process

  • Bugfix.
  • Оптимизация подгона длительности дорожек (Fitting-а).

TTS

  • anchor аргумент (см. --voice-set-anchor).
  • Оптимизация смены голосов.

Submodules

YouTube

  • При multi-загрузке полностью загруженные видео удаляются с экрана (чтоб не занимать зря место).

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

FastDub-3.6.0b2.tar.gz (45.5 kB view details)

Uploaded Source

Built Distribution

FastDub-3.6.0b2-py3-none-any.whl (54.4 kB view details)

Uploaded Python 3

File details

Details for the file FastDub-3.6.0b2.tar.gz.

File metadata

  • Download URL: FastDub-3.6.0b2.tar.gz
  • Upload date:
  • Size: 45.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.9

File hashes

Hashes for FastDub-3.6.0b2.tar.gz
Algorithm Hash digest
SHA256 22017c0c77dfc441930fc238a3562c8411c349dc455ddb9198f1328b82eb51ab
MD5 8e60e4374afc21044dc365d8100ed786
BLAKE2b-256 1d25f31fdb8415d160c69023e46d101d11d85df460812cfa6df77d8ede8988a7

See more details on using hashes here.

File details

Details for the file FastDub-3.6.0b2-py3-none-any.whl.

File metadata

  • Download URL: FastDub-3.6.0b2-py3-none-any.whl
  • Upload date:
  • Size: 54.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.9

File hashes

Hashes for FastDub-3.6.0b2-py3-none-any.whl
Algorithm Hash digest
SHA256 530323605dec91dc105b34ca55f42466f11b2794ee9e6b08f81e320f8aeb29a7
MD5 3ce26705de506a72608fd46471d50cbd
BLAKE2b-256 4c734c25002602ee7bb98c06dcb75c8caedd846e38c4086723a31c1b2da0d6e6

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page