twitter-video-tools 2023.4.15

Twitter Video Tools is a multi-processing supported video downloader, supports videos from twitter (or specific user from twitter) && monsnode.

This project is deprecated. Please look at https://github.com/code-yeongyu/twitter_video_tools_v2

Twitter Video Tools

• A multi-processing supported video downloader
• supports downloading videos from twitter (or specific user from twitter) && monsnode.

Install

with PIP

pip install twitter-video-tools

with Poetry

poetry add twitter-video-tools

Usage

Command line

python3 -m twitter_video_tools [link]

Supported link types:

• Video tweet: https://twitter.com/twtvtOfficial/status/1599748329927499777
• Video from monsnode: https://monsnode.com/v1506575871309589251
• Specific user's uploaded videos: https://twitter.com/twtvtOfficial/media
• Specific user's liked videos: https://twitter.com/twtvtOfficial/likes

Python Embedding

from twitter_video_tools import TwitterVideoTools

with TwitterVideoTools() as twitter_video_tools:
    twitter_video_tools.download_from_user('twtvtOfficial')

Contribution

Prerequisites

• Python 3.9
• poetry
• code editor (vscode recommended)

Overview of Development Environments

• Local

  • vscode ready (launching, debugging, formatting)
  • strict type checking using mypy & pyright
    • type hint generator monkeytype also included
  • amazing linters & formatters (yapf, pylint, isort)
    • unify for forcing single-quote
  • unit test using pytest

• GitHub Actions

  • All PRs are statically analyzed & checked by yapf, pylint, pyright, mypy
  • All PRs are tested with pytest
  • Can be released with Github Action when creating GitHub Releases

All-in-one

gh repo clone code-yeongyu/twitter_video_tools
python3 -m pip install poetry
poetry install # install dependencies
code --install-extension emeraldwalk.RunOnSave # to force single quote
code --install-extension tamasfe.even-better-toml # for handling toml

Done!

Test

poetry shell
inv test

Inspirations

yt-dlp

• Inspired me to start this project. yt-dlp is a fork project of youtube-dl.
• Since the cookie option of yt-dlp's twitter extractor is not working, I decided to make my own project, using browser automation.

playwright

• Microsoft's browser automation module.
• Another major project to made me to start this project. I made up my mind to make TwitterVideoTools to experience playwright.
• It would be so painful to imagine making this project with selenium, but I enjoyed a lot while writing the twitter crawler part thanks to playwright.

typer

• Ever since I started this project, I always wanted to support CLI with typer's awesome development experience.
• TwitterVideoTools' CLI is written with typer, and it is so beautiful and easy to use at the same time.

pyright & mypy & monkeytype

• These three tools helped me to write fully-typed python code.
• I won't start my python project without these tools.

my python project template

• I made this template to make my python project development experience better.
  • Safe & Convient development environment
    • Strict type checking
    • Amazing linters & formatters
    • Unit test supported
• This project is also based on this template.