twitch-archiver 3.0.0.dev1

A simple, fast, platform-independent tool for downloading Twitch streams, videos, and chat logs.

 _______ ___ ___ ___ _______ _______ ___ ___  _______ _______ _______ ___ ___ ___ ___ ___ _______ _______ 
|       |   Y   |   |       |   _   |   Y   ||   _   |   _   |   _   |   Y   |   |   Y   |   _   |   _   \
|.|   | |.  |   |.  |.|   | |.  1___|.  1   ||.  1   |.  l   |.  1___|.  1   |.  |.  |   |.  1___|.  l   /
`-|.  |-|. / \  |.  `-|.  |-|.  |___|.  _   ||.  _   |.  _   |.  |___|.  _   |.  |.  |   |.  __)_|.  _   1
  |:  | |:      |:  | |:  | |:  1   |:  |   ||:  |   |:  |   |:  1   |:  |   |:  |:  1   |:  1   |:  |   |
  |::.| |::.|:. |::.| |::.| |::.. . |::.|:. ||::.|:. |::.|:. |::.. . |::.|:. |::.|\:.. ./|::.. . |::.|:. |
  `---' `--- ---`---' `---' `-------`--- ---'`--- ---`--- ---`-------`--- ---`---' `---' `-------`--- ---'

A simple, fast, platform-independent tool for downloading Twitch streams, videos and chat logs.
Primarily focused on data preservation, this script can be used to archive an entire Twitch channel at once, or to quickly grab the chat log from a single VOD. Both archived, and live VODs can be downloaded with this script.

Table of Contents

• Features
• Requirements
• Installation & Usage
  • Installation
  • Usage
  • Arguments
• Disclaimer

Features

• Archives both video and chat logs.
• VODs can be downloaded as fast as your Internet connection (and storage) can handle.[^1]
• Allows the downloading of live VODs before sections are muted or deleted.[^2]
• Generates a readable chat log with timestamps and user badges.
• Supports downloading streams which aren't being archived by Twitch.
• Error notifications supported with pushbullet.
• Supports archiving of subscriber-only VODs.

[^1]: If you wish to speed up (or slow down) the downloading of VOD pieces, supply the '--threads NUMBER' argument to the script. This changes how many download threads are used to grab the individual video files. With the default of 20, I can max out my gigabit Internet while downloading to an M.2 drive. [^2]: There is one caveat with live archiving due to how Twitch presents ads. Ads are not downloaded, BUT while an ad is displayed, the actual stream output is not sent. This can result in missing segments under very rare circumstances, but any missing segments should be filled via a parallel VOD archival function.

Requirements

• Python >= 3.7
• FFmpeg >= 4.3.1 and ffprobe (Accessible via your PATH - see Installation)

Installation & Usage

Installation

Twitch Archiver can be installed via pip, setup as a docker container or installed manually.
Make sure to read the usage section after installation.

Installing with PIP

1. Ensure you meet the above requirements.
2. Install pip if you do not already have it.
3. Download and install TA with python -m pip install twitch-archiver.

Installing Manually

1. Either download the repository via the green code button at the top of the page, or grab the latest release here.
2. Unpack the archive and enter the directory with cd twitch-archiver.
3. Install pip if you do not already have it.
4. Build the package with python -m build, then install with python -m pip install ./dist/twitch-archiver-*.tar.gz.

Installing as a Docker Container

1. Either download the repository via the green code button at the top of the page, or grab the latest release here.
2. Unpack the archive and enter the directory with cd twitch-archiver.
3. Build the container with docker build . -t twitch-archiver.
4. Run the container with the following command. Configuration can also be provided via environment variables (see wiki).

docker run -it -v {output_dir}:/output -v {config_dir}:/config twitch-archiver -c Brisppy -i {client_id} -s {client_secret} -d "/output" -I "/config"

Usage

Run via your terminal of choice. Use twitch-archiver -h to view help text.

Before you start downloading VODs or streams you will need generate and provide your Twitch app developer credentials to Twitch Archiver. If you do not yet have these credentials, see Retrieving Tokens.
Once you have these, run TA once with twitch-archiver -i CLIENT_ID -s CLIENT_SECRET -v 0, where CLIENT_ID and CLIENT_SECRET are your Twitch client ID and client secret.

Alternatively you can run TA with the above command without replacing the CLIENT_ID and CLIENT_SECRET, and instead add them manually to the configuration file located in $HOME/.config/twitch-archiver/config.ini.

More advanced usage such as watch mode and setting up as a service can be found in the Wiki.

Examples

# twitch-archiver -c Brisppy -i {client_id} -s {client_secret} -d "Z:\\twitch-archive"

Would download video and chat of all VODs from the channel Brisppy, using the provided client_id and client_secret, to the directory Z:\twitch-archive.

# twitch-archiver -v 1276315849,1275305106 -d "/mnt/twitch-archive" -V -t 10

Would download VODs 1276315849 and 1275305106 to the directory /mnt/twitch-archive, only saving the video using 10 download threads.

Arguments

Below is the output of the --help or -h command. This displays all the available arguments and a brief description of how to use them.

usage: twitch-archiver [-h] (-c CHANNEL | -v VOD_ID) [-i CLIENT_ID] [-s CLIENT_SECRET] [-C] [-V]
                       [-t THREADS] [-q QUALITY] [-d DIRECTORY] [-w] [-L LOG_FILE] [-I CONFIG_DIR]
                       [-p PUSHBULLET_KEY] [-Q | -D] [--version] [--show-config]

requires one of:
    -c CHANNEL, --channel CHANNEL
            Channel(s) to download, comma separated if multiple provided.
    -v VOD_ID, --vod-id VOD_ID
            VOD ID(s) to download, comma separated if multiple provided.

credentials are grabbed from stored config, OR provided with:
    -i CLIENT_ID, --client-id CLIENT_ID
            Client ID retrieved from dev.twitch.tv
    -s CLIENT_SECRET, --client-secret CLIENT_SECRET
            Client secret retrieved from dev.twitch.tv

Both the video and chat logs are grabbed if neither are specified.

optional arguments:
  -h, --help            show this help message and exit
  -c CHANNEL, --channel CHANNEL
                        A single twitch channel to download, or multiple comma-separated channels.
  -v VOD_ID, --vod-id VOD_ID
                        A single VOD (e.g 12763849) or many comma-separated IDs (e.g 12763159,12753056).
  -i CLIENT_ID, --client-id CLIENT_ID
                        Client ID retrieved from dev.twitch.tv
  -s CLIENT_SECRET, --client-secret CLIENT_SECRET
                        Client secret retrieved from dev.twitch.tv
  -C, --chat            Only save chat logs.
  -V, --video           Only save video.
  -t THREADS, --threads THREADS
                        Number of video download threads. (default: 20)
  -q QUALITY, --quality QUALITY
                        Quality to download. Options are 'best', 'worst' or a custom value.
                        Format for custom values is [resolution]p[framerate], (e.g 1080p60, 720p30).
                        (default: best)
  -d DIRECTORY, --directory DIRECTORY
                        Directory to store archived VOD(s), use TWO slashes for Windows paths.
                        (default: $CURRENT_DIRECTORY)
  -w, --watch           Continually check every 10 seconds for new streams from the specified channel.
  -S, --stream-only     Only download streams which are currently live.
  -N, --no-stream       Don't download streams which are currently live.
  -L LOG_FILE, --log-file LOG_FILE
                        Output logs to specified file.
  -I CONFIG_DIR, --config-dir CONFIG_DIR
                        Directory to store configuration, VOD database and lock files.
                        (default: $HOME/.config/twitch-archiver)
  -p PUSHBULLET_KEY, --pushbullet-key PUSHBULLET_KEY
                        Pushbullet key for sending pushes on error. Enabled by supplying key.
  -Q, --quiet           Disable all log output.
  -D, --debug           Enable debug logs.
  --version             Show version number and exit.
  --show-config         Show saved config and exit.

Disclaimer

This script is intended to be used with the express permission of any involved rights holders, and is not intended to be used to duplicate, download or steal copyrighted content or information. When downloading VODs ensure you have permission from ALL involved rights holders for the content which you are downloading, and if you have the intention to share such content, you should also have explicit permission to do so.

If your intent is to use this script to lazily rip and upload streams to another platform for your own gain without the permission of the streamer, I implore you to stop and think about what you are doing and the possible effect of doing so, and politely request that you find another method with which to steal the work of others.