Command-line program to download image galleries and collections from several image hosting sites
Project description
gallery-dl is a command-line program to download image galleries and collections from several image hosting sites (see Supported Sites). It is a cross-platform tool with many configuration options and powerful filenaming capabilities.
Dependencies
Optional
FFmpeg: Pixiv Ugoira conversion
yt-dlp or youtube-dl: Video downloads
PySocks: SOCKS proxy support
brotli or brotlicffi: Brotli compression support
PyYAML: YAML configuration file support
toml: TOML configuration file support for Python<3.11
SecretStorage: GNOME keyring passwords for --cookies-from-browser
Installation
Pip
The stable releases of gallery-dl are distributed on PyPI and can be easily installed or upgraded using pip:
python3 -m pip install -U gallery-dl
Installing the latest dev version directly from GitHub can be done with pip as well:
python3 -m pip install -U -I --no-deps --no-cache-dir https://github.com/mikf/gallery-dl/archive/master.tar.gz
Note: Windows users should use py -3
instead of python3
.
It is advised to use the latest version of pip,
including the essential packages setuptools
and wheel
.
To ensure these packages are up-to-date, run
python3 -m pip install --upgrade pip setuptools wheel
Standalone Executable
Prebuilt executable files with a Python interpreter and required Python packages included are available for
Nightly Builds
Snap
Linux users that are using a distro that is supported by Snapd can install gallery-dl from the Snap Store:
snap install gallery-dl
Chocolatey
Windows users that have Chocolatey installed can install gallery-dl from the Chocolatey Community Packages repository:
choco install gallery-dl
Scoop
gallery-dl is also available in the Scoop “main” bucket for Windows users:
scoop install gallery-dl
Homebrew
For macOS or Linux users using Homebrew:
brew install gallery-dl
MacPorts
For macOS users with MacPorts:
sudo port install gallery-dl
Docker
Using the Dockerfile in the repository:
git clone https://github.com/mikf/gallery-dl.git
cd gallery-dl/
docker build -t gallery-dl:latest .
Pulling image from Docker Hub:
docker pull mikf123/gallery-dl
docker tag mikf123/gallery-dl gallery-dl
Pulling image from GitHub Container Registry:
docker pull ghcr.io/mikf/gallery-dl
docker tag ghcr.io/mikf/gallery-dl gallery-dl
To run the container you will probably want to attach some directories on the host so that the config file and downloads can persist across runs.
Make sure to either download the example config file reference in the repo and place it in the mounted volume location or touch an empty file there.
If you gave the container a different tag or are using podman then make sure you adjust. Run docker image ls to check the name if you are not sure.
This will remove the container after every use so you will always have a fresh environment for it to run. If you setup a ci-cd pipeline to autobuild the container you can also add a --pull=newer flag so that when you run it docker will check to see if there is a newer container and download it before running.
docker run --rm -v $HOME/Downloads/:/gallery-dl/ -v $HOME/.config/gallery-dl/gallery-dl.conf:/etc/gallery-dl.conf -it gallery-dl:latest
You can also add an alias to your shell for “gallery-dl” or create a simple bash script and drop it somewhere in your $PATH to act as a shim for this command.
Usage
To use gallery-dl simply call it with the URLs you wish to download images from:
gallery-dl [OPTIONS]... URLS...
Use gallery-dl --help
or see https://github.com/mikf/gallery-dl/blob/master/docs/options.md
for a full list of all command-line options.
Examples
Download images; in this case from danbooru via tag search for ‘bonocho’:
gallery-dl "https://danbooru.donmai.us/posts?tags=bonocho"
Get the direct URL of an image from a site supporting authentication with username & password:
gallery-dl -g -u "<username>" -p "<password>" "https://twitter.com/i/web/status/604341487988576256"
Filter manga chapters by chapter number and language:
gallery-dl --chapter-filter "10 <= chapter < 20" -o "lang=fr" "https://mangadex.org/title/59793dd0-a2d8-41a2-9758-8197287a8539"
gallery-dl "r:https://pastebin.com/raw/FLwrCYsT"
If a site’s address is nonstandard for its extractor, you can prefix the URL with the extractor’s name to force the use of a specific extractor:
gallery-dl "tumblr:https://sometumblrblog.example"
Configuration
Configuration files for gallery-dl use a JSON-based file format.
Documentation
A list of all available configuration options and their descriptions can be found in https://github.com/mikf/gallery-dl/blob/master/docs/configuration.rst.
Locations
gallery-dl searches for configuration files in the following places:
- Windows:
%APPDATA%\gallery-dl\config.json
%USERPROFILE%\gallery-dl\config.json
%USERPROFILE%\gallery-dl.conf
(%USERPROFILE% usually refers to a user’s home directory, i.e. C:\Users\<username>\)
- Linux, macOS, etc.:
/etc/gallery-dl.conf
${XDG_CONFIG_HOME}/gallery-dl/config.json
${HOME}/.config/gallery-dl/config.json
${HOME}/.gallery-dl.conf
When run as executable, gallery-dl will also look for a gallery-dl.conf file in the same directory as said executable.
It is possible to use more than one configuration file at a time. In this case, any values from files after the first will get merged into the already loaded settings and potentially override previous ones.
Authentication
Username & Password
Some extractors require you to provide valid login credentials in the form of a username & password pair. This is necessary for nijie and optional for aryion, danbooru, e621, exhentai, idolcomplex, imgbb, inkbunny, mangadex, mangoxo, pillowfort, sankaku, subscribestar, tapas, tsumino, twitter, and zerochan.
You can set the necessary information in your configuration file
{
"extractor": {
"twitter": {
"username": "<username>",
"password": "<password>"
}
}
}
or you can provide them directly via the
-u/--username
and -p/--password
or via the
-o/--option
command-line options
gallery-dl -u "<username>" -p "<password>" "URL"
gallery-dl -o "username=<username>" -o "password=<password>" "URL"
OAuth
gallery-dl supports user authentication via OAuth for some extractors. This is necessary for pixiv and optional for deviantart, flickr, reddit, smugmug, tumblr, and mastodon instances.
Linking your account to gallery-dl grants it the ability to issue requests on your account’s behalf and enables it to access resources which would otherwise be unavailable to a public user.
To do so, start by invoking it with oauth:<sitename> as an argument. For example:
gallery-dl oauth:flickr
You will be sent to the site’s authorization page and asked to grant read access to gallery-dl. Authorize it and you will be shown one or more “tokens”, which should be added to your configuration file.
To authenticate with a mastodon instance, run gallery-dl with oauth:mastodon:<instance> as argument. For example:
gallery-dl oauth:mastodon:pawoo.net
gallery-dl oauth:mastodon:https://mastodon.social/
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for gallery_dl-1.26.6-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8b1f3db1403d734441a10f07691b96f7cdaeb447b36c590a2c8dfe640f869987 |
|
MD5 | 675dbb96ebce4eeea1179d73d685c2fd |
|
BLAKE2b-256 | cbf701168aad1963680a97b3c95b0e925f37a288e49dddb74ed9e994cbd9318e |