twidr

🐦️ the Twitter–Wayback Machine Image Download Robot 🤖

twidr downloads images from the Wayback Machine's snapshots of a Twitter (X) account.

To be as kind as possible to Internet Archive's infrastructure, twidr rate-limits itself and creates an on-disk cache of the indices it gets from the Wayback Machine's APIs.

The Internet Archive plays a crucial role in preserving worldwide knowledge and combatting censorship. Donate!

installing

pipx is the preferred way to install twidr. Unlike pip alone: it automatically isolates the package from your other Python packages and puts the package in your PATH.

pipx install twidr

twidr supports argcomplete shell completions, which you can install for just twidr or all your Python packages.

pip install twidr

usage

Alongside its cached indices of Wayback Machine query results, twidr saves its progress as it downloads files. This lets you start a long-running download, pause it, and come back to it.

examples

Download all the images archived from user @openSUSE into a new directory called opensuse:

twidr opensuse

Download images into the current directory:

twidr opensuse --output .
twidr opensuse -o .

See all of twidr's options with twidr --help.

developing and building

This project uses uv.

Clone the repository with Git and use uv to install dependencies:

git clone git@github.com:solanto/twidr.git
cd twidr
uv sync

Run the program in development with uv run:

uv run twidr

And build the package with uv build:

uv build

contributing

Feel free to ask questions or make suggestions here or at person@dandelion.computer. I'll do my best to collaborate with those who'd like to!

If you fork twidr, be sure to change lib.meta:ORG_DOMAIN to your own domain (which could even be something like your-username.github.io). twidr uses this identifier to tell Internet Archive's servers exactly whose code is requesting information.

license

GNU General Public License v3.0 or later. See license in LICENSE.md.