Skip to main content

Tool for downloading files from MediaWiki sites

Project description

wikiget

Build Status PyPI version

Something like a wget clone for downloading files from MediaWiki sites (like Wikipedia or Wikimedia Commons) using only the file name or the URL of its description page.

Requires Python 2.7 or 3.5+. Install with pip install --user -U wikiget.

Usage

wikiget [-h] [-V] [-q | -v] [-f] [--site SITE] [-o OUTPUT] FILE

If FILE is in the form File:Example.jpg or Example.jpg, it will be fetched from the default site, which is "en.wikipedia.org". If it's the fully-qualified URL of a file description page, like https://commons.wikimedia.org/wiki/File:Example.jpg, the file is fetched from the specified site, in this case "commons.wikimedia.org". Full URLs may contain characters your shell interprets differently, so you can either escape those characters with a backslash \ or surround the entire URL with single ' or double " quotes.

The site can also be specified with the --site flag, though this will not have any effect if the full URL is given.

More detailed information, such as the site used and full URL of the file, can be displayed with -v or --verbose. Use -vv to display even more detail. -q can be used to silence warnings.

By default, the program won't overwrite existing files with the same name as the target, but this can be forced with -f or --force. Additionally, the file can be downloaded to a different name with -o.

Examples

wikiget File:Example.jpg
wikiget --site commons.wikimedia.org File:Example.jpg
wikiget https://en.wikipedia.org/wiki/File:Example.jpg -o test.jpg

Future plans

  • batch download categories, user uploads, or from a text file
  • download from any MediaWiki-powered site, not just Wikimedia projects
  • download Wikipedia articles, in plain text, wikitext, or other formats

Contributing

It's recommended that you use a virtual environment manager (like virtualenv) to install dependencies:

pip install --user -U virtualenv
git clone https://github.com/clpo13/python-wikiget.git
cd python-wikiget
virtualenv venv

To activate the virtual environment, use one of the following commands:

source venv/bin/activate  # Linux and macOS
.\venv\Scripts\activate   # Windows

Then run pip install -e . to invoke an "editable" install, meaning any changes made to the source will be reflected immediately in the executable script. Unit tests can be run with python setup.py test.

License

Copyright (C) 2018-2019 Cody Logan

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program. If not, see https://www.gnu.org/licenses/.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for wikiget, version 0.1.3
Filename, size File type Python version Upload date Hashes
Filename, size wikiget-0.1.3-py2.py3-none-any.whl (19.2 kB) File type Wheel Python version py2.py3 Upload date Hashes View hashes
Filename, size wikiget-0.1.3.tar.gz (6.8 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page