Skip to main content

A simple but fast python script that reads the XML dump of a wiki and output the processed data in a CSV file.

Project description

A simple but fast python script that reads the XML dump of a wiki and output the processed data in a CSV file.

All revisions history of a mediawiki wiki can be backed up as an XML file, known as a XML dump. This file is a record of all the edits made in a wiki with all the corresponding data regarding date, page, author and the full content within the edit.

Very often we just want the metadata for the edit regarding date, author and page; and therefore, we do not need the content of the edit, which by far the longest piece of data.

This script converts this very long XML dump in csv files much smaller and easiest to read and work with. It takes care of


Install the package using pip:

pip install wiki_dump_parser

Then, use it directly from command line:

python -m wiki_dump_parser <dump.xml>

Or from python code:

import wiki_dump_parser as parser

The output csv files should be loaded using ‘|’ as an escape character for quoting string. An example to load the output file “dump.csv” generated by this script using pandas would be:

df = pd.read_csv('dump.csv', quotechar='|', index_col = False)
df['timestamp'] = pd.to_datetime(df['timestamp'],format='%Y-%m-%dT%H:%M:%SZ')


  • python 3

Yes, nothing more.

How to get a wiki history dump

There are several ways to get the wiki dump:

  • If you have access to the server, follow the instructions in the mediawiki docs.

  • For Wikia wikis and many other domains, you can use our in-house developed script made to accomplish this task. It is straightforward to use and very fast on it.

  • Wikimedia project wikis: For wikis belonging to the Wikimedia project, you already have a regular updated repo with all the dumps here: Select your target wiki from the list and download the complete edit history dump and uncompress it.

  • For other wikis, like self-hosted wikis, you should use the wikiteam’s script. You have a simple tutorial in their wiki. Its usage is very straightforward and the script is well maintained. Remember to use the –xml option to download the full history dump.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wiki_dump_parser-2.0.2.tar.gz (4.3 kB view hashes)

Uploaded source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page