mwcites

This project contains a utility for extracting academic citation identifiers.

NOTE: As one of its dependencies (Mediawiki-Utilities) requires Python 3 so does mwcites.

pip install mwcites

Usage

There’s really only one utility in this package called mwcitations.

$ mwcitations extract enwiki-20150112-pages-meta-history*.xml*.bz2 > citations.tsv

Documentation

Documentation is provided $ mwcitations extract -h.

Extracts academic citations from articles from the history of Wikipedia
articles by processing a pages-meta-history XML dump and matching regular
expressions to revision content.

Currently supported identifiers include:

 * PubMed
 * DOI
 * ISBN

Outputs a TSV file with the following fields:

 * page_id: The identifier of the Wikipedia article (int), e.g. 1325125
 * page_title: The title of the Wikipedia article (utf-8), e.g. Club cell
 * rev_id: The Wikipedia revision where the citation was first added (int),
           e.g. 282470030
 * timestamp: The timestamp of the revision where the citation was first added.
              (ISO 8601 datetime), e.g. 2009-04-08T01:52:20Z
 * type: The type of identifier, e.g. pmid
 * id: The id of the cited scholarly article (utf-8),
       e.g 10.1183/09031936.00213411

Usage:
    mwcites extract -h | --help
    mwcites extract <dump_file>...

Options:
    -h --help        Shows this documentation

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

mwcites-0.1.2.zip (17.3 kB view details)

Uploaded Mar 9, 2015 Source

mwcites-0.1.2.tar.gz (10.8 kB view details)

Uploaded Mar 9, 2015 Source

File details

Details for the file mwcites-0.1.2.zip.

File metadata

Download URL: mwcites-0.1.2.zip
Upload date: Mar 9, 2015
Size: 17.3 kB
Tags: Source
Uploaded using Trusted Publishing? No

File hashes

Hashes for mwcites-0.1.2.zip
Algorithm	Hash digest
SHA256	`c1f2469647eefc693d016a6e90dd380c6eacf50890a90788e59ae5896610f3db`
MD5	`ad582d7a123533b3fb6b2be84ac5eaee`
BLAKE2b-256	`a9f21ddf50b2783c6719c73fb28cb00fefd9e4fd94b563ae57a610ddbaafc4f0`

See more details on using hashes here.

File details

Details for the file mwcites-0.1.2.tar.gz.

File metadata

Download URL: mwcites-0.1.2.tar.gz
Upload date: Mar 9, 2015
Size: 10.8 kB
Tags: Source
Uploaded using Trusted Publishing? No

File hashes

Hashes for mwcites-0.1.2.tar.gz
Algorithm	Hash digest
SHA256	`550c479c10979cfe8e017dcf4d5a85604540fafbc71156bd3fb17428f601adb1`
MD5	`028be2e252a637c572978e2938ecfd29`
BLAKE2b-256	`2e90ccaf7bf67cb0d98df8bf59a2c283cc940728ca26d8d8258ae6fca127a94b`