Skip to main content

Extract academic citations from Wikipedia

This project contains a utility for extracting academic citation identifiers.

NOTE: As one of its dependencies (Mediawiki-Utilities) requires Python 3 so does mwcites.

pip install mwcites

Usage

There’s really only one utility in this package called mwcitations.

$ mwcitations extract enwiki-20150112-pages-meta-history*.xml*.bz2 > citations.tsv

Documentation

Documentation is provided $ mwcitations extract -h.

Extracts academic citations from articles from the history of Wikipedia
articles by processing a pages-meta-history XML dump and matching regular
expressions to revision content.

Currently supported identifiers include:

 * PubMed
 * DOI
 * ISBN
 * arXiv

Outputs a TSV file with the following fields:

 * page_id: The identifier of the Wikipedia article (int), e.g. 1325125
 * page_title: The title of the Wikipedia article (utf-8), e.g. Club cell
 * rev_id: The Wikipedia revision where the citation was first added (int),
           e.g. 282470030
 * timestamp: The timestamp of the revision where the citation was first
              added. (ISO 8601 datetime), e.g. 2009-04-08T01:52:20Z
 * type: The type of identifier, e.g. pmid, pmcid, doi, isbn or arxiv
 * id: The id of the cited scholarly article (utf-8),
       e.g 10.1183/09031936.00213411

Usage:
    mwcites extract -h | --help
    mwcites extract <dump_file>...

Options:
    -h --help        Shows this documentation

Metadata

Release files for mwcites 0.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distributions (sdists)

Source distribution for mwcites 0.2.0
File Size Uploaded Provenance
mwcites-0.2.0.zip 17.7 kB Without provenance Details
mwcites-0.2.0.tar.gz 10.5 kB Without provenance Details

Release files / mwcites-0.2.0.zip

Download URL mwcites-0.2.0.zip
Size 17.7 kB
Tags Source
SHA-256 checksum
How to use checksums
7670124a4ab55b856022949f0046a05d38a12d14a6f156e1a654747987485e2e
BLAKE2b-256 checksum
How to use checksums
ecd5e9df07872b866e44a7ab90e0c6fd472e531a5107393e6a1233a58c6017a1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release files / mwcites-0.2.0.tar.gz

Download URL mwcites-0.2.0.tar.gz
Size 10.5 kB
Tags Source
SHA-256 checksum
How to use checksums
8229377609e2d9ebcd3d8dc3ba8f8283a05029f91062a16c6b715dbd6bd7a536
BLAKE2b-256 checksum
How to use checksums
28c89bb13c1198d47aa59209b5f3551ad3ddd02eaa7de4c9d44fe94e4f634e11
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for mwcites 0.2.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page