Skip to main content

This project contains a utility for extracting academic citation identifiers.

pip install mwcites

Usage

There’s really only one utility in this package called extract_cites.

$ extract_cites enwiki-20150112-pages-meta-history*.xml*.bz2 > citations.tsv

Documentation

Documentation is provided $ mwcites extract -h.

Extracts academic citations from articles from the history of Wikipedia
articles by processing a pages-meta-history XML dump and matching regular
expressions to revision content.

Currently supported identifies include:

 * PubMed
 * DOI

Outputs a TSV file with the following fields:

 * page_id: The identifier of the Wikipedia article (int), e.g. 1325125
 * page_title: The title of the Wikipedia article (utf-8), e.g. Club cell
 * rev_id: The Wikipedia revision where the citation was first added (int),
           e.g. 282470030
 * timestamp: The timestamp of the revision where the citation was first added.
              (ISO 8601 datetime), e.g. 2009-04-08T01:52:20Z
 * type: The type of identifier, e.g. pmid
 * id: The id of the cited scholarly article (utf-8),
       e.g 10.1183/09031936.00213411

Usage:
    mwcites extract -h | --help
    mwcites extract <dump_file>...

Options:
    -h --help        Shows this documentation

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

mwcites-0.0.5.zip (15.1 kB view details)

Uploaded Source

mwcites-0.0.5.tar.gz (8.7 kB view details)

Uploaded Source

File details

Details for the file mwcites-0.0.5.zip.

File metadata

  • Download URL: mwcites-0.0.5.zip
  • Upload date:
  • Size: 15.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for mwcites-0.0.5.zip
Algorithm Hash digest
SHA256 519e601b558f4dba1635173b40b7910795fdfccdff72b8fd4eeabbe240c52a3a
MD5 189d362a3a8c517f4d1eb3e0982c29a2
BLAKE2b-256 a99a43c6952458649c38a76ce69fe26c1e43b013a42e466b3a1488e922bf423f

See more details on using hashes here.

File details

Details for the file mwcites-0.0.5.tar.gz.

File metadata

  • Download URL: mwcites-0.0.5.tar.gz
  • Upload date:
  • Size: 8.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for mwcites-0.0.5.tar.gz
Algorithm Hash digest
SHA256 00af8d823f2411c27a8327635e9f8d02f09f9290c9eefa39b62ad46e09712747
MD5 2d26787d1a3b3606e1d6ccfa890dd38c
BLAKE2b-256 e8fb44e9906eb9fbc1f273ad65fb00d1691c21f5773a17909b49aa3c1b0e2a3e

See more details on using hashes here.

Release history Release notifications | RSS feed

0.2.0

2 files

0.1.2

2 files

0.1.0

2 files

This release

0.0.5 This release

2 files

0.0.4

2 files

0.0.3

2 files

0.0.2

2 files

0.0.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page