PyAutoCorpus
A python interface to the excellent AutoCorpus library.
Right now, it only supports the wiki markup textify function, which strips out
markup. From my benchmarks, this ends up being ~40x faster than methods to strip
markup using other libraries:
mwparserfromhell 0.208 sec/doc
wikitextparser 0.215 sec/doc
pyautocorpus 0.005 sec/doc
where:
mwparserfromhellismwparserfromhell.parse(x).strip_code()wikitextparseriswikitextparser.parse(x).plain_text()pyautocorpusispyautocorpus.Textifier().textify(x)
Installing
From pypi:
pip install pyautocorpus
From source:
Be sure to clone recursively:
git clone --recursive https://github.com/seanmacavaney/pyautocorpus.git
You will first need the pcre library installed.
python setup.py install
Usage
Example:
import pyautocorpus
textifier = pyautocorpus.Textifier()
textifier.textify("==Wiki Marked up text==\n [[Some Page|link text]] example.")
'Wiki Marked up text\n\n\n link text example.'
Known issues
- Windows is not yet supported
Credits
Contributors to this repository:
- Sean MacAvaney (University of Glasgow)
- Thomas Jänich (University of Glasgow)
1 maintainer
Metadata
1 maintainer
Release files for pyautocorpus 0.1.18
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| pyautocorpus-0.1.18.tar.gz | 10.9 kB | Details |
Built distributions (wheels)
Total release size: 3.3 MB
Release files / pyautocorpus-0.1.18.tar.gz
| Download URL | pyautocorpus-0.1.18.tar.gz |
|---|---|
| Size | 10.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a0c7b9f01f5d00bae0cae2f10a6cf10ccb2356663c608179356efb3db896867b
|
|
BLAKE2b-256 checksum How to use checksums |
ef4d27cac031338ccd9fc6aecc52321ed4193848142c19bce906df21a5cec0d2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.6
|
Release files / pyautocorpus-0.1.18-cp314-cp314t-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.18-cp314-cp314t-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 368.4 kB |
| Tags | CPython 3.14 CPython 3.14 free-threading Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
e55592d6fd27fbe75347b04d9d344fbc52065880014a87c5094fd4392f7cd40a
|
|
BLAKE2b-256 checksum How to use checksums |
5542720e3119389e3cd29fa869bfc468bc3b1bb6f590a773bc7cdc41b4d1a982
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.5
|
Release files / pyautocorpus-0.1.18-cp314-cp314-win_amd64.whl
| Download URL | pyautocorpus-0.1.18-cp314-cp314-win_amd64.whl |
|---|---|
| Size | 6.9 kB |
| Tags | CPython 3.14 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
493db91fafff47410bc4f73c0f856bdc670ff545f69383d1db373cf4e7c4c2d6
|
|
BLAKE2b-256 checksum How to use checksums |
400dd555a09973c3b2563b2a63227e03d50d73fba092f6d2b024d910a0c0c0e4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.6
|
Release files / pyautocorpus-0.1.18-cp314-cp314-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.18-cp314-cp314-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 367.2 kB |
| Tags | CPython 3.14 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
57ddf744b1a1a791a706efa8f7393744500df3f9c9e932843a26a9642618bb40
|
|
BLAKE2b-256 checksum How to use checksums |
a4fad0c54db8d9a8486f162d09058a2e4076842db5253148e422f7d18ce242bb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.5
|
Release files / pyautocorpus-0.1.18-cp314-cp314-macosx_10_15_universal2.whl
| Download URL | pyautocorpus-0.1.18-cp314-cp314-macosx_10_15_universal2.whl |
|---|---|
| Size | 45.2 kB |
| Tags | CPython 3.14 macOS 10.15+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
be62ab5ac967b19b808acfad8191fd314ed594844554c6e0f80f5162fc3263a6
|
|
BLAKE2b-256 checksum How to use checksums |
7719750055baae754a4bf7bcd654322dfc3a04b2db0800b972488c70871df74d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.5
|
Release files / pyautocorpus-0.1.18-cp313-cp313-win_amd64.whl
| Download URL | pyautocorpus-0.1.18-cp313-cp313-win_amd64.whl |
|---|---|
| Size | 6.7 kB |
| Tags | CPython 3.13 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
0f0908e3a84bab6791ae4c6824d084a71fbebcc2e797e4b66da7705dfdcb3034
|
|
BLAKE2b-256 checksum How to use checksums |
0446c697d7f03cc8d9bab4bfc1ce47bd5ef8bff0870cc28afc5ae615baeb1f1c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.13.13
|
Release files / pyautocorpus-0.1.18-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.18-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 367.1 kB |
| Tags | CPython 3.13 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
64a32ad49248bf58ec73613535644601a1cba1f21850d540492fd57c6464911f
|
|
BLAKE2b-256 checksum How to use checksums |
916cea871041dcf1f675e67a3de2435369327e523da4a8bace9f27a713b2b0e4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.5
|
Release files / pyautocorpus-0.1.18-cp313-cp313-macosx_10_13_universal2.whl
| Download URL | pyautocorpus-0.1.18-cp313-cp313-macosx_10_13_universal2.whl |
|---|---|
| Size | 45.0 kB |
| Tags | CPython 3.13 macOS 10.13+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
e4897d722242d5c3bece25aec1219c6ef2835731adaea6a22629a982149ab4d8
|
|
BLAKE2b-256 checksum How to use checksums |
095a0527afa5bc0432422ec9a03d7a36591b0aa0fb1c4d9b537dfc5eeb723d02
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.13.13
|
Release files / pyautocorpus-0.1.18-cp312-cp312-win_amd64.whl
| Download URL | pyautocorpus-0.1.18-cp312-cp312-win_amd64.whl |
|---|---|
| Size | 6.7 kB |
| Tags | CPython 3.12 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
ac4395ebab38f32b011243d59d1a53dcab97590fcb71856c4f559ec40dac8a7f
|
|
BLAKE2b-256 checksum How to use checksums |
6afbd2a04f41dd7f5e19d341ab4a384d95feb7dd8f8e3f1f1a03f084bbaf55b6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.10
|
Release files / pyautocorpus-0.1.18-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.18-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 367.1 kB |
| Tags | CPython 3.12 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
d878e5309206b6fb5b95b760471f1c8561cddeba7410a7958e1168e944b87006
|
|
BLAKE2b-256 checksum How to use checksums |
3d2239ddb8acd746687ccc923a67b920c7eadfc3c8ab153135215286734a0049
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.5
|
Release files / pyautocorpus-0.1.18-cp312-cp312-macosx_10_13_universal2.whl
| Download URL | pyautocorpus-0.1.18-cp312-cp312-macosx_10_13_universal2.whl |
|---|---|
| Size | 45.0 kB |
| Tags | CPython 3.12 macOS 10.13+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
7bdb4f8658a3e5ebdc184ad13983e154339ea909e4821347dd718f558e0be7fc
|
|
BLAKE2b-256 checksum How to use checksums |
9fb4e1116be16c02f88e9ddbe12222b0be477d44c9fa38fb3569590d90253230
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.10
|
Release files / pyautocorpus-0.1.18-cp311-cp311-win_amd64.whl
| Download URL | pyautocorpus-0.1.18-cp311-cp311-win_amd64.whl |
|---|---|
| Size | 6.6 kB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
d7820760cde5c0abdb56274ef1020df12c85d1364e359609dfe024539ed653b8
|
|
BLAKE2b-256 checksum How to use checksums |
146c4f8f785c78c232e3246592fd5e656b483edc1660d98901c4d4fa6ba12269
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.9
|
Release files / pyautocorpus-0.1.18-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.18-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 366.5 kB |
| Tags | CPython 3.11 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
3bac6b22a3580b6179176222ef3f5c65a7ef8da4fd4220daff94272bb3dd1eed
|
|
BLAKE2b-256 checksum How to use checksums |
ac1f93563bc94543c61d7093d62dd96ada884dec1b026a9a76ed65c7292f0c2d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.5
|
Release files / pyautocorpus-0.1.18-cp311-cp311-macosx_10_9_universal2.whl
| Download URL | pyautocorpus-0.1.18-cp311-cp311-macosx_10_9_universal2.whl |
|---|---|
| Size | 44.9 kB |
| Tags | CPython 3.11 macOS 10.9+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
2ab565242662dd4d5fe47180bec2ca0318ebfb1ec9edd25b70c51c175c39a82f
|
|
BLAKE2b-256 checksum How to use checksums |
6afb1c31d68531a407401fdaf5f4ffb0743c89bb28a16ad4a64381f41677653f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.9
|
Release files / pyautocorpus-0.1.18-cp310-cp310-win_amd64.whl
| Download URL | pyautocorpus-0.1.18-cp310-cp310-win_amd64.whl |
|---|---|
| Size | 6.6 kB |
| Tags | CPython 3.10 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
c6b38a3eabcde3b0d773830cad7db883e23c91f372c8a36d4c16c79db8673fc7
|
|
BLAKE2b-256 checksum How to use checksums |
7cfe21091f597061d3501e8bc474f8c11cd6aa54a7f6b63b94048ad9d37dbbd6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.10.11
|
Release files / pyautocorpus-0.1.18-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.18-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 366.4 kB |
| Tags | CPython 3.10 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
44ab11fe0a66b22bf24b17b55febf5b00f1b80e8a881c59ba1e6233c85f3ef15
|
|
BLAKE2b-256 checksum How to use checksums |
363eb40418b8cb3304675d3c80ba909846ae7cbe889e36a506d48f0d9f406356
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.5
|
Release files / pyautocorpus-0.1.18-cp310-cp310-macosx_10_9_universal2.whl
| Download URL | pyautocorpus-0.1.18-cp310-cp310-macosx_10_9_universal2.whl |
|---|---|
| Size | 44.9 kB |
| Tags | CPython 3.10 macOS 10.9+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
b6c174ae31264fad69eb4ff17e097c9df0cc0e27d743b13afe38a64228d24785
|
|
BLAKE2b-256 checksum How to use checksums |
74ebce4a10f97a63240618cdb0115675a473a4f1e46a50e2580f3b6bf5437d0d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.10.11
|
Release files / pyautocorpus-0.1.18-cp39-cp39-win_amd64.whl
| Download URL | pyautocorpus-0.1.18-cp39-cp39-win_amd64.whl |
|---|---|
| Size | 6.7 kB |
| Tags | CPython 3.9 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
8feb05e217b112faca133068062537feea4f8b6bdc24bbf85c51ccd52986eaea
|
|
BLAKE2b-256 checksum How to use checksums |
1fe5711a2867456eb87e243feaa02a3a163a813399af42b4100ed4e4428c6da9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.9.13
|
Release files / pyautocorpus-0.1.18-cp39-cp39-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.18-cp39-cp39-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 366.2 kB |
| Tags | CPython 3.9 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
bd64d3bc29ba93387d4ecbaa85b9726ec4ba7a480a117b92b0563a579697b970
|
|
BLAKE2b-256 checksum How to use checksums |
59d263368a62f969d3b0dfa33eaa01e5c672f0ce7032cc2556d57a5cf6239642
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.5
|
Release files / pyautocorpus-0.1.18-cp39-cp39-macosx_10_9_universal2.whl
| Download URL | pyautocorpus-0.1.18-cp39-cp39-macosx_10_9_universal2.whl |
|---|---|
| Size | 44.9 kB |
| Tags | CPython 3.9 macOS 10.9+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
515f60dcfa559fe41709db9d329704bd93c52f197ec77cee894e098292680009
|
|
BLAKE2b-256 checksum How to use checksums |
74ba211d9c03db6bc280e2d4660aa66954d6e68eed9bf634c738bb6293411a69
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.9.13
|
Release files / pyautocorpus-0.1.18-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.18-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 366.2 kB |
| Tags | CPython 3.8 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
e18cccfaf41625305ddae017d1040eb781ed497b78a558106bf051370569d9f8
|
|
BLAKE2b-256 checksum How to use checksums |
0482dc8680eea640c64b40b0639c8464244784d4b7c6f0e29ce3401b55c3e1b2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.5
|
