PyAutoCorpus
A python interface to the excellent AutoCorpus library.
Right now, it only supports the wiki markup textify function, which strips out
markup. From my benchmarks, this ends up being ~40x faster than methods to strip
markup using other libraries:
mwparserfromhell 0.208 sec/doc
wikitextparser 0.215 sec/doc
pyautocorpus 0.005 sec/doc
where:
mwparserfromhellismwparserfromhell.parse(x).strip_code()wikitextparseriswikitextparser.parse(x).plain_text()pyautocorpusispyautocorpus.Textifier().textify(x)
Installing
From pypi:
pip install pyautocorpus
From source:
Be sure to clone recursively:
git clone --recursive https://github.com/seanmacavaney/pyautocorpus.git
You will first need the pcre library installed.
python setup.py install
Usage
Example:
import pyautocorpus
textifier = pyautocorpus.Textifier()
textifier.textify("==Wiki Marked up text==\n [[Some Page|link text]] example.")
'Wiki Marked up text\n\n\n link text example.'
Known issues
- Windows is not yet supported
Credits
Contributors to this repository:
- Sean MacAvaney (University of Glasgow)
- Thomas Jänich (University of Glasgow)
Metadata
Release files for pyautocorpus 0.1.19
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| pyautocorpus-0.1.19.tar.gz | 10.9 kB | Details |
Built distributions (wheels)
Total release size: 3.7 MB
Release files / pyautocorpus-0.1.19.tar.gz
| Download URL | pyautocorpus-0.1.19.tar.gz |
|---|---|
| Size | 10.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
8a36c6fc8cb7860548ffa60bcf05557a457eeca11db8223d16e15b9606c67b65
|
|
BLAKE2b-256 checksum How to use checksums |
e87d5c9379ed52b746eb39fbe6f24545dfbb474260c75f6ddcfb97ec7b99f9e6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.14.8
|
Release files / pyautocorpus-0.1.19-cp315-cp315t-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.19-cp315-cp315t-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 373.0 kB |
| Tags | CPython 3.15 CPython 3.15 free-threading Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
b8f50c8ee788f1432cf2188a4ad6d2f671a15a4060ada88e215fb622f30badfc
|
|
BLAKE2b-256 checksum How to use checksums |
501ea69f1e5353fe25fcf7c06916b966b33acbb023c12b14b28020a3f2979c73
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.14.8
|
Release files / pyautocorpus-0.1.19-cp315-cp315-win_amd64.whl
| Download URL | pyautocorpus-0.1.19-cp315-cp315-win_amd64.whl |
|---|---|
| Size | 6.8 kB |
| Tags | CPython 3.15 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
c4720d8138e08dbd62c2a6fa31abbadb970c91d4efbb205785a4b75752693b83
|
|
BLAKE2b-256 checksum How to use checksums |
716e8e4ed2c59ecfc6e51a5cb742746a684bdc3ebb8c89725bf89b781241a9dc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.15.0
|
Release files / pyautocorpus-0.1.19-cp315-cp315-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.19-cp315-cp315-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 371.8 kB |
| Tags | CPython 3.15 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
ad412ef3f316dfe48f82adae34ad82e212765349e70f7cb6c5ffe63d5204eae0
|
|
BLAKE2b-256 checksum How to use checksums |
6731ca14ab644316e884b20c33eb6d258c786afa86317adc0d770a129402c424
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.14.8
|
Release files / pyautocorpus-0.1.19-cp315-cp315-macosx_10_15_universal2.whl
| Download URL | pyautocorpus-0.1.19-cp315-cp315-macosx_10_15_universal2.whl |
|---|---|
| Size | 44.4 kB |
| Tags | CPython 3.15 macOS 10.15+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
6011acf26fae43edbf202f6240bd538516472305aee67ad45e724f00f7c18aa4
|
|
BLAKE2b-256 checksum How to use checksums |
873dc5b639655e986de1f8b79769468ed1d829d0c5fad7b30fb8d6a751ba6766
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.15.0
|
Release files / pyautocorpus-0.1.19-cp314-cp314t-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.19-cp314-cp314t-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 372.9 kB |
| Tags | CPython 3.14 CPython 3.14 free-threading Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
78fd0e21aeb42ad409d83563f0d78210b76e3e59d1dfc64b2a9fdc7d00571f6d
|
|
BLAKE2b-256 checksum How to use checksums |
f5075744634ca9f5b7d2e5a6f8b8ce771666726c8ffd616e33af93dfa4ee974c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.14.8
|
Release files / pyautocorpus-0.1.19-cp314-cp314-win_amd64.whl
| Download URL | pyautocorpus-0.1.19-cp314-cp314-win_amd64.whl |
|---|---|
| Size | 6.9 kB |
| Tags | CPython 3.14 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
e3a62407a4f3c1a606edf45b6c8be6da02c0064100cfe79858d38c9e3e881510
|
|
BLAKE2b-256 checksum How to use checksums |
05ea30290b1ff89b68d5ac20716c6a183508efeb92804a8ee9e7281afb3d306b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.14.8
|
Release files / pyautocorpus-0.1.19-cp314-cp314-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.19-cp314-cp314-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 371.7 kB |
| Tags | CPython 3.14 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
8dd88592aa19e59169c7746ec466202a8834529cf700bc45463e2045145828ac
|
|
BLAKE2b-256 checksum How to use checksums |
6ab3226f02e6da1a709000d532b6a278b0329cc8f6661e3ea056f6caabec0837
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.14.8
|
Release files / pyautocorpus-0.1.19-cp314-cp314-macosx_10_15_universal2.whl
| Download URL | pyautocorpus-0.1.19-cp314-cp314-macosx_10_15_universal2.whl |
|---|---|
| Size | 44.4 kB |
| Tags | CPython 3.14 macOS 10.15+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
f3c4e9f4ce997c0c738573495ea076f4b75f719869a9c40c0b840a9e6321ac9f
|
|
BLAKE2b-256 checksum How to use checksums |
8a8f79b523480c2762b3545d25e915bb243ab2f8db4f49a0a53906861ac2e572
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.14.8
|
Release files / pyautocorpus-0.1.19-cp313-cp313-win_amd64.whl
| Download URL | pyautocorpus-0.1.19-cp313-cp313-win_amd64.whl |
|---|---|
| Size | 6.7 kB |
| Tags | CPython 3.13 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
cb7632a6906bbe3ba09addabb5973869ab760d9dc0224e4f4645166a06da1a66
|
|
BLAKE2b-256 checksum How to use checksums |
c224a3ac44b50e9c592980220487e52a4d18b688965b730598a05b6e1b72f12d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Release files / pyautocorpus-0.1.19-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.19-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 371.6 kB |
| Tags | CPython 3.13 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
aa8fd2fc7caa5619a6555dc8d728e92b90c4744f9ad4a39088e7e2ef59ba85d5
|
|
BLAKE2b-256 checksum How to use checksums |
287fe310c80d11bbd155a7a48e7a12b4365745c5214d9faf7efee846c9b49a02
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.14.8
|
Release files / pyautocorpus-0.1.19-cp313-cp313-macosx_10_13_universal2.whl
| Download URL | pyautocorpus-0.1.19-cp313-cp313-macosx_10_13_universal2.whl |
|---|---|
| Size | 44.2 kB |
| Tags | CPython 3.13 macOS 10.13+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
9fb6a890bf8ce591e3f9367006b7e5094a37219108013b88b9b8b29883221d77
|
|
BLAKE2b-256 checksum How to use checksums |
fd6864cf0fdac5d9e6443458a4033994600f328a0b39bc7d2686184efb084395
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Release files / pyautocorpus-0.1.19-cp312-cp312-win_amd64.whl
| Download URL | pyautocorpus-0.1.19-cp312-cp312-win_amd64.whl |
|---|---|
| Size | 6.7 kB |
| Tags | CPython 3.12 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
0f75c2b3eed94f79a9792e7590540fa5888f677a11579b6dac257ce76d22c8d5
|
|
BLAKE2b-256 checksum How to use checksums |
09e4f58e363cfa26bc2a07e15d59d148198356e5af7cbab5fe329f797e7074c4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.10
|
Release files / pyautocorpus-0.1.19-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.19-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 371.6 kB |
| Tags | CPython 3.12 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
386046cc0edcaaddca4dfb2126d381e18bbcda78b1c04a1bf0fc3aa5853cef08
|
|
BLAKE2b-256 checksum How to use checksums |
edf6ff872967010b3f8988aaa41d30538a3e3f7c140cde8d9b2df8407666cc7a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.14.8
|
Release files / pyautocorpus-0.1.19-cp312-cp312-macosx_10_13_universal2.whl
| Download URL | pyautocorpus-0.1.19-cp312-cp312-macosx_10_13_universal2.whl |
|---|---|
| Size | 44.2 kB |
| Tags | CPython 3.12 macOS 10.13+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
62d07e25f4a5266533828c381d5b3cc43a91ad166948f4063bb7020939e64679
|
|
BLAKE2b-256 checksum How to use checksums |
9b0eee86c181adc052a325e9d6238fea282ce9f96727b0a25f7fae0fbb0ae1bf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.10
|
Release files / pyautocorpus-0.1.19-cp311-cp311-win_amd64.whl
| Download URL | pyautocorpus-0.1.19-cp311-cp311-win_amd64.whl |
|---|---|
| Size | 6.6 kB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
2f765e0c502ff90796c5ff4e0cb0299dd9fb3f488b5b791ad08bd770731fa2ea
|
|
BLAKE2b-256 checksum How to use checksums |
f0b8dbe233520705aa06df5c8c683f6a4d879f1718686e94a1239500bde0e6e1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.9
|
Release files / pyautocorpus-0.1.19-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.19-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 371.0 kB |
| Tags | CPython 3.11 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
66b3dcd4395eba349494fb8c08e83dfa0d8869cbdffa6955b6681e4103345e2a
|
|
BLAKE2b-256 checksum How to use checksums |
63644d1b74d91a89155de90698ba1ea3fa4269ef605870a1fa2a373827d6588b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.14.8
|
Release files / pyautocorpus-0.1.19-cp311-cp311-macosx_10_9_universal2.whl
| Download URL | pyautocorpus-0.1.19-cp311-cp311-macosx_10_9_universal2.whl |
|---|---|
| Size | 44.1 kB |
| Tags | CPython 3.11 macOS 10.9+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
a215095628a6410a71e15244d16ec24abad5988434379848f73d65153bb92c4a
|
|
BLAKE2b-256 checksum How to use checksums |
5c657acf10c41b540b0052dfee0971fda34a9c8e5c3d6aed5803ff0151c2825b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.9
|
Release files / pyautocorpus-0.1.19-cp310-cp310-win_amd64.whl
| Download URL | pyautocorpus-0.1.19-cp310-cp310-win_amd64.whl |
|---|---|
| Size | 6.6 kB |
| Tags | CPython 3.10 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
c4d9c5c7bcd25afd2fba11cececba29208a2e424b81a736af251d2cdab22db04
|
|
BLAKE2b-256 checksum How to use checksums |
3cda40e98bee721d9750cbba4833f0cc9a0344f8f170a1733f2d16ae6d1f6243
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.11
|
Release files / pyautocorpus-0.1.19-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.19-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 370.9 kB |
| Tags | CPython 3.10 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
c7bddb88f88148405bdf199c6507dc18dc9667fceb82dab3b1ef2b7ac02400fe
|
|
BLAKE2b-256 checksum How to use checksums |
0312f71d779aaa8ce46439d0394937b08c7ac9b5a420b2d57b78a6ebf635aa03
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.14.8
|
Release files / pyautocorpus-0.1.19-cp310-cp310-macosx_10_9_universal2.whl
| Download URL | pyautocorpus-0.1.19-cp310-cp310-macosx_10_9_universal2.whl |
|---|---|
| Size | 44.1 kB |
| Tags | CPython 3.10 macOS 10.9+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
a7436b03c5c55ce019c94db159491543b22a685bd70fc845ce08bf0273f20cb5
|
|
BLAKE2b-256 checksum How to use checksums |
514b98cf4e1d42ad646f157737b7ed963f51feefd801739d660621a24cc16c4e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.11
|
Release files / pyautocorpus-0.1.19-cp39-cp39-win_amd64.whl
| Download URL | pyautocorpus-0.1.19-cp39-cp39-win_amd64.whl |
|---|---|
| Size | 6.7 kB |
| Tags | CPython 3.9 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
8a282bde588b4c86de70546aedee47e9654104888cda4e445f8a7395956a3d79
|
|
BLAKE2b-256 checksum How to use checksums |
4e6e595092a3276d34c72ccdb226850884b523bf22a5b4791791ba0b9a687fff
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.9.13
|
Release files / pyautocorpus-0.1.19-cp39-cp39-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
| Download URL | pyautocorpus-0.1.19-cp39-cp39-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl |
|---|---|
| Size | 370.8 kB |
| Tags | CPython 3.9 Linux glibc 2.24+ x86-64 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
b3d02840e1508dba428444d5101e3938414c71888f90882bdda14feb8b36a519
|
|
BLAKE2b-256 checksum How to use checksums |
69b34c01a6a4732d3952283a5c994b44210a6e3c7854e76816dbfedaf3d0264b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.14.8
|
Release files / pyautocorpus-0.1.19-cp39-cp39-macosx_10_9_universal2.whl
| Download URL | pyautocorpus-0.1.19-cp39-cp39-macosx_10_9_universal2.whl |
|---|---|
| Size | 44.1 kB |
| Tags | CPython 3.9 macOS 10.9+ universal2 (ARM64, x86-64) |
|
SHA-256 checksum How to use checksums |
8516a8ecd548c05dd8be9d74613844786c8ac3e516d3ae4d01ffbdcde915abfa
|
|
BLAKE2b-256 checksum How to use checksums |
38cdf221a3d19045e2c8b508c616d8e774097d4b6e073a4d188e0cd2b5257519
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.9.13
|