Skip to main content

IAR Wikipedia parser

The IAR (Iván Arias Rodríguez) Wikipedia parser is a parser that downloads the Spanish Wikipedia, divides it in smaller chunks, deletes non-content articles and cleans all kind of tags or any other element that is not pure plain text, so it creates a corpus out of the content of the Wikipedia.

The creation of this software was supported by the Spanish Ministry of Education, Culture and Sport via a doctoral grant to Iván Arias Rodríguez (FPU16/04039). It has also been funded by research projects TIN2014-52010-R (RedR+Human) and TIN2017-88092 R (CetrO+Spec).

You can install this software with pip :

pip install iar-wiki-parser

If you change or adapt a function, change its name (for example add your initial after the name)

License: CC BY-NC-SA 4.0 This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. http://creativecommons.org/licenses/by-nc-sa/4.0/

This code is given as is without warranty of any kind. In no event shall the authors or copyright holder be liable for any claim damages or other liability.


El IAR (Iván Arias Rodríguez) Wikipedia parser is un analizador que se descarga el contenido de la Wikipedia en español, la divide en trozos más pequeños, borra los artículos sin contenido enciclopédico y limpia todo tipo de etiquetas y cualquier otro elemento que no es puramente texto sin formato, de manera que crea un corpus a partir del contenido de la Wikipedia.

La creación de este software fue apoyada por el Ministerio de Educación, Cultura y Deporte de España, a través de una beca doctoral otorgada a Iván Arias Rodríguez (FPU16/04039). También ha sido financiado por los proyectos de investigación TIN2014-52010-R (RedR+Human) y TIN2017-88092 R (CetrO+Spec).

Puedes instalar este software con pip :

pip install iar-wiki-parser

Si cambias o adaptas una función, cambia su nombre (por ejemplo añade tus iniciales tras el nombre)

License: CC BY-NC-SA 4.0 Este trabajo se ofrece bajo la licencia Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. http://creativecommons.org/licenses/by-nc-sa/4.0/

Este código se ofrece como es sin ninguna garantía de ningún tipo. En ningún caso los autores o el titular de los derechos de autor serán responsables de cualquier reclamación por daños y perjuicios u otra responsabilidad.

Metadata

Release files for iar-wiki-parser 1.0.7

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for iar-wiki-parser 1.0.7
File Size Uploaded Provenance Actions
iar-wiki-parser-1.0.7.tar.gz 25.8 kB Without provenance Details for iar-wiki-parser-1.0.7.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for iar-wiki-parser 1.0.7
File Interpreter ABI Platform Actions
iar_wiki_parser-1.0.7-py3-none-any.whl Python 3 none any Details for iar_wiki_parser-1.0.7-py3-none-any.whl

Total release size: 51.1 kB

Release files / iar-wiki-parser-1.0.7.tar.gz

Download URL iar-wiki-parser-1.0.7.tar.gz
Size 25.8 kB
Tags Source
SHA-256 checksum
How to use checksums
59db5a06ad7c5098f6d50319f20888f7079f5ef838e7ec92d1ec4b18acc876e5
BLAKE2b-256 checksum
How to use checksums
8da6e84d59ea371e1b2ceeb4fd905dddd5ad2b49dcad98bd4c11a9ff8332f0ea
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.5.0.1 requests/2.22.0 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.7.2

Release files / iar_wiki_parser-1.0.7-py3-none-any.whl

Download URL iar_wiki_parser-1.0.7-py3-none-any.whl
Size 25.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
fa6c92afef9ff2aa0e2d70039ab647e00fedfb12f67b73f9004b61fc75c1063a
BLAKE2b-256 checksum
How to use checksums
799daf864022a0065075e708d354bb0912f849d4096af2820bd1e06dfa00d4c8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.5.0.1 requests/2.22.0 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.7.2

Security for iar-wiki-parser 1.0.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page