Skip to main content

A parser for the Spanish Wikipedia.

Project description

IAR Wikipedia parser

The IAR (Iván Arias Rodríguez) Wikipedia parser is a parser that downloads the Spanish Wikipedia, divides it in smaller chunks, deletes non-content articles and cleans all kind of tags or any other element that is not pure plain text, so it creates a corpus out of the content of the Wikipedia.

The creation of this software was supported by the Spanish Ministry of Education, Culture and Sport via a doctoral grant to Iván Arias Rodríguez (FPU16/04039). It has also been funded by research projects TIN2014-52010-R (RedR+Human) and TIN2017-88092 R (CetrO+Spec).

You can install this software with pip :

pip install iar-wiki-parser

If you change or adapt a function, change its name (for example add your initial after the name)

License: CC BY-NC-SA 4.0 This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. http://creativecommons.org/licenses/by-nc-sa/4.0/

This code is given as is without warranty of any kind. In no event shall the authors or copyright holder be liable for any claim damages or other liability.


El IAR (Iván Arias Rodríguez) Wikipedia parser is un analizador que se descarga el contenido de la Wikipedia en español, la divide en trozos más pequeños, borra los artículos sin contenido enciclopédico y limpia todo tipo de etiquetas y cualquier otro elemento que no es puramente texto sin formato, de manera que crea un corpus a partir del contenido de la Wikipedia.

La creación de este software fue apoyada por el Ministerio de Educación, Cultura y Deporte de España, a través de una beca doctoral otorgada a Iván Arias Rodríguez (FPU16/04039). También ha sido financiado por los proyectos de investigación TIN2014-52010-R (RedR+Human) y TIN2017-88092 R (CetrO+Spec).

Puedes instalar este software con pip :

pip install iar-wiki-parser

Si cambias o adaptas una función, cambia su nombre (por ejemplo añade tus iniciales tras el nombre)

License: CC BY-NC-SA 4.0 Este trabajo se ofrece bajo la licencia Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. http://creativecommons.org/licenses/by-nc-sa/4.0/

Este código se ofrece como es sin ninguna garantía de ningún tipo. En ningún caso los autores o el titular de los derechos de autor serán responsables de cualquier reclamación por daños y perjuicios u otra responsabilidad.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

iar-wiki-parser-1.0.7.tar.gz (25.8 kB view details)

Uploaded Source

Built Distribution

iar_wiki_parser-1.0.7-py3-none-any.whl (25.4 kB view details)

Uploaded Python 3

File details

Details for the file iar-wiki-parser-1.0.7.tar.gz.

File metadata

  • Download URL: iar-wiki-parser-1.0.7.tar.gz
  • Upload date:
  • Size: 25.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.5.0.1 requests/2.22.0 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.7.2

File hashes

Hashes for iar-wiki-parser-1.0.7.tar.gz
Algorithm Hash digest
SHA256 59db5a06ad7c5098f6d50319f20888f7079f5ef838e7ec92d1ec4b18acc876e5
MD5 6ec329ae73ea447ddb7c1ef2bd378129
BLAKE2b-256 8da6e84d59ea371e1b2ceeb4fd905dddd5ad2b49dcad98bd4c11a9ff8332f0ea

See more details on using hashes here.

File details

Details for the file iar_wiki_parser-1.0.7-py3-none-any.whl.

File metadata

  • Download URL: iar_wiki_parser-1.0.7-py3-none-any.whl
  • Upload date:
  • Size: 25.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.5.0.1 requests/2.22.0 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.7.2

File hashes

Hashes for iar_wiki_parser-1.0.7-py3-none-any.whl
Algorithm Hash digest
SHA256 fa6c92afef9ff2aa0e2d70039ab647e00fedfb12f67b73f9004b61fc75c1063a
MD5 6fa8fe1f5fbb7ef9eafcee892059e2c3
BLAKE2b-256 799daf864022a0065075e708d354bb0912f849d4096af2820bd1e06dfa00d4c8

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page