IAR Wikipedia parser
The IAR (Iván Arias Rodríguez) Wikipedia parser is a parser that downloads the Spanish Wikipedia, divides it in smaller chunks, deletes non-content articles and cleans all kind of tags or any other element that is not pure plain text, so it creates a corpus out of the content of the Wikipedia.
The creation of this software was supported by the Spanish Ministry of Education, Culture and Sport via a doctoral grant to Iván Arias Rodríguez (FPU16/04039). It has also been funded by research projects TIN2014-52010-R (RedR+Human) and TIN2017-88092 R (CetrO+Spec).
You can install this software with pip :
pip install iar-wiki-parser
If you change or adapt a function, change its name (for example add your initial after the name)
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
http://creativecommons.org/licenses/by-nc-sa/4.0/
This code is given as is without warranty of any kind. In no event shall the authors or copyright holder be liable for any claim damages or other liability.
El IAR (Iván Arias Rodríguez) Wikipedia parser is un analizador que se descarga el contenido de la Wikipedia en español, la divide en trozos más pequeños, borra los artículos sin contenido enciclopédico y limpia todo tipo de etiquetas y cualquier otro elemento que no es puramente texto sin formato, de manera que crea un corpus a partir del contenido de la Wikipedia.
La creación de este software fue apoyada por el Ministerio de Educación, Cultura y Deporte de España, a través de una beca doctoral otorgada a Iván Arias Rodríguez (FPU16/04039). También ha sido financiado por los proyectos de investigación TIN2014-52010-R (RedR+Human) y TIN2017-88092 R (CetrO+Spec).
Puedes instalar este software con pip :
pip install iar-wiki-parser
Si cambias o adaptas una función, cambia su nombre (por ejemplo añade tus iniciales tras el nombre)
Este trabajo se ofrece bajo la licencia Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
http://creativecommons.org/licenses/by-nc-sa/4.0/
Este código se ofrece como es sin ninguna garantía de ningún tipo. En ningún caso los autores o el titular de los derechos de autor serán responsables de cualquier reclamación por daños y perjuicios u otra responsabilidad.
Metadata
Release files for iar-wiki-parser 1.0.7
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| iar-wiki-parser-1.0.7.tar.gz | 25.8 kB | Without provenance | Details for iar-wiki-parser-1.0.7.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| iar_wiki_parser-1.0.7-py3-none-any.whl | Python 3 | none | any | Details for iar_wiki_parser-1.0.7-py3-none-any.whl |
Total release size: 51.1 kB
Release files / iar-wiki-parser-1.0.7.tar.gz
| Download URL | iar-wiki-parser-1.0.7.tar.gz |
|---|---|
| Size | 25.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
59db5a06ad7c5098f6d50319f20888f7079f5ef838e7ec92d1ec4b18acc876e5
|
|
BLAKE2b-256 checksum How to use checksums |
8da6e84d59ea371e1b2ceeb4fd905dddd5ad2b49dcad98bd4c11a9ff8332f0ea
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.5.0.1 requests/2.22.0 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.7.2
|
Release files / iar_wiki_parser-1.0.7-py3-none-any.whl
| Download URL | iar_wiki_parser-1.0.7-py3-none-any.whl |
|---|---|
| Size | 25.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
fa6c92afef9ff2aa0e2d70039ab647e00fedfb12f67b73f9004b61fc75c1063a
|
|
BLAKE2b-256 checksum How to use checksums |
799daf864022a0065075e708d354bb0912f849d4096af2820bd1e06dfa00d4c8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.5.0.1 requests/2.22.0 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.7.2
|
Security for iar-wiki-parser 1.0.7
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.