ESA-Wiki
Explicit Semantic Analysis based on Wikipedia
This is a python library which contains code to 1) construct a semantic interpreter based on data from Wikipedia and 2) apply this to various kinds of texts.
To construct an interpreter, first obtain a Wikipedia XML dump from http://dumps.wikimedia.org/enwiki/
-
Then run
python3 -m esa_wiki.xml_parse <file>with the downloaded file as its argument. This outputs some temporary files containing information on the words, links and articles encountered. -
Next, run
python3 -m esa_wiki.generate_indicesto generate lists of indices corresponding to unique words and articles encountered -
Finally, run
python3 -m esa_wiki.matrix_builderto construct a very large sparse interpretation matrix. Each row corresponds to a unique word, each column to a 'concept', i.e. a Wikipedia article, and each entry is the TF-IDF score for word i in article j. The Matrix is saved in separate chunks to conserve memory.
medium_wiki.xml can be used as an example file for demonstration/testing purposes, as it contains only the first 100 or so Wikipedia articles.
cunning_linguistics.py then contains classes to perform text analysis and harvest tweets for analysis.
1 maintainer
Metadata
1 maintainer
Release files for esa-wiki 0.0.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| esa_wiki-0.0.1.tar.gz | 15.0 kB | Without provenance | Details for esa_wiki-0.0.1.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| esa_wiki-0.0.1-py3-none-any.whl | Python 3 | none | any | Details for esa_wiki-0.0.1-py3-none-any.whl |
Total release size: 32.3 kB
Release files / esa_wiki-0.0.1.tar.gz
| Download URL | esa_wiki-0.0.1.tar.gz |
|---|---|
| Size | 15.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
78a4bd39e7d340ea8dc76fad00248d6ab1e464649b09f88909e47ac99038c0d3
|
|
BLAKE2b-256 checksum How to use checksums |
a20efa497789f9a3c1a50fdba2ee60d7d765266ddaff51720d78594b7b6f9177
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.5.0.1 requests/2.18.4 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.23.3 CPython/3.6.5
|
Release files / esa_wiki-0.0.1-py3-none-any.whl
| Download URL | esa_wiki-0.0.1-py3-none-any.whl |
|---|---|
| Size | 17.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
3571a5fe21f8692761a2f1a4f3b663f91942e878f53bc6ea2078868c5888e5ee
|
|
BLAKE2b-256 checksum How to use checksums |
0ee09d54bc3e1ddadf03eb26cd730d61f2ac13201d1d629aca0952a624ab3d4b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.5.0.1 requests/2.18.4 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.23.3 CPython/3.6.5
|
Security for esa-wiki 0.0.1
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
