An ESA implementation in python.
Project description
Get the required resources
scp -r webis@webislab40.medien.uni-weimar.de:/home/weci2587/projects/args-topic-modeling/resources .
To run the ESA-script with all terms run:
For normal ESA:
./esa-all-terms.py --similarity cos
--matrix-path <path_to_resources>/resources/esa-plain/<debatepedia|strategic-intelligence|wikipedia>.mat
--model-path <path_to_resources>/resources/esa-w2v/GoogleNews-vectors-negative300.bin
--model-vocab <path_to_resources>/resources/esa-w2v/w2v-vocab.p
--input-path <path_to_input_file>
--output-path <path_to_output_file>
For word2vec-ESA:
./esa-all-terms.py --similarity max
--matrix-path <path_to_resources>/resources/esa-w2v/<debatepedia|strategic-intelligence|wikipedia>.mat
--model-path <path_to_resources>/resources/esa-w2v/GoogleNews-vectors-negative300.bin
--model-vocab <path_to_resources>/resources/esa-w2v/w2v-vocab.p
--input-path <path_to_input_file>
--output-path <path_to_output_file>
To run the word2vec-ESA with reduced terms run:
./esa-top-n-terms.py -n <number_of_terms>
--corpus-path <path_to_resources>/resources/corpora/<debatepedia|strategic-intelligence|wikipedia>.csv
--model-path <path_to_resources>/resources/esa-w2v/GoogleNews-vectors-negative300.bin
--model-vocab <path_to_resources>/resources/esa-w2v/w2v-vocab.p
--input-path <path_to_input_file>
--output-path <path_to_output_file>
The input document must be a csv file with "|" as the separator and must contain the column "document", which is used as the input text for the ESA.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for sklearn_esa-0.0.4.linux-x86_64.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 03698b4f91b6871ab1ad2049eb2a81607ec9cfa751fd87c883a0318cd2b7b894 |
|
MD5 | 3d1cf8b694489fd0f47f1b0a89cbefea |
|
BLAKE2b-256 | d477e47a873b734ad44da41c428054137b9550fee79c9af1916691abdf2c2f47 |
Close
Hashes for sklearn_esa-0.0.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f8f7a9e8a686ed8955a512f225c84fc1f9f9e5007382f2d93c59abaac5e24ca8 |
|
MD5 | 8e86cde806c8ec1d702ee8658aa4c4d6 |
|
BLAKE2b-256 | 80aebf50d81da5847dcc330372e8be496b3afc05f5e15973b5b543ca7dec42e3 |