counterix

A small toolkit to generate count-based PPMI-weighed SVD Distributional Semantic Models.

Install

pip install counterix

or, after a git clone:

python3 setup.py install

To generate a raw count matrix from a tokenized corpus, run:

counterix generate \
  --corpus /abs/path/to/corpus/txt/file \
  --min-count frequency_threshold \
  --win-size window_size

If the --output parameter is not set, the output files will be saved to the corpus directory.

To weigh a raw count model with PPMI, run:

counterix weigh --model /abs/path/to/raw/count/npz/model

To apply SVD on a PPMI-weighed model, with k=10000, run:

counterix svd \
  --model /abs/path/to/ppmi/npz/model \
  --dim singular_vectors_final_dim

To control the number of threads used during SVD, run counterix with env OMP_NUM_THREADS=1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution for counterix 1.2.2
File	Size	Uploaded
counterix-1.2.2.tar.gz	6.4 kB	Aug 17, 2020	Details

Download URL	counterix-1.2.2.tar.gz
Size	6.4 kB
Tags	Source
SHA-256 checksum How to use checksums	`20f6a1eab665c5d27cbd97aea8272d3461abd62041bed39c11c5e347657dc1cc`
BLAKE2b-256 checksum How to use checksums	`a6fda2a94766afe726f8e1502bdd2b6a963fe07c066e9449429130b45fb868b3`
Upload date	Aug 17, 2020
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.35.0 CPython/3.6.5`