Word2Vec

This is a re-implementation of Word2Vec relying on Tensorflow Estimators and Datasets.

Works with python >= 3.6 and Tensorflow v2.0.

Install

via pip:

pip3 install tf-word2vec

or, after a git clone:

python3 setup.py install

Get data

You can download a sample of the English Wikipedia here:

wget http://129.194.21.122/~kabbach/enwiki.20190120.sample10.0.balanced.txt.7z

Train Word2Vec

w2v train \
  --data /absolute/path/to/enwiki.20190120.sample10.0.balanced.txt \
  --outputdir /absolute/path/to/word2vec/models \
  --alpha 0.025 \
  --neg 5 \
  --window 2 \
  --epochs 5 \
  --size 300 \
  --min-count 50 \
  --sample 1e-5 \
  --train-mode skipgram \
  --t-num-threads 20 \
  --p-num-threads 25 \
  --keep-checkpoint-max 3 \
  --batch 1 \
  --shuffling-buffer-size 10000 \
  --save-summary-steps 10000 \
  --save-checkpoints-steps 100000 \
  --log-step-count-steps 10000

Metadata

Release files for tf-word2vec 1.0.7

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for tf-word2vec 1.0.7
File	Size	Uploaded
tf-word2vec-1.0.7.tar.gz	31.6 kB	Oct 3, 2020	Details

Release files / tf-word2vec-1.0.7.tar.gz

Download URL	tf-word2vec-1.0.7.tar.gz
Size	31.6 kB
Tags	Source
SHA-256 checksum How to use checksums	`eae6ef7988d0718204091edd56a10a6be85142dd571dc1e89072936b99e692a2`
BLAKE2b-256 checksum How to use checksums	`5b7cf08e9ffb6651bfaa38ca7e28bba30cfdc1158c1a276665400f36f777e034`
Upload date	Oct 3, 2020
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.35.0 CPython/3.6.5`