Frequency vocabulary for NLP purposes
Project description
nlpvocab
Tokens frequency counter with save/load features. Supports save/load with Pickle and TSV formats.
Usage
from nlpvocab import Vocabulary
text = 'token1 token2 token1 token2 token3'
vocab = Vocabulary()
vocab.update(text.split())
vocab.save('vocab.tsv', format=Vocabulary.FORMAT_TSV_WITH_HEADERS)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
nlpvocab-1.0.1.tar.gz
(3.4 kB
view hashes)