Sentence Topic Prediction using Topic Modeling
sptm: Sentence Topic Prediction using Topic Modeling
sptm is a high-level API, written in Python and capable of training Topic Models using Gensim and MALLET. It was developed as a summer internship project under the guidance of @Anupam Mediratta. The package was wriiten with a focus on enabling fast experimentation. Being able to go from idea to result with the least possible delay is key to doing good research.
Use sptm if you need a library that:
- Allows for easy and fast topic model training
- Draw Inter-topic Distance Maps
- Construct Conditional Probability Matrix for topics
- Predict topic of sentences
Read the documentation at [sptm_source]/docs/_build/html/index.html.
sptm is compatible (tested) with: Python 3.7.
Some good stuff about sptm
User friendliness. The source code is very simple to follow
Modularity. You can use your own models, training algorithms etc. as long as it is supported by gensim
Getting started: 30 seconds to sptm
In the test folder of the repository, you will find a single script with almost all classes and functions used.
sptm makes use of MALLET whose installtion steps can be found here.
This is required only if you want to train the topic model using gensim's LDAMallet wrapper that is the default training algorithm used in sptm.
Then, you can install sptm itself. There are two ways to install sptm:
- Install sptm from PyPI (recommended):
sudo pip3 install sptm
If you are using a virtualenv, you may want to avoid using sudo:
pip3 install sptm
- Alternatively: install sptm from the GitHub source:
First, clone sptm using
git clone https://github.com/Rochan-A/sptm.git
cd to the sptm folder and run the install command:
cd sptm sudo python3 setup.py install
- NOTE: You will need to specifically download spacy's en_core_web_sm model.
This step needs to be done irrespective the method of installation.
You can do that by running:
python3 -m spacy download en_core_web_sm
Why name it sptm?
sptm stands for - Sentence topic Prediction using Topic Modeling
Why is this readme oddly familiar?
This README is a heavily edited version of keras's
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.