SST Utils
Utilities for downloading, importing, and visualizing the Stanford Sentiment Treebank, a dataset capturing fine-grained sentiment over movie reviews.
See examples below for usage. Tested in Python 3.4.3 and 2.7.12.
Javascript code by Jason Chuang and Stanford NLP modified and taken from Stanford NLP Sentiment Analysis demo.
Visualization
Allows for visualization using Jason Chuang's Javascript and CSS within an IPython notebook:
import pytreebank
# load the sentiment treebank corpus in the parenthesis format,
# e.g. "(4 (2 very ) (3 good))"
dataset = pytreebank.load_sst()
# add Javascript and CSS to the Ipython notebook
pytreebank.LabeledTree.inject_visualization_javascript()
# select and example to visualize
example = dataset["train"][0]
# display it in the page
example.display()
Lines and Labels
To use the corpus to output spans from the different trees you can call the to_labeled_lines and to_lines method of a LabeledTree. The first returned sentence in those lists is always the root sentence:
import pytreebank
dataset = pytreebank.load_sst()
example = dataset["train"][0]
# extract spans from the tree.
for label, sentence in example.to_labeled_lines():
print("%s has sentiment label %s" % (
sentence,
["very negative", "negative", "neutral", "positive", "very positive"][label]
))
Download/Loading control:
Change the save/load directory by passing a path (this will look for
train.txt, dev.txt and test.txt files under the directory).
dataset = pytreebank.load_sst("/path/to/sentiment/")
To just load a single dataset file:
train_data = pytreebank.import_tree_corpus("/path/to/sentiment/train.txt")
1 maintainer
Release files for pytreebank 0.2.7
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| pytreebank-0.2.7.tar.gz | 34.6 kB | Details |
Release files / pytreebank-0.2.7.tar.gz
| Download URL | pytreebank-0.2.7.tar.gz |
|---|---|
| Size | 34.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
f0c6fde639739d356d4994d432476903421d216b3e2f11a620c3118e47aa675f
|
|
BLAKE2b-256 checksum How to use checksums |
e012626ead6f6c0a0a9617396796b965961e9dfa5e78b36c17a81ea4c43554b1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/42.0.2 requests-toolbelt/0.9.1 tqdm/4.42.0 CPython/3.7.6
|
