The Sentida Danish sentiment analysis package
Project description
Sentida
Sentida is the state-of-the-art Danish sentiment analysis tool. This is the Python implementation of Sentida with an array of improvements on the previous version originally developed for R. Inspired by the VADER sentiment analysis python implementation.
Authors and Citation
Python implementation of Sentida:
Emma: Danish Computational Analysis of Emotion in Text, 2020 (Søren Orm and Esben Kran)
Originally developed for R:
SENTIDA: A New Tool for Sentiment Analysis in Danish, 2019 (Lars Kjartan Bacher Svendsen, Jacob Aarup Dalsgaard, Gustav Aarup Lauridsen)
For commercial use, please contact: Email: gustavaarup0111@gmail.com, jacdals@hotmail.com
Installation
You can install Sentida through pip with the following command:
pip install sentida
Documentation and examples
from sentida import Sentida
Sentida().sentida(
text,
output = ["mean", "total", "by_sentence_mean", "by_sentence_total"],
normal = True,
speed = ["normal", "fast"]
)
Setting speed to fast drastically reduces sentiment precision in complex sentences but speeds up the process by 180% (10,000 iteration test).
Usage examples:
# Define the class:
SV = Sentida()
_____________________________
SV.sentida(
text = 'Lad der blive fred.',
output = 'mean',
normal = False)
Example of usage:
Lad der bliver fred
Sentiment = 2.0
_____________________________
SV.sentida(
text = 'Lad der blive fred!',
output = 'mean',
normal = False)
With exclamation mark:
Lad der blive fred!
Sentiment = 3.13713
_____________________________
SV.sentida(
text = 'Lad der blive fred!!!',
output = 'mean',
normal = False)
With several exclamation mark:
Lad der blive fred!!!
Sentiment = 3.7896530399999997
_____________________________
SV.sentida(
text = 'Lad der BLIVE FRED',
output = 'mean',
normal = False)
Uppercase:
lad der BLIVE FRED
Sentiment = 3.466
_____________________________
SV.sentida(
text = 'Det går dårligt.',
output = 'mean',
normal = False)
Negative sentence:
Det går dårligt
Sentiment = -1.8333333333333335
_____________________________
SV.sentida(
text = 'Det går ikke dårligt.',
output = 'mean',
normal = False)
Negation in sentence:
Det går ikke dårligt
Sentiment = 1.8333333333333335
_____________________________
SV.sentida(
text = 'Lad der blive fred, men det går dårligt.',
output = 'mean',
normal = False)
'Men' ('but'):
Lad der blive fred, men det går dårligt
Sentiment = -1.5
_____________________________
SV.sentida(
text = 'Lad der blive fred.',
output = 'mean',
normal = True)
Normalized:
Lad der blive fred
Sentiment = 0.4
_____________________________
SV.sentida(
text = 'Lad der bliver fred. Det går dårligt!',
output = 'by_sentence_mean',
normal = False)
Multiple sentences mean:
Lad der bliver fred. Det går dårligt!
Sentiments = [2.0, -2.8757025]
_____________________________
SV.sentida(
text = 'Lad der bliver fred. Det går dårligt!',
output = 'by_sentence_total',
normal = False)
Multiple sentences total:
Lad der bliver fred. Det går dårligt!
Sentiments = [2.0, -5.751405]
_____________________________
Acknowledgements and Context
Thank you to the Sentida team, jry, VADER, AFINN. For license information, see LICENSE.TXT.
The Sentida sentiment analysis tool is freely available for research purposes (please cite Lauridsen et al., 2019 and Kran and Orm, in print). If you want to use the tool for commercial purposes, please contact:
For Python specific inquiries, contact:
Aarhus University, Cognitive Science. 2019 - Cognition & Communication. @authors: sorenorm & esbenkc.
This script was developed along with other tools in an attempt to improve danish sentiment analysis. The tool will be updated as more data is collected and new methods for more optimally asessing sentiment is developed.
Notes
VADER BASIS VALUES
Multiplication values: 0.291, 0.215, and 0.208 for !, !!, and !!! respectively empirically tested by one sentence compared to the three conditions 0.733 for uppercase empirically tested from single control sentence to uppercase version 0.293 for degree modifications from adverbs empirically tested with "extremely"
SENTIDA BASIS VALUES
Currently using VADER basis values Question mark is: XXX Degree modifications for other words are implemented in intensitifer list
- Need implementation of larger intensifier list based on sentences
FUTURE IMPROVEMENTS
Still missing: common phrases, Danish cultural adherence: Exclamation marks, adjusted values for men-sentences, adjusted values for uppercase. More rated words, more intensifiers/mitigators, better solution than snowball stemmer, synonym/antonym dictionary. Social media orientated: emoticons, using multiple letters - i.e. suuuuuper. Better normalization with respect to sub-(-1) and super-(1) output values
References
Lauridsen, G. A., Dalsgaard, J. A., & Svendsen, L. K. B. (2019). SENTIDA: A New Tool for Sentiment Analysis in Danish. Journal of Language Works - Sprogvidenskabeligt Studentertidsskrift, 4(1), 38–53.
Hutto, C. J., & Gilbert, E. (2014, May 16). VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text. Eighth International AAAI Conference on Weblogs and Social Media. Eighth International AAAI Conference on Weblogs and Social Media. https://www.aaai.org/ocs/index.php/ICWSM/ICWSM14/paper/view/8109
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.