Visual Text Explorer tool. Enables the exploration and text analysis through word frequency and named entity recognition in Jupyter Notebooks
VisualTextAnalyzer help users to understand the text data. It includes word frequency analysis and named entities recognition, which help users to explore the fundamental characteristics of the text data. We use bar charts to create the visualizations integrated with the Jupyter Notebook environment. Word frequency analysis is a frequent task in text analytics. Word frequency measures the most frequently occurring words in a given text. Common stopwords like ‘to’, ‘in’, ‘for’, were removed for the word frequency analysis. Named entity recognition is an information extraction method. The entities that are present in the text are classified into predefined entity types like ‘Person’, ‘Organization’, ‘City’, etc. By using this method, users can get great insights into the types of entities present in the given textual dataset.
In Jupyter Notebook:
import VisualTextAnalyzer import pandas as pd data = pd.read_csv('yelp_labelled_sample.csv') VisualTextAnalyzer.plot_text_summary(data, category_column='category', text_column='comments')
In Jupyter Notebook::
import VisualTextAnalyzer yelp_data = VisualTextAnalyzer.get_yelp_labelled_data() VisualTextAnalyzer.plot_text_summary(yelp_data, category_column='category', text_column='comments')
You might want to export a subset of selected texts for further analyses. To do so, use the following code (after exporting it through the UI):
obj_text = VisualTextAnalyzer.get_exported_texts()
The returned object has the following attributes:
- texts: List of texts.
- category: All texts belong to that category.
- word: All texts contain that word.
Get Processed data (Words and Entities)
You might want to get the processed data, which includes word and entity frequencies, that is ready for analysis before generating the visualization. To do so, use the code:
processed_data = VisualTextAnalyzer.get_words_entities(data, category_column='category', text_column='comments') VisualTextAnalyzer.plot_text_summary(words_entities=processed_data)
The function 'get_words_entities' returns an object that contains has the following attributes:
- words: Word frequencies.
- entities: Entity frequencies.
- raw_texts: All texts separated in two categories: positive and negative.
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|Filename, size||File type||Python version||Upload date||Hashes|
|Filename, size visual_text_explorer-0.1.9-py3-none-any.whl (1.3 MB)||File type Wheel||Python version py3||Upload date||Hashes View|
|Filename, size visual-text-explorer-0.1.9.tar.gz (1.3 MB)||File type Source||Python version None||Upload date||Hashes View|
Hashes for visual_text_explorer-0.1.9-py3-none-any.whl
Hashes for visual-text-explorer-0.1.9.tar.gz