narsche 0.1.0

Computing schematicity of autobiographical narratives

Measuring narrative schematicity

Methods from the paper "Computational Tools for Quantifying Schemas in Autobiographical Narratives".

Installation

[Under construction until this project is on PyPI]

Depends on networkx (for network models), SpaCy (for tokenization), and wordfreq for automated topic identification. Additionally, one of SpaCy's models must be downloaded (see their instructions on how to do this).

Usage

Loading and saving models

A text file of word vectors can be read using the read_vectors() function:

vec_mod = narsche.read_vectors('/path/to/vectors.txt')

This produces a vector model. Initializing a network model requires first loading a networkx.Graph object:

import networkx as nx

graph = nx.load('/path/to/graph')
net_mod = narsche.NetworkModel(graph)

Models can be saved using the save() method and loaded using the load() class method:

net_mod.save('network.mod')
net_mod = narsche.NetworkModel.load('network.mod')

vec_mod.save('vector.mod')
vec_mod = narsche.VectorModel.load('vector.mod')

These are just wrappers around pickle.[load/dump]. Any extension can be used.

Tokenizing narratives

Before schematicity can be computed, narratives must be tokenized, i.e., converted to a list of tokens. For this, there is a Tokenizer() class that relies on SpaCy:

txt = 'I sat on the sofa in my living room with a lamp' # Example text
tokenizer = narsche.Tokenizer('en_core_web_sm') # Initialize tokenizer
words = tokenizer.tokenize(txt) # Tokenize words
words = vec_mod.keep_known(words) # Use only those words that are in the model

Computing schematicity

Given a model and a set of tokens (and possibly a topic word), schematicity can be computed using the schematicity() function:

topic = narsche.identify_topic(words) # Identify the topic
# Compute schematicity
narsche.schematicity(
	words=words,
	model=mod,
	method='on-topic-ppn', # or topic-relatedness, pairwise-relatedness, or component-size
	topic=topic)

See the documentation of the schematicity() function for kewords required by other methods.