verskyt 0.2.4

Python library for Tversky Neural Networks with research tools for model introspection and prototype analysis

Verskyt

A versatile toolkyt for Tversky Neural Networks

Verskyt (pronounced "ver-SKIT") is a Python library for Tversky Neural Networks (TNNs) built on three design principles: Modularity, Introspection, and Extensibility. Verskyt provides PyTorch-compatible TNN implementations alongside tools for model introspection, prototype analysis, and causal interventions.

What are Tversky Neural Networks?

Tversky Neural Networks represent a novel paradigm in deep learning, introduced by Doumbouya et al. (2025). TNNs replace traditional linear transformations with similarity-based computations grounded in cognitive science, specifically Tversky's feature-based similarity theory. TNNs operate by projecting inputs into a learned feature space (Ω), where similarity to explicit prototypes (Π) is computed.

Key TNN Properties:

• Psychologically Plausible: Based on established cognitive models of human similarity perception
• Asymmetric Similarity: Can learn that "A is more similar to B than B is to A" (unlike standard neural networks)
• Interpretable Representations: Uses explicit prototypes and feature sets that can be directly examined
• Non-linear Single Layer: Can solve non-linearly separable problems (like XOR) with just one layer

What Verskyt Provides

Design Principles:

🔧 Modularity: Clean, composable components that integrate with existing PyTorch workflows 🔍 Introspection: Tools for examining model internals, learned prototypes, and decision processes 🚀 Extensibility: Built for researchers to modify and develop novel TNN-based architectures

🧠 TNN Implementation

PyTorch Integration:

• Drop-in Compatibility: Replace torch.nn.Linear layers with verskyt.TverskyProjectionLayer in existing models
• Full Parameter Control: All TNN components (prototypes (Π), features (Ω), and asymmetry parameters (α, β)) are learnable and accessible
• Full Specification: All 6 intersection reduction methods and 2 difference methods from the original paper
• Tested Implementation: Passes mathematical correctness tests, including the XOR non-linearity benchmark

🔬 Research Tools

Verskyt includes research tools for TNN exploration and development:

Model Introspection:

• Prototype Analysis: Examine learned prototype vectors and their semantic meanings
• Feature Bank Inspection: Understand which features the model has discovered
• Similarity Landscape Mapping: Visualize how the model perceives relationships between concepts

Visualization Suite:

• Prototype Space Visualization: PCA and t-SNE plots of learned prototype distributions
• Data Clustering Analysis: See how input data clusters around different prototypes
• Feature-Prototype Relationships: Advanced analysis of internal similarity computations
• Interactive Research Tools: High-quality plots for papers and presentations

Causal Intervention Framework:

• Prototype Surgery: Directly edit model concepts and observe behavioral changes
• Counterfactual Analysis: Simulate "what if" scenarios by modifying internal representations
• Concept Grafting: Transfer learned concepts between different models

Experimental Infrastructure:

• Benchmark Suites: Testing against paper specifications
• Reproducible Research: Tools for systematic hyperparameter exploration and results validation

Quick Start

Install from PyPI: pip install verskyt

Basic Usage: Drop-in Replacement

verskyt layers are designed as drop-in replacements for standard PyTorch layers.

import torch
from verskyt.layers import TverskyProjectionLayer

# A TNN layer that can replace nn.Linear(in_features=128, out_features=10)
layer = TverskyProjectionLayer(
    in_features=128,      # Dimensionality of the input vector
    num_prototypes=10,    # Corresponds to output classes
    num_features=256,     # Dimensionality of the internal learned feature space (Ω)
)

# It works just like a standard PyTorch layer
x = torch.randn(32, 128)
output = layer(x)  # shape: [32, 10]

Advanced Usage: Introspection & Intervention

Inspect and modify model internals using the intervention toolkit:

from verskyt.interventions import InterventionManager

# Assume 'model' is a trained model with TverskyProjectionLayer
manager = InterventionManager(model)

# 1. Inspect the model's learned concepts
prototypes = manager.list_prototypes()
print(f"Inspecting {len(prototypes)} learned prototypes.")

# 2. Examine individual prototypes and features
proto_info = manager.get_prototype("layer_name", 0)
print(f"Prototype 0: shape={proto_info.shape}, norm={proto_info.norm:.3f}")

# 3. Permanently edit a prototype ("prototype surgery")
original_proto = manager.get_prototype("layer_name", 0)
modified_vector = original_proto.vector * 0.5  # Dampen the prototype
manager.modify_prototype("layer_name", 0, modified_vector)

# 4. Reset to original state when done
manager.reset_to_original()

Library Implementation Status

Verskyt provides a complete, production-ready implementation of TNNs with research capabilities:

Implementation Area	Component	Status
TNN Core	TverskyProjectionLayer	✅ Complete - Drop-in PyTorch compatibility
	TverskySimilarityLayer	✅ Complete - All similarity computations
	Intersection Methods	✅ Complete - All 6 from paper: product, min, max, mean, gmean, softmin
	Difference Methods	✅ Complete - Both substractmatch & ignorematch
Paper Validation	XOR Benchmark	✅ Complete - Non-linearity verified
	Mathematical Correctness	✅ Complete - All specifications validated
Research Tools	InterventionManager	✅ Complete - Prototype surgery & analysis
	FeatureGrounder	✅ Complete - Concept mapping framework
	Prototype Analysis	✅ Complete - Introspection APIs
	Visualization Suite	✅ Complete - PCA/t-SNE prototype analysis
Development	Comprehensive Testing	✅ Complete - 60+ tests, 75% coverage
	CI/CD Pipeline	✅ Complete - Automated quality & releases
	Documentation Site	✅ Complete - Automated docs building and publishing

🚀 Future Work

Verskyt continues expanding its research toolkit capabilities:

• Interactive Visualization Suite: ✅ Complete - Tools for prototype visualization, similarity landscapes, and intervention impact analysis
• Extended Benchmark Suite: Evaluation across more datasets and TNN configurations
• Performance Profiling: Optimization for large-scale models and training efficiency
• TverskyResNet Implementation: Pre-built architecture demonstrating TNN integration in complex models
• Concept Transfer Tools: Framework for moving learned concepts between different TNN models
• Uncertainty Quantification: Tools for measuring confidence in TNN predictions and prototype assignments
• Multi-Modal Extensions: Extend TNN concepts to handle different data modalities simultaneously

Examples & Visualizations

Verskyt includes comprehensive examples demonstrating all capabilities:

🎨 Visualization Demo

examples/visualization_demo.py - Complete visualization showcase:

• Prototype space analysis with PCA and t-SNE
• Data clustering by prototype similarity
• Advanced prototype-feature relationship analysis
• XOR problem demonstration

Learned prototype space visualized with PCA and t-SNE

🔬 Research Examples

• Research Tutorial - Advanced TNN research workflows
• Intervention Demo - Prototype surgery and causal analysis

Installation for visualizations:

pip install verskyt[visualization]

Documentation

For complete usage guides, tutorials, and the API reference, please see the Full Documentation Website.

• Examples Directory - All example scripts with comprehensive documentation
• Visualization Guide - Step-by-step tutorial for using the visualization suite
• API Reference - Complete function documentation

Contributing

Contributions are welcome! Please see our development and contribution guidelines.

Citation

If you use Verskyt in your research, please cite both the original Tversky Neural Network paper and this library.

1. Foundational Paper:

@article{doumbouya2025tversky,
  title={Tversky Neural Networks: Psychologically Plausible Deep Learning with Differentiable Tversky Similarity},
  author={Doumbouya, Moussa Koulako Bala and Jurafsky, Dan and Manning, Christopher D.},
  journal={arXiv preprint arXiv:2506.11035},
  year={2025}
}

2. This Library (Verskyt):

We recommend citing the specific version of the software you used. You can get a persistent DOI for each version from Zenodo.

@software{smith_2025_verskyt,
  author       = {Smith, Jeff},
  title        = {{Verskyt: A versatile toolkyt for Tversky Neural Networks}},
  month        = aug,
  year         = 2025,
  publisher    = {Zenodo},
  version      = {v0.2.4},
  doi          = {10.5281/zenodo.17014431},
  url          = {https://doi.org/10.5281/zenodo.17014431}
}