tokenlearn-static-model 0.1.1

Rust-accelerated static embedding model with baked-in 10k/64d/int8 weights.

Rust + Python Inference

This package provides:

• A Rust encoder core (tokenizers + safetensors) for static Model2Vec-style embeddings.
• A Python wrapper API:
  • from static_model import get_embeddings

The default 10k/64d/int8 model files are baked into the package under static_model/model/.

Python Install

pip install .

Python Usage

from static_model import get_embeddings

embeddings = get_embeddings(["Hello", "World"])  # list[list[float]]
single_embedding = get_embeddings("Hello World")  # list[float]