embedding-adapter 0.1.0

A lightweight open-source package to fine-tune embedding models.

Embedding Adapter 💬 📐

Finetune embedding models in just 4 lines of code.

from embedding_adapter import EmbeddingAdapter
adapter = EmbeddingAdapter()
EmbeddingAdapter.fit(query_embeddings, document_embeddings, labels)
EmbeddingAdapter.transform(new_embeddings)

Once you've trained the adapter, you can use patch your pre-trained embedding model.

patch = EmbeddingAdapter.patch()
adapted_embeddings = patch(original_embedding_fn("SAMPLE_TEXT"))

Synthetic Label Generation

No user feedback to use as labels? 🤔 Create synthetic label the LabelGenerator util

from embedding_adapter.utils import LabelGenerator
generator = LabelGenerator()
generator.run()

Note: This requires an OpenAI API key saved as an OPENAI_API_KEY env var.

Installation 🔧

pip install embedding_adapter

License 📄

This project is licensed under the MIT License.