Haystack 2.x component to embed strings and Documents using fastembed embedding model
Project description
fastembed-haystack
Table of Contents
Installation
pip install fastembed-haystack
Usage
You can use FastembedTextEmbedder
and FastembedDocumentEmbedder
by importing as:
from haystack_integrations.components.embedders.fastembed import FastembedTextEmbedder
text = "fastembed is supported by and maintained by Qdrant."
text_embedder = FastembedTextEmbedder(
model="BAAI/bge-small-en-v1.5"
)
text_embedder.warm_up()
embedding = text_embedder.run(text)["embedding"]
from haystack_integrations.components.embedders.fastembed import FastembedDocumentEmbedder
from haystack.dataclasses import Document
embedder = FastembedDocumentEmbedder(
model="BAAI/bge-small-en-v1.5",
)
embedder.warm_up()
doc = Document(content="fastembed is supported by and maintained by Qdrant.", meta={"long_answer": "no",})
result = embedder.run(documents=[doc])
You can use FastembedSparseTextEmbedder
and FastembedSparseDocumentEmbedder
by importing as:
from haystack_integrations.components.embedders.fastembed import FastembedSparseTextEmbedder
text = "fastembed is supported by and maintained by Qdrant."
text_embedder = FastembedSparseTextEmbedder(
model="prithvida/Splade_PP_en_v1"
)
text_embedder.warm_up()
embedding = text_embedder.run(text)["embedding"]
from haystack_integrations.components.embedders.fastembed import FastembedSparseDocumentEmbedder
from haystack.dataclasses import Document
embedder = FastembedSparseDocumentEmbedder(
model="prithvida/Splade_PP_en_v1",
)
embedder.warm_up()
doc = Document(content="fastembed is supported by and maintained by Qdrant.", meta={"long_answer": "no",})
result = embedder.run(documents=[doc])
License
fastembed-haystack
is distributed under the terms of the Apache-2.0 license.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
fastembed_haystack-0.1.0.tar.gz
(15.2 kB
view hashes)
Built Distribution
Close
Hashes for fastembed_haystack-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 67bcadcf5b1c329b4ec04000ebbc9be5a32997aa0b1bc839dff728b05bd2f8cb |
|
MD5 | 39bf812903c91f22b977942374f5cde3 |
|
BLAKE2b-256 | 2c567d764b359daab4d0a1893e501d3c5033051cb5a03c77d743e93cba62ae8b |