Text Embeddings Inference (TEI)'s unofficial python wrapper library for batch processing with asyncio
Project description
TEI Python
Text Embeddings Inference (TEI)'s unofficial python wrapper library for batch processing with asyncio.
Get Started
pip install teicli
from tei import TEIClient
client = TEIClient()
client.embed_sync("Hello world!")
# [0.010536194, 0.05859375, 0.022262....
routine = client.embed_batch(["Hello world!", "Hello world!", "Hello world!"])
# [[0.010536194, 0.05859375, 0.022262....
You need to run own text-embeddings-inference server. Check here
docker run --gpus all -p 8080:80 -v $volume:/data --pull always ghcr.io/huggingface/text-embeddings-inference:0.3.0 --model-id $model --revision
$revision
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
teicli-0.3.3.tar.gz
(2.6 kB
view hashes)
Built Distribution
teicli-0.3.3-py3-none-any.whl
(2.6 kB
view hashes)