VantaDB × LiteLLM
PyO3 cdylib that exposes a VantaDBLiteLLM class — a unified embedding provider that generates embeddings through LiteLLM's embedding() gateway and stores/searches them in VantaDB.
Install
Not on PyPI yet. The
vantadb-litellmwheel builds on all release platforms; it goes live with the firstproviders-v*tag release. Until then, build from a repo checkout.
From PyPI (after the first release)
pip install vantadb-litellm
The LiteLLM SDK is installed automatically (litellm>=1.0,<2).
From source
Requires Python 3.11+ and the LiteLLM SDK. Build the extension with maturin:
pip install litellm
maturin develop --release
Quickstart
from vantadb_litellm import VantaDBLiteLLM
store = VantaDBLiteLLM("/tmp/vantadb-litellm", timeout=30)
emb = store.embed(["hello world"])
rid = store.store("hello world", emb[0], metadata={"lang": "en"})
results = store.search("litellm_store", emb[0], top_k=5)
print(rid, results)
API
| Method | Signature | Description |
|---|---|---|
embed |
embed(texts) -> list[list[float]] |
Generate embeddings via litellm.embedding(); forwards timeout (seconds) when set. |
store |
store(text, embedding, metadata=None, key=None) -> str |
Store a record; returns "<namespace>:<key>". key upserts at a deterministic key, else auto-generated. Metadata values must be str/bool/int/float. |
search |
search(namespace, query_embedding, text_query=None, filters=None, distance_metric=None, top_k=10) -> list[dict] |
Hybrid vector + BM25 search (distance_metric: "cosine" or "euclidean"/"l2"). Returns full records plus score. |
get |
get(namespace, key) -> dict | None |
Retrieve a single record, or None if not found. |
list |
list(namespace, limit=100, cursor=None) -> dict |
Paginated listing: {"records": [...], "next_cursor": int | None}. |
delete |
delete(key, namespace=None) -> bool |
Delete a record by key; defaults to the instance namespace. |
list_namespaces |
list_namespaces() -> list[str] |
All namespaces containing at least one record. |
Constructor options: VantaDBLiteLLM(db_path, api_key=None, model="text-embedding-3-small", namespace="litellm_store", timeout=None).
1 maintainer
Metadata
1 maintainer
Release files for vantadb-litellm 0.9.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Reset | |||
|---|---|---|---|---|
| vantadb_litellm-0.9.0-cp311-abi3-win_amd64.whl | CPython 3.11 | abi3 | Windows x86-64 | Details |
| vantadb_litellm-0.9.0-cp311-abi3-manylinux_2_28_x86_64.whl | CPython 3.11 | abi3 | Linux glibc 2.28+ x86-64 | Details |
| vantadb_litellm-0.9.0-cp311-abi3-manylinux_2_28_aarch64.whl | CPython 3.11 | abi3 | Linux glibc 2.28+ ARM64 | Details |
| vantadb_litellm-0.9.0-cp311-abi3-macosx_11_0_arm64.whl | CPython 3.11 | abi3 | macOS 11.0+ ARM64 | Details |
Total release size: 7.4 MB
Release files / vantadb_litellm-0.9.0-cp311-abi3-win_amd64.whl
| Download URL | vantadb_litellm-0.9.0-cp311-abi3-win_amd64.whl |
|---|---|
| Size | 1.7 MB |
| Tags | CPython 3.11 Windows x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
3bc2ac95a6138c413b81847219ba6473df14888737698c3ea682cff59a781e80
|
|
BLAKE2b-256 checksum How to use checksums |
7f10d1712674f95f6562a7a9884f3cc85a4fe131c8839a921876e77f4c44e6cd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Release files / vantadb_litellm-0.9.0-cp311-abi3-manylinux_2_28_x86_64.whl
| Download URL | vantadb_litellm-0.9.0-cp311-abi3-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 2.0 MB |
| Tags | CPython 3.11 Linux glibc 2.28+ x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
5fcef40effcc38f6888c4a9ec8d1083fd213a08aa4a933deebaa5186cff4d613
|
|
BLAKE2b-256 checksum How to use checksums |
b97e8fee7cf11b5790a04da971c247aca25205c80f9e0fb44f827af31c733b8e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Release files / vantadb_litellm-0.9.0-cp311-abi3-manylinux_2_28_aarch64.whl
| Download URL | vantadb_litellm-0.9.0-cp311-abi3-manylinux_2_28_aarch64.whl |
|---|---|
| Size | 1.9 MB |
| Tags | CPython 3.11 Linux glibc 2.28+ ARM64 abi3 |
|
SHA-256 checksum How to use checksums |
f1cb05d230df6d75d209262ca69f6e3ccfdb33c8444a555d512984646a0283ca
|
|
BLAKE2b-256 checksum How to use checksums |
ac3edfa6a9f847239d7c8cb28135c2b5fb1f57d203a318c6155d8bf88c188fa9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Release files / vantadb_litellm-0.9.0-cp311-abi3-macosx_11_0_arm64.whl
| Download URL | vantadb_litellm-0.9.0-cp311-abi3-macosx_11_0_arm64.whl |
|---|---|
| Size | 1.8 MB |
| Tags | CPython 3.11 abi3 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
c2427839c21515577a709763418fe7f69f94eedf96f8c9395a1da7a858c66700
|
|
BLAKE2b-256 checksum How to use checksums |
5f786735b0c0c2af79fa10f352e44d54dee522bfd2ccbba0cc75bfe2011d6a65
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Security for vantadb-litellm 0.9.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
