SERAPH — ONNX Runtime Backend

Maximum encoder throughput on NVIDIA GPUs.

This is the ONNX Runtime variant of SERAPH. It uses the ONNX Runtime CUDA Execution Provider for encoding, delivering ~3x faster ingest throughput compared to the standard GPU (candle) build.

For the standard build that works everywhere (GPU with CPU fallback), install seraph-db instead.

Install

pip install seraph-db-onnx

This automatically installs onnxruntime-gpu as a dependency. SERAPH discovers the ORT shared libraries from the installed package at runtime.

GPU Requirements (optional)

For CUDA-accelerated encoding:

NVIDIA GPU with compute capability >= 7.0 (Volta or newer)
NVIDIA driver >= 580 on Windows, >= 560 on Linux (the two are built with different CUDA toolkits, which sets the PTX floor)
CUDA toolkit with cuBLAS and cuDNN 9.x — CUDA 11.x, 12.x and 13.x are all detected

If the CUDA EP fails to initialize (missing toolkit, incompatible driver), encoding falls back to CPU automatically — no configuration needed.

Advanced: Custom ORT Location

Set ORT_DYLIB_PATH to override the default ORT discovery:

ORT_DYLIB_PATH=/path/to/onnxruntime.dll python my_app.py

Quick Start

import seraph

cfg = seraph.StoreConfig(model_id="BAAI/bge-small-en-v1.5")
store = seraph.SeraphStore.create("my_store.sfg", cfg)

text = "The quick brown fox jumps over the lazy dog."
store.put(text.encode(), store.encode(text))    # content bytes + embedding

for hit in store.search_text("fast animal"):     # text query, encodes internally
    print(f"{hit.score:.3f}  {hit.snippet}")

store.close()

The API is identical to seraph-db — only the encoder backend differs.

API Reference

Licensing

SERAPH is proprietary software licensed by Tree D Interactive LLC. See the License Agreement and Pricing Schedule for full terms.

Metadata

Release files for seraph-db-onnx 0.4.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for seraph-db-onnx 0.4.0
File	Interpreter	ABI	Platform	Reset
seraph_db_onnx-0.4.0-cp38-abi3-win_amd64.whl 6.8 MB Oct 24, 2026 Without provenance	CPython 3.8	abi3	Windows x86-64	Details
seraph_db_onnx-0.4.0-cp38-abi3-manylinux2014_x86_64.whl 7.6 MB Oct 24, 2026 Without provenance	CPython 3.8	abi3	Linux glibc 2.17+ x86-64	Details

Total release size: 14.4 MB

Release files / seraph_db_onnx-0.4.0-cp38-abi3-win_amd64.whl

Download URL	seraph_db_onnx-0.4.0-cp38-abi3-win_amd64.whl
Size	6.8 MB
Tags	CPython 3.8 Windows x86-64 abi3
SHA-256 checksum How to use checksums	`f1fde2603c83fa1c98106f48c75ebb80011f9704437b1103632d05fdfb72bd50`
BLAKE2b-256 checksum How to use checksums	`718b7f9ebe086568f083959128e629db65eead08fabb72b49d8fc9dd8b8d7a4d`
Upload date	Oct 24, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.13.2`

Release files / seraph_db_onnx-0.4.0-cp38-abi3-manylinux2014_x86_64.whl

Download URL	seraph_db_onnx-0.4.0-cp38-abi3-manylinux2014_x86_64.whl
Size	7.6 MB
Tags	CPython 3.8 Linux glibc 2.17+ x86-64 abi3
SHA-256 checksum How to use checksums	`e4b36fa21a4df2df41b5d29ca72fabbf29c984a0be05eb945c17683bb4284ff2`
BLAKE2b-256 checksum How to use checksums	`2131dffcaed83bfa36c8551dc48b496fca025abc7d475bc9273831ef615d7d23`
Upload date	Oct 24, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.13.2`

Security for seraph-db-onnx 0.4.0

Report project as malware

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.