seraph-db-onnx 0.1.2

SERAPH with ONNX Runtime backend — maximum encoder throughput on NVIDIA GPUs

SERAPH — ONNX Runtime Backend

Maximum encoder throughput on NVIDIA GPUs.

This is the ONNX Runtime variant of SERAPH. It uses the ONNX Runtime CUDA Execution Provider for encoding, delivering ~3x faster ingest throughput compared to the standard GPU (candle) build.

For the standard build that works everywhere (GPU with CPU fallback), install seraph-db instead.

---

Install

pip install seraph-db-onnx

ONNX Runtime Dependency

This package ships the SERAPH engine compiled against ONNX Runtime, but does not bundle the ORT shared libraries. You must provide them:

Option 1 — pip (recommended):

pip install onnxruntime-gpu

Option 2 — system install: Download from ONNX Runtime releases and ensure the libraries are on your library search path.

Option 3 — manual placement: Place onnxruntime.dll (Windows) or libonnxruntime.so (Linux) alongside the installed seraph.pyd/seraph.so, or set ORT_DYLIB_PATH to point to them.

Requirements

• NVIDIA GPU with compute capability >= 7.0 (Volta or newer)
• NVIDIA driver >= 520
• cuDNN 9.x (cudnn64_9.dll / libcudnn.so.9) on the library search path
• ONNX Runtime 1.26+ with CUDA EP

If the CUDA EP fails to initialize (missing cuDNN, incompatible driver), the ONNX build falls back to CPU inference automatically.

Quick Start

import seraph

store = seraph.SeraphStore("my_store.sfg")
store.put("The quick brown fox jumps over the lazy dog.")
hits = store.search("fast animal", k=5)
for hit in hits:
    print(f"{hit.score:.3f}  {hit.text}")
store.close()

The API is identical to seraph-db — only the encoder backend differs.

API Reference

• Python API Reference
• Product overview

---

Licensing

SERAPH is proprietary software licensed by Tree D Interactive LLC. See the License Agreement and Pricing Schedule for full terms.

---

Copyright (c) 2025-2026 Tree D Interactive LLC. All rights reserved.