A Python library for benchmarking Weaviate's Query Agent!
Project description
Query Agent Benchmarking
This repo contains a package for benchmarking the performance of Weaviate's Query Agent.
News 📯
[9/25] 📊 Search Mode Benchmarking is live on the Weaviate Blog.
How to Run 🧰
Populate Weaviate with benchmark data:
uv run python3 scripts/populate-db.py
Run eval:
uv run python3 scripts/run-search-benchmark.py
See query_agent_benchmarking/benchmark-config.yml to change the dataset populated in your Weaviate instance, as well as ablate hybrid-search or query-agent-search-only, as well as the number of samples and concurrency parameters.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file query_agent_benchmarking-0.4.tar.gz.
File metadata
- Download URL: query_agent_benchmarking-0.4.tar.gz
- Upload date:
- Size: 40.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.10.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
946423ae7da393110c644b2abc81fd950d55ac70b4e7ce26e0ed5fe09e9ceccc
|
|
| MD5 |
10e80e7027bc2669746059c28ab5ad14
|
|
| BLAKE2b-256 |
e5293bc33b6877df2327fb7340e3ea813fc11a7f61bae0f605b67d8f15b8b686
|
File details
Details for the file query_agent_benchmarking-0.4-py3-none-any.whl.
File metadata
- Download URL: query_agent_benchmarking-0.4-py3-none-any.whl
- Upload date:
- Size: 52.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.10.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
92ce7f433317314e1b3117616ee76e2def861a012d07add67618d55d249ad121
|
|
| MD5 |
288f47496e1b1e65c316df047c10b828
|
|
| BLAKE2b-256 |
d580184e87a0a56460c4dacd2af46c17b1848f7f3e123b84b4e49bac48301789
|
