Skip to main content

A Python library for benchmarking Weaviate's Query Agent!

Project description

Query Agent Benchmarking

This repo contains a package for benchmarking the performance of Weaviate's Query Agent.

News 📯

[9/25] 📊 Search Mode Benchmarking is live on the Weaviate Blog.

How to Run 🧰

Populate Weaviate with benchmark data:

uv run python3 scripts/populate-db.py

Run eval:

uv run python3 scripts/run-search-benchmark.py

See query_agent_benchmarking/benchmark-config.yml to change the dataset populated in your Weaviate instance, as well as ablate hybrid-search or query-agent-search-only, as well as the number of samples and concurrency parameters.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

query_agent_benchmarking-0.6.tar.gz (40.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

query_agent_benchmarking-0.6-py3-none-any.whl (52.3 kB view details)

Uploaded Python 3

File details

Details for the file query_agent_benchmarking-0.6.tar.gz.

File metadata

  • Download URL: query_agent_benchmarking-0.6.tar.gz
  • Upload date:
  • Size: 40.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.10

File hashes

Hashes for query_agent_benchmarking-0.6.tar.gz
Algorithm Hash digest
SHA256 5ca14967c17df0377ba12398c9269cc3219753b7e12775199b51fbdd32cb7c0f
MD5 df6c0432c3003618bd90659b1aa4315f
BLAKE2b-256 a64d85fefd513adee558d3875c128592626b6cb522148febcf8f535eb66435b6

See more details on using hashes here.

File details

Details for the file query_agent_benchmarking-0.6-py3-none-any.whl.

File metadata

File hashes

Hashes for query_agent_benchmarking-0.6-py3-none-any.whl
Algorithm Hash digest
SHA256 c0f51dc36ffb53ff3d5a1a009ae8e4c3670a8f62fe7356ccfec80880b762b7b6
MD5 99871ba40042fd7ef2cf57aeeae7fb94
BLAKE2b-256 048054a0b752509f4d652169360991057a026bb69073f26a53477ce88edb7ddb

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page