Skip to main content

A Python library for benchmarking Weaviate's Query Agent!

Project description

Query Agent Benchmarking

This repo contains a package for benchmarking the performance of Weaviate's Query Agent.

News 📯

[9/25] 📊 Search Mode Benchmarking is live on the Weaviate Blog.

How to Run 🧰

Populate Weaviate with benchmark data:

uv run python3 scripts/populate-db.py

Run eval:

uv run python3 scripts/run-search-benchmark.py

See query_agent_benchmarking/benchmark-config.yml to change the dataset populated in your Weaviate instance, as well as ablate hybrid-search or query-agent-search-only, as well as the number of samples and concurrency parameters.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

query_agent_benchmarking-0.5.tar.gz (40.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

query_agent_benchmarking-0.5-py3-none-any.whl (52.3 kB view details)

Uploaded Python 3

File details

Details for the file query_agent_benchmarking-0.5.tar.gz.

File metadata

  • Download URL: query_agent_benchmarking-0.5.tar.gz
  • Upload date:
  • Size: 40.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.10

File hashes

Hashes for query_agent_benchmarking-0.5.tar.gz
Algorithm Hash digest
SHA256 2c8a7a85ba3244ebf1cedf05911af1aa48acaec409f84d6ec927d6d130844d25
MD5 72fb262c5924ba1882c0e3ca33b488c5
BLAKE2b-256 b7a62dc2b6818e270c5173147219c60c76be48f82b2efed0adecf786dc04aff5

See more details on using hashes here.

File details

Details for the file query_agent_benchmarking-0.5-py3-none-any.whl.

File metadata

File hashes

Hashes for query_agent_benchmarking-0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 8ca9b5d3736c1121b86620dfe2d81eb2e4f967a90f978063a470884fb3daf51c
MD5 149072a9e67f4a97bf1064b501ff2b94
BLAKE2b-256 e44d59b8fc0451d3ed747ac6f25808bfc491935e7386abf1bc11e8e745289c48

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page