Skip to main content

An open benchmark for measuring what LLMs get wrong about quantum computing

Project description

hallucinationguard-bench

An open benchmark for measuring what LLMs get wrong about quantum computing.

Bag-of-words metrics cannot separate topic overlap from semantic agreement. Neither can mean-pooled word embeddings — "measurement collapses the state" and "measurement never collapses the state" land nearly on top of each other. This benchmark exists because of that gap.

Status: placeholder. The scoring harness lands here. The benchmark, fixtures, and baseline scorer are at:

https://github.com/Minapak/hallucinationguard

Apache-2.0.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hallucinationguard_bench-0.0.1.tar.gz (1.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hallucinationguard_bench-0.0.1-py3-none-any.whl (1.9 kB view details)

Uploaded Python 3

File details

Details for the file hallucinationguard_bench-0.0.1.tar.gz.

File metadata

File hashes

Hashes for hallucinationguard_bench-0.0.1.tar.gz
Algorithm Hash digest
SHA256 f240bfaf888af3a8d6f2658d40ce1a8c72ee9692bd5cd4b2de60a3c100e6a766
MD5 d1f6b44c9d3c47b8cd4b3fa9f1f231c2
BLAKE2b-256 a4f2b744b3e7a3ae16918158dd992212d7d077002996b1f4115de002c2f55e5d

See more details on using hashes here.

File details

Details for the file hallucinationguard_bench-0.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for hallucinationguard_bench-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 cb80e6e2b8d1fb35a0e7c2ef588a49e4ec3dd5f94c06d2de3439dbce7df732da
MD5 9944dfa594a38ec9b4af6dbe275b4cd4
BLAKE2b-256 00e345822f3c3842ce4bef5627d87dea870e5f0e158fa6b0345567d895dfde45

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page