oknoll-eval

OpenKnoll evaluation harness: frozen benchmark specs (bundles + questions with gold evidence) run against two retrieval conditions — progressive disclosure via the deterministic explorer vs. a vector-RAG baseline — with grading, metrics, and comparison reports. Drives oknoll eval.

Usually consumed through the oknoll CLI. Part of OpenKnoll.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.3.4)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for rubengbits from gravatar.com rubengbits

License expression

Apache-2.0
View SPDX License List

Requires

Python >=3.12

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

oknoll_eval-0.3.3.tar.gz (38.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

oknoll_eval-0.3.3-py3-none-any.whl (7.8 kB view details)

Uploaded Python 3

File details

Details for the file oknoll_eval-0.3.3.tar.gz.

File metadata

  • Download URL: oknoll_eval-0.3.3.tar.gz
  • Upload date:
  • Size: 38.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for oknoll_eval-0.3.3.tar.gz
Algorithm Hash digest
SHA256 b90e5e0413983a25b941fddb38de953eeb60102c9ebc577aeda88bbe57587820
MD5 cdde2d4f855d0245187b5f53f528f0d7
BLAKE2b-256 43e7f14e5540013f851e8ffc1db9db82f2949b8eecd0bbb5a92ff9f4e5b973cd

See more details on using hashes here.

Provenance

The following attestation bundles were made for oknoll_eval-0.3.3.tar.gz:

Publisher: release.yml on openknoll/oknoll-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file oknoll_eval-0.3.3-py3-none-any.whl.

File metadata

  • Download URL: oknoll_eval-0.3.3-py3-none-any.whl
  • Upload date:
  • Size: 7.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for oknoll_eval-0.3.3-py3-none-any.whl
Algorithm Hash digest
SHA256 9165b4025d3c5abf7d828cbd159f931138b6d49421d972ae6de60cf9ba06ec82
MD5 56bf411802112112efec14c2ef429303
BLAKE2b-256 6d6cea5ace681bb4da47379861b17d44ce9990984c59ea56d581b4fad3a3b5d0

See more details on using hashes here.

Provenance

The following attestation bundles were made for oknoll_eval-0.3.3-py3-none-any.whl:

Publisher: release.yml on openknoll/oknoll-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page