oknoll-eval

OpenKnoll evaluation harness: frozen benchmark specs (bundles + questions with gold evidence) run against two retrieval conditions — progressive disclosure via the deterministic explorer vs. a vector-RAG baseline — with grading, metrics, and comparison reports. Drives oknoll eval.

Usually consumed through the oknoll CLI. Part of OpenKnoll.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.3.4)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for rubengbits from gravatar.com rubengbits

License expression

Apache-2.0
View SPDX License List

Requires

Python >=3.12

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

oknoll_eval-0.3.1.tar.gz (6.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

oknoll_eval-0.3.1-py3-none-any.whl (6.6 kB view details)

Uploaded Python 3

File details

Details for the file oknoll_eval-0.3.1.tar.gz.

File metadata

  • Download URL: oknoll_eval-0.3.1.tar.gz
  • Upload date:
  • Size: 6.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for oknoll_eval-0.3.1.tar.gz
Algorithm Hash digest
SHA256 6a13d2a38b08f00db48bf09a4bbae06cde6437aca7733b5221320f0b83b81354
MD5 aa5c313aff3c6d906ea32c4117f1b06a
BLAKE2b-256 e8d4f69abc9091fe160f9823cde3ce603ba74286daf5e3267dddc0ce062a8c29

See more details on using hashes here.

Provenance

The following attestation bundles were made for oknoll_eval-0.3.1.tar.gz:

Publisher: release.yml on openknoll/oknoll-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file oknoll_eval-0.3.1-py3-none-any.whl.

File metadata

  • Download URL: oknoll_eval-0.3.1-py3-none-any.whl
  • Upload date:
  • Size: 6.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for oknoll_eval-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 e956dd629a979a096b95fa13844d37a833d5d8495859a3a332d469934e220f5e
MD5 77bb1a958506253fc6c4ee375c367fc5
BLAKE2b-256 5c7dba55b6907f4b73af408d5b4818224d4215f62c05a736a1b5b97f93037a93

See more details on using hashes here.

Provenance

The following attestation bundles were made for oknoll_eval-0.3.1-py3-none-any.whl:

Publisher: release.yml on openknoll/oknoll-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page