oknoll-eval

OpenKnoll evaluation harness: frozen benchmark specs (bundles + questions with gold evidence) run against two retrieval conditions — progressive disclosure via the deterministic explorer vs. a vector-RAG baseline — with grading, metrics, and comparison reports. Drives oknoll eval.

Usually consumed through the oknoll CLI. Part of OpenKnoll.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.3.4)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for rubengbits from gravatar.com rubengbits

License expression

Apache-2.0
View SPDX License List

Requires

Python >=3.12

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

oknoll_eval-0.3.2.tar.gz (38.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

oknoll_eval-0.3.2-py3-none-any.whl (7.8 kB view details)

Uploaded Python 3

File details

Details for the file oknoll_eval-0.3.2.tar.gz.

File metadata

  • Download URL: oknoll_eval-0.3.2.tar.gz
  • Upload date:
  • Size: 38.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for oknoll_eval-0.3.2.tar.gz
Algorithm Hash digest
SHA256 2ecf9fb150620d2a94ba5e90db724dcb914262d41a7bd8020522ca913aa59996
MD5 a8866c6618ac4ed9c29cc1930220a2e5
BLAKE2b-256 a2185b52f1b05c050477a9fc6668fcb8f4dc1d0ebd29fc3d64c6c162f1bbc5c1

See more details on using hashes here.

Provenance

The following attestation bundles were made for oknoll_eval-0.3.2.tar.gz:

Publisher: release.yml on openknoll/oknoll-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file oknoll_eval-0.3.2-py3-none-any.whl.

File metadata

  • Download URL: oknoll_eval-0.3.2-py3-none-any.whl
  • Upload date:
  • Size: 7.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for oknoll_eval-0.3.2-py3-none-any.whl
Algorithm Hash digest
SHA256 86dc269bdafedf585cbeb826064d4e9b99a49d40a4d77fb0f6b5c37c151adf0c
MD5 298860d999b6d33e1ce67fbd338e3f05
BLAKE2b-256 08f8f3593467b372022c3eb1aebb99536456b3f240c5b3ad6ce50feb6427d5d7

See more details on using hashes here.

Provenance

The following attestation bundles were made for oknoll_eval-0.3.2-py3-none-any.whl:

Publisher: release.yml on openknoll/oknoll-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page