Skip to main content

Nkama Fact Benchmark

Your AI says it built it. Nkama asks: can it prove it?

Nkama Fact Benchmark is an evidence-gated CLI toolkit for AI-assisted work. It does not make an AI magically truthful. It makes the AI's claims easier to test by turning them into files, checks, manifests, and clear pass/fail/blocked reports.

Quick Start

uvx nkama-fact-benchmark
uvx nkama-fact-benchmark activate
uvx nkama-fact-benchmark prepare "Build a browser game with tests."
uvx nkama-fact-benchmark capability-test
uvx nkama-fact-benchmark inspect path/to/nkama_run
uvx nkama-fact-benchmark pilot-harness --phase A
uvx nkama-fact-benchmark selftest

For reproducible runs, pin the version:

uvx --from 'nkama-fact-benchmark==0.1.25' nkama-fact-benchmark selftest

What It Helps With

  • Turn a normal prompt into a stronger evidence-gated execution prompt.
  • Ask terminal-capable AI agents to keep evidence files as they work.
  • Test whether the current sandbox can write files, run Python, and use uvx.
  • Inspect generated folders and classify them as design-only, incomplete, blocked, failed, or verified.
  • Prepare publication-style research harnesses for SWE-bench Verified and FEVER/TruthfulQA scope experiments.
  • Mark missing evidence as BLOCKED instead of pretending it passed.

Core Rule

Blocked evidence is not success. Fix it, rerun it, or report the limitation.

Important Limits

This package verifies only the environment where it runs. If it runs inside a ChatGPT, Claude, Grok, Gemini, Codex, Cursor, or other AI sandbox, the result describes that sandbox only. A blocked PyPI, GitHub, or network connection is a real capability result, not proof that the package does not exist.

External model calls are disabled by default. Tool access and command execution must be explicitly requested with the relevant command flags.

Links

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nkama_fact_benchmark-0.1.29.tar.gz (64.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nkama_fact_benchmark-0.1.29-py3-none-any.whl (73.5 kB view details)

Uploaded Python 3

File details

Details for the file nkama_fact_benchmark-0.1.29.tar.gz.

File metadata

  • Download URL: nkama_fact_benchmark-0.1.29.tar.gz
  • Upload date:
  • Size: 64.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for nkama_fact_benchmark-0.1.29.tar.gz
Algorithm Hash digest
SHA256 09ae781e36fe6b97420dfe5786992519533531d5c4ea87dd7b5536274581d416
MD5 da79d6aa411316fdbb83fa024fc44bff
BLAKE2b-256 49a71f74fb5d4868e313667561d68b68edc577363706cd7adc99974d27b65083

See more details on using hashes here.

Provenance

The following attestation bundles were made for nkama_fact_benchmark-0.1.29.tar.gz:

Publisher: publish.yml on donkk11/nkama-fact-benchmark

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nkama_fact_benchmark-0.1.29-py3-none-any.whl.

File metadata

File hashes

Hashes for nkama_fact_benchmark-0.1.29-py3-none-any.whl
Algorithm Hash digest
SHA256 d4a17bc0e03a5caeb05caaf07d05ee9e2a8fad9a64cfe3cd6e3aa4c4705ab71b
MD5 a6908beb76c65b217e08a93dcd759eb9
BLAKE2b-256 7a85eb8d0c16f3e66a046ac2d8939cf0c4784f9772271431fdf55e77e6345976

See more details on using hashes here.

Provenance

The following attestation bundles were made for nkama_fact_benchmark-0.1.29-py3-none-any.whl:

Publisher: publish.yml on donkk11/nkama-fact-benchmark

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.1.31

2 files

0.1.30

2 files

This release

0.1.29 This release

2 files

0.1.28

2 files

0.1.27

2 files

0.1.26

2 files

0.1.25

2 files

0.1.24

2 files

0.1.23

2 files

0.1.22

2 files

0.1.21

2 files

0.1.20

2 files

0.1.19

2 files

0.1.18

2 files

0.1.15

2 files

0.1.14

2 files

0.1.13

2 files

0.1.12

2 files

0.1.10

2 files

0.1.9

2 files

0.1.8

2 files

0.1.6

2 files

0.1.5

2 files

0.1.4

2 files

0.1.3

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page