Skip to main content

Nkama Fact Benchmark

Your AI says it built it. Nkama asks: can it prove it?

Nkama Fact Benchmark is an evidence-gated CLI toolkit for AI-assisted work. It does not make an AI magically truthful. It makes the AI's claims easier to test by turning them into files, checks, manifests, and clear pass/fail/blocked reports.

Quick Start

uvx nkama-fact-benchmark
uvx nkama-fact-benchmark activate
uvx nkama-fact-benchmark prepare "Build a browser game with tests."
uvx nkama-fact-benchmark capability-test
uvx nkama-fact-benchmark inspect path/to/nkama_run
uvx nkama-fact-benchmark pilot-harness --phase A
uvx nkama-fact-benchmark selftest

For reproducible runs, pin the version:

uvx --from 'nkama-fact-benchmark==0.1.31' nkama-fact-benchmark selftest

What It Helps With

  • Turn a normal prompt into a stronger evidence-gated execution prompt.
  • Ask terminal-capable AI agents to keep evidence files as they work.
  • Test whether the current sandbox can write files, run Python, and use uvx.
  • Inspect generated folders and classify them as design-only, incomplete, blocked, failed, or verified.
  • Prepare publication-style research harnesses for SWE-bench Verified and FEVER/TruthfulQA scope experiments.
  • Mark missing evidence as BLOCKED instead of pretending it passed.

Core Rule

Blocked evidence is not success. Fix it, rerun it, or report the limitation.

Important Limits

This package verifies only the environment where it runs. If it runs inside a ChatGPT, Claude, Grok, Gemini, Codex, Cursor, or other AI sandbox, the result describes that sandbox only. A blocked PyPI, GitHub, or network connection is a real capability result, not proof that the package does not exist.

External model calls are disabled by default. Tool access and command execution must be explicitly requested with the relevant command flags.

Links

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nkama_fact_benchmark-0.1.31.tar.gz (83.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nkama_fact_benchmark-0.1.31-py3-none-any.whl (95.8 kB view details)

Uploaded Python 3

File details

Details for the file nkama_fact_benchmark-0.1.31.tar.gz.

File metadata

  • Download URL: nkama_fact_benchmark-0.1.31.tar.gz
  • Upload date:
  • Size: 83.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for nkama_fact_benchmark-0.1.31.tar.gz
Algorithm Hash digest
SHA256 c308f691000c4da7f2a9e6dc1bb4a197f46a71e32af00cd6b649452fa28541b8
MD5 d120231fdefec44360d4d8b55985fdbe
BLAKE2b-256 a9c1070c59687b6fc5de230be5b44c10abe3cbb0cb36f4c9c1c0138a321d7649

See more details on using hashes here.

Provenance

The following attestation bundles were made for nkama_fact_benchmark-0.1.31.tar.gz:

Publisher: publish.yml on donkk11/nkama-fact-benchmark

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nkama_fact_benchmark-0.1.31-py3-none-any.whl.

File metadata

File hashes

Hashes for nkama_fact_benchmark-0.1.31-py3-none-any.whl
Algorithm Hash digest
SHA256 b536b7a425ae6516c6bb8acb0f48912829d52ab3fc3276b5d0b23c2039a0ea02
MD5 3d08c91969bd92f1f6a36d01acd95f87
BLAKE2b-256 982bd2ed78b779c1ecb5a19417db9f005e79369bc2d223913d54806f38f72308

See more details on using hashes here.

Provenance

The following attestation bundles were made for nkama_fact_benchmark-0.1.31-py3-none-any.whl:

Publisher: publish.yml on donkk11/nkama-fact-benchmark

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.1.31 This release

2 files

0.1.30

2 files

0.1.29

2 files

0.1.28

2 files

0.1.27

2 files

0.1.26

2 files

0.1.25

2 files

0.1.24

2 files

0.1.23

2 files

0.1.22

2 files

0.1.21

2 files

0.1.20

2 files

0.1.19

2 files

0.1.18

2 files

0.1.15

2 files

0.1.14

2 files

0.1.13

2 files

0.1.12

2 files

0.1.10

2 files

0.1.9

2 files

0.1.8

2 files

0.1.6

2 files

0.1.5

2 files

0.1.4

2 files

0.1.3

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page