Skip to main content

Nkama Fact Benchmark

Your AI says it built it. Nkama asks: can it prove it?

Nkama Fact Benchmark is an evidence-gated CLI toolkit for AI-assisted work. It does not make an AI magically truthful. It makes the AI's claims easier to test by turning them into files, checks, manifests, and clear pass/fail/blocked reports.

Quick Start

uvx nkama-fact-benchmark
uvx nkama-fact-benchmark activate
uvx nkama-fact-benchmark prepare "Build a browser game with tests."
uvx nkama-fact-benchmark capability-test
uvx nkama-fact-benchmark inspect path/to/nkama_run
uvx nkama-fact-benchmark pilot-harness --phase A
uvx nkama-fact-benchmark selftest

For reproducible runs, pin the version:

uvx --from 'nkama-fact-benchmark==0.1.25' nkama-fact-benchmark selftest

What It Helps With

  • Turn a normal prompt into a stronger evidence-gated execution prompt.
  • Ask terminal-capable AI agents to keep evidence files as they work.
  • Test whether the current sandbox can write files, run Python, and use uvx.
  • Inspect generated folders and classify them as design-only, incomplete, blocked, failed, or verified.
  • Prepare publication-style research harnesses for SWE-bench Verified and FEVER/TruthfulQA scope experiments.
  • Mark missing evidence as BLOCKED instead of pretending it passed.

Core Rule

Blocked evidence is not success. Fix it, rerun it, or report the limitation.

Important Limits

This package verifies only the environment where it runs. If it runs inside a ChatGPT, Claude, Grok, Gemini, Codex, Cursor, or other AI sandbox, the result describes that sandbox only. A blocked PyPI, GitHub, or network connection is a real capability result, not proof that the package does not exist.

External model calls are disabled by default. Tool access and command execution must be explicitly requested with the relevant command flags.

Links

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nkama_fact_benchmark-0.1.27.tar.gz (62.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nkama_fact_benchmark-0.1.27-py3-none-any.whl (70.4 kB view details)

Uploaded Python 3

File details

Details for the file nkama_fact_benchmark-0.1.27.tar.gz.

File metadata

  • Download URL: nkama_fact_benchmark-0.1.27.tar.gz
  • Upload date:
  • Size: 62.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for nkama_fact_benchmark-0.1.27.tar.gz
Algorithm Hash digest
SHA256 f07b5298284e64bf9d61c1425b6f573af0c971210fac2632208f635b05dd11bb
MD5 5f54a1bec70119b961a67ecfbf803523
BLAKE2b-256 0c87c97a0adc0c5c4c041fa1cf04103035907ef4b14d48a1ecb29c981919ac67

See more details on using hashes here.

Provenance

The following attestation bundles were made for nkama_fact_benchmark-0.1.27.tar.gz:

Publisher: publish.yml on donkk11/nkama-fact-benchmark

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nkama_fact_benchmark-0.1.27-py3-none-any.whl.

File metadata

File hashes

Hashes for nkama_fact_benchmark-0.1.27-py3-none-any.whl
Algorithm Hash digest
SHA256 2d7e60c7a959ec83d5fb4afa7f0150a8d1ca39e8e984f68c9fee1db741bded12
MD5 cd3f400e8a22c658c4b0392e73978279
BLAKE2b-256 a4e119810c35cc0cf5907797397338ebda7b05796c29a2c7a03219f65474d2bd

See more details on using hashes here.

Provenance

The following attestation bundles were made for nkama_fact_benchmark-0.1.27-py3-none-any.whl:

Publisher: publish.yml on donkk11/nkama-fact-benchmark

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.1.31

2 files

0.1.30

2 files

0.1.29

2 files

0.1.28

2 files

This release

0.1.27 This release

2 files

0.1.26

2 files

0.1.25

2 files

0.1.24

2 files

0.1.23

2 files

0.1.22

2 files

0.1.21

2 files

0.1.20

2 files

0.1.19

2 files

0.1.18

2 files

0.1.15

2 files

0.1.14

2 files

0.1.13

2 files

0.1.12

2 files

0.1.10

2 files

0.1.9

2 files

0.1.8

2 files

0.1.6

2 files

0.1.5

2 files

0.1.4

2 files

0.1.3

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page