Skip to main content

Nove Test

Continuous testing intelligence layers for AI coding agents.

License: Apache 2.0 CI Release pipeline Python Version

Stop naive testing — simply running tests and getting pass/fail results.

Add testing intelligence layers on top of your native test engines: structured guidance through coverage-guided testing, regression testing, and fault localization.

Nove Test ships with native test runner wrappers, test result memory, a coverage analyzer, a regression engine, fault localization, and test replay — all under one CLI, all under one JSON contract.

Install · Quick start · Why · For AI agents · Docs · License


Install

One line, Linux and macOS:

curl -fsSL https://raw.githubusercontent.com/Nove-Lab/Nove-Test/main/scripts/install.sh | sh

One line, Windows (PowerShell 5.1+):

irm https://raw.githubusercontent.com/Nove-Lab/Nove-Test/main/scripts/install.ps1 | iex

Both scripts detect your OS/arch, download a signed binary from the latest GitHub Release, verify SHA-256, and install to ~/.local/bin/novetest (Linux/macOS) or %USERPROFILE%\.local\bin\novetest.exe (Windows). Re-running upgrades in place.

Inspect-first (recommended):

# Linux / macOS
curl -fsSL -o install.sh https://raw.githubusercontent.com/Nove-Lab/Nove-Test/main/scripts/install.sh
less install.sh   # read it
sh install.sh
# Windows
irm https://raw.githubusercontent.com/Nove-Lab/Nove-Test/main/scripts/install.ps1 -OutFile install.ps1
Get-Content install.ps1   # read it
.\install.ps1

Or download a binary directly:

curl -fsSL -o novetest \
  https://github.com/Nove-Lab/Nove-Test/releases/latest/download/novetest-linux-x86_64
curl -fsSL -o novetest.sha256 \
  https://github.com/Nove-Lab/Nove-Test/releases/latest/download/novetest-linux-x86_64.sha256
sha256sum -c novetest.sha256
chmod +x novetest && mv novetest ~/.local/bin/

For Python tooling users:

uv tool install novetest    # via uv (Astral)
pipx install novetest       # via pipx

Quick start

cd your-project          # any project — Python, JS, Go, Java, .NET, Rust
novetest init            # creates .novetest/, detects the test engine
novetest test            # runs your tests, stores the result, prints JSON
novetest status          # list stored runs
novetest inspect <id>    # full Run Record (passes, failures, coverage, metadata)
novetest compare A B     # what changed between runs A and B
novetest localization run --formula ochiai   # rank likely buggy files (SBFL)

Every command emits a novetest/v1 JSON envelope on stdout:

{
  "version": "novetest/v1",
  "verb": "test",
  "exit_code": 0,
  "data": {
    "run_id": "2026-06-10T07:23:14Z-a1b2c3",
    "summary": { "total": 42, "passed": 41, "failed": 1, "skipped": 0 },
    "results": [
      {
        "test_id": "tests/test_auth.py::test_login_succeeds_with_valid_credentials",
        "outcome": "passed",
        "duration_ms": 12
      }
    ]
  },
  "warnings": [],
  "errors": []
}

The JSON shape is stable across all six engines (pytest, jest, JUnit, go test, dotnet, cargo). Your scripts and AI agents see the same envelope regardless of what's underneath.

Why Nove Test?

You are Nove Test gives you
An AI coding agent Stable novetest/v1 envelopes — parse JSON, not stderr. Run Records as ground truth — compare your edits against a known baseline. SBFL fault localization — get a ranked list of probable culprit files.
A solo developer One binary, six engines, zero per-engine config. Persistent run history without setting up a database.
A team CI integrator Stable JSON contract across pytest / jest / JUnit / go test / dotnet / cargo. Deterministic regression detection.
A test-engine author Documented, minimal adapter contract. Bring your own engine, get storage and cross-run analysis for free.

Features

  • Adapters for six native test engines — pytest · jest · JUnit (Maven, Gradle) · go test · dotnet (xUnit / NUnit / MSTest) · cargo
  • Parsers for five coverage formats — coverage.py · istanbul (LCOV) · jacoco · cobertura · with cross-drive normalization on Windows
  • Persistent run records — every execution stored as immutable JSON under .novetest/
  • Cross-run regression — deterministic deltas between any two runs
  • Fault localization — SBFL (Ochiai, DStar, Op2, Tarantula) across three degradation modes
  • Replay — re-execute a prior run under reconstructed conditions
  • AI-friendly by default--output json is the default contract; NOVETEST_OUTPUT=json env override
  • Single binary — PyApp-wrapped, no Python toolchain required on the user's machine

For AI coding agents

If you're an AI agent invoking Nove Test on a user's project, here's the contract you can rely on:

  • One verb, one envelope, one exit code. Every CLI verb emits { version: "novetest/v1", verb, exit_code, data, warnings, errors }. Parse JSON; ignore stderr.
  • The version field is the schema contract. When it ticks to novetest/v2, the schema may break — until then it won't.
  • Run IDs are stable references. Use them in subsequent calls (inspect <id>, compare <A> <B>, localization run --baseline <id>).
  • Determinism is a first-class goal. A given input project + engine + version produces the same summary block. Differences across runs are user-visible flake, not framework noise.
  • warnings[] is your degradation signal. Adapter quirks, partial coverage, missing tooling — all surface here as structured { code, message, ... } entries. Match on code for programmatic handling.

See docs/ for the full envelope reference and integration patterns.

Status

v0.1.2 — production-ready for Linux, macOS, and Windows.

Stable today:

  • All six native test engines and CLI verbs
  • The novetest/v1 JSON envelope schema
  • The on-disk Run Record format under .novetest/
  • Linux (x86_64, aarch64), macOS (universal2), and Windows (x86_64) distribution

Roadmap:

  • Rich TTY renderer — tables, colors, and single-line summaries for human use
  • Nove Test Console — a dashboard for humans to inspect what AI coding agents are doing through Nove Test
  • Nove Test Team — team-scale collaborative test-driven development built on the Nove Test engine

Documentation

User documentation ships in two parallel sets — same flow, same verbs, tuned to two audiences:

  • For humans — install, quick start, per-language notes, deeper verbs, troubleshooting. Examples are scannable terminal text with glyph summaries (✓ ✗ — ⚠ ! ? · ↳).
  • For AI agents — same flow, same verbs, but every example is a full novetest/v1 JSON envelope with deterministic routing on recommendations[].category.

Start at docs/ for the audience picker.

License

Nove Test is released under the Apache License 2.0 — see LICENSE.

Free for any use:

  • Internal use, CI integration, production deployment, by individuals and organizations of any size
  • Forking, modifying, redistributing (with notices preserved)
  • Academic and research use, including publishing modifications

The Apache 2.0 patent grant terminates if you initiate patent litigation against Nove Test or its contributors (Apache 2.0 §3).

Enterprise licensing inquiries (custom terms, indemnification, support contracts): admin.nove@gmail.com

Contributing

Pull requests, bug reports, documentation improvements, and adapter contributions for new test engines are all welcome. See CONTRIBUTING.md for how to get started.


Stop instant testing.

Build continuous testing intelligence with Nove Test.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

novetest-0.2.0.tar.gz (2.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

novetest-0.2.0-py3-none-any.whl (2.9 MB view details)

Uploaded Python 3

File details

Details for the file novetest-0.2.0.tar.gz.

File metadata

  • Download URL: novetest-0.2.0.tar.gz
  • Upload date:
  • Size: 2.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for novetest-0.2.0.tar.gz
Algorithm Hash digest
SHA256 381a7f5dcf48e99714c7e5f5e4d9f54da3a77595cd0b6336639f6847f6e80cee
MD5 3c4ead8ee460fbfbd62d6cd8e4f73d10
BLAKE2b-256 3e2371888038dd815f7b1e1f1026face5e76ded2a953cafad738b8ddccd52404

See more details on using hashes here.

Provenance

The following attestation bundles were made for novetest-0.2.0.tar.gz:

Publisher: pypi-publish.yml on Nove-Lab/Nove-Test

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file novetest-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: novetest-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 2.9 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for novetest-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7b5c4212ecb9820c6cf867c24e2f779568944ed086f4eda12fc2781791f86c22
MD5 8ad497c01f0ccd2d7d3a0add4533bba9
BLAKE2b-256 d4e1e972ef5a4d80eae2b643240351b8cd39ffac23aae130f678c0b48191f650

See more details on using hashes here.

Provenance

The following attestation bundles were made for novetest-0.2.0-py3-none-any.whl:

Publisher: pypi-publish.yml on Nove-Lab/Nove-Test

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.3.1

2 files

0.3.0

2 files

0.2.1

2 files

This release

0.2.0 This release

2 files

0.1.3

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page