Skip to main content

Nove Test

Continuous testing intelligence layers for AI coding agents.

License: Apache 2.0 CI Release pipeline Python Version

Stop naive testing — simply running tests and getting pass/fail results.

Add testing intelligence layers on top of your native test engines: structured guidance through coverage-guided testing, regression testing, and fault localization.

Nove Test ships with native test runner wrappers, test result memory, a coverage analyzer, a regression engine, fault localization, and test replay — all under one CLI, all under one JSON contract.

Install · Quick start · Why · For AI agents · Docs · License


Install

One line, Linux and macOS:

curl -fsSL https://raw.githubusercontent.com/Nove-Lab/Nove-Test/main/scripts/install.sh | sh

One line, Windows (PowerShell 5.1+):

irm https://raw.githubusercontent.com/Nove-Lab/Nove-Test/main/scripts/install.ps1 | iex

Both scripts detect your OS/arch, download a signed binary from the latest GitHub Release, verify SHA-256, and install to ~/.local/bin/novetest (Linux/macOS) or %USERPROFILE%\.local\bin\novetest.exe (Windows). Re-running upgrades in place.

Inspect-first (recommended):

# Linux / macOS
curl -fsSL -o install.sh https://raw.githubusercontent.com/Nove-Lab/Nove-Test/main/scripts/install.sh
less install.sh   # read it
sh install.sh
# Windows
irm https://raw.githubusercontent.com/Nove-Lab/Nove-Test/main/scripts/install.ps1 -OutFile install.ps1
Get-Content install.ps1   # read it
.\install.ps1

Or download a binary directly:

curl -fsSL -o novetest \
  https://github.com/Nove-Lab/Nove-Test/releases/latest/download/novetest-linux-x86_64
curl -fsSL -o novetest.sha256 \
  https://github.com/Nove-Lab/Nove-Test/releases/latest/download/novetest-linux-x86_64.sha256
sha256sum -c novetest.sha256
chmod +x novetest && mv novetest ~/.local/bin/

For Python tooling users:

uv tool install novetest    # via uv (Astral)
pipx install novetest       # via pipx

Quick start

cd your-project          # any project — Python, JS, Go, Java, .NET, Rust
novetest init            # creates .novetest/, detects the test engine
novetest test            # runs your tests, stores the result, prints JSON
novetest status          # list stored runs
novetest inspect <id>    # full Run Record (passes, failures, coverage, metadata)
novetest compare A B     # what changed between runs A and B
novetest localization run --formula ochiai   # rank likely buggy files (SBFL)

Every command emits a novetest/v1 JSON envelope on stdout:

{
  "version": "novetest/v1",
  "verb": "test",
  "exit_code": 0,
  "data": {
    "run_id": "2026-06-10T07:23:14Z-a1b2c3",
    "summary": { "total": 42, "passed": 41, "failed": 1, "skipped": 0 },
    "results": [
      {
        "test_id": "tests/test_auth.py::test_login_succeeds_with_valid_credentials",
        "outcome": "passed",
        "duration_ms": 12
      }
    ]
  },
  "warnings": [],
  "errors": []
}

The JSON shape is stable across all six engines (pytest, jest, JUnit, go test, dotnet, cargo). Your scripts and AI agents see the same envelope regardless of what's underneath.

Why Nove Test?

You are Nove Test gives you
An AI coding agent Stable novetest/v1 envelopes — parse JSON, not stderr. Run Records as ground truth — compare your edits against a known baseline. SBFL fault localization — get a ranked list of probable culprit files.
A solo developer One binary, six engines, zero per-engine config. Persistent run history without setting up a database.
A team CI integrator Stable JSON contract across pytest / jest / JUnit / go test / dotnet / cargo. Deterministic regression detection.
A test-engine author Documented, minimal adapter contract. Bring your own engine, get storage and cross-run analysis for free.

Features

  • Adapters for six native test engines — pytest · jest · JUnit (Maven, Gradle) · go test · dotnet (xUnit / NUnit / MSTest) · cargo
  • Parsers for five coverage formats — coverage.py · istanbul (LCOV) · jacoco · cobertura · with cross-drive normalization on Windows
  • Persistent run records — every execution stored as immutable JSON under .novetest/
  • Cross-run regression — deterministic deltas between any two runs
  • Fault localization — SBFL (Ochiai, DStar, Op2, Tarantula) across three degradation modes
  • Replay — re-execute a prior run under reconstructed conditions
  • AI-friendly by default--output json is the default contract; NOVETEST_OUTPUT=json env override
  • Single binary — PyApp-wrapped, no Python toolchain required on the user's machine

For AI coding agents

If you're an AI agent invoking Nove Test on a user's project, here's the contract you can rely on:

  • One verb, one envelope, one exit code. Every CLI verb emits { version: "novetest/v1", verb, exit_code, data, warnings, errors }. Parse JSON; ignore stderr.
  • The version field is the schema contract. When it ticks to novetest/v2, the schema may break — until then it won't.
  • Run IDs are stable references. Use them in subsequent calls (inspect <id>, compare <A> <B>, localization run --baseline <id>).
  • Determinism is a first-class goal. A given input project + engine + version produces the same summary block. Differences across runs are user-visible flake, not framework noise.
  • warnings[] is your degradation signal. Adapter quirks, partial coverage, missing tooling — all surface here as structured { code, message, ... } entries. Match on code for programmatic handling.

See docs/ for the full envelope reference and integration patterns.

Status

Production-ready for Linux, macOS, and Windows. The current release is the latest tag on GitHub Releases; novetest --version reports the build you actually have.

Stable today:

  • All six native test engines and CLI verbs
  • The novetest/v1 JSON envelope schema
  • The on-disk Run Record format under .novetest/
  • Linux (x86_64, aarch64), macOS (universal2), and Windows (x86_64) distribution

Roadmap:

  • Rich TTY renderer — tables, colors, and single-line summaries for human use
  • Nove Test Console — a dashboard for humans to inspect what AI coding agents are doing through Nove Test
  • Nove Test Team — team-scale collaborative test-driven development built on the Nove Test engine

Documentation

User documentation ships in two parallel sets — same flow, same verbs, tuned to two audiences:

  • For humans — install, quick start, per-language notes, deeper verbs, troubleshooting. Examples are scannable terminal text with glyph summaries (✓ ✗ — ⚠ ! ? · ↳).
  • For AI agents — same flow, same verbs, but every example is a full novetest/v1 JSON envelope with deterministic routing on recommendations[].category.

Start at docs/ for the audience picker.

License

Nove Test is released under the Apache License 2.0 — see LICENSE.

Free for any use:

  • Internal use, CI integration, production deployment, by individuals and organizations of any size
  • Forking, modifying, redistributing (with notices preserved)
  • Academic and research use, including publishing modifications

The Apache 2.0 patent grant terminates if you initiate patent litigation against Nove Test or its contributors (Apache 2.0 §3).

Enterprise licensing inquiries (custom terms, indemnification, support contracts): admin.nove@gmail.com

Contributing

Pull requests, bug reports, documentation improvements, and adapter contributions for new test engines are all welcome. See CONTRIBUTING.md for how to get started.


Stop instant testing.

Build continuous testing intelligence with Nove Test.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

novetest-0.3.1.tar.gz (2.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

novetest-0.3.1-py3-none-any.whl (2.9 MB view details)

Uploaded Python 3

File details

Details for the file novetest-0.3.1.tar.gz.

File metadata

  • Download URL: novetest-0.3.1.tar.gz
  • Upload date:
  • Size: 2.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for novetest-0.3.1.tar.gz
Algorithm Hash digest
SHA256 0cffebcd5d8032ea518d7d040ec97c42a62905ce3f6a228c1f458e02ebecedcb
MD5 f2daa5709a76587d479984ac96c1c332
BLAKE2b-256 527fcbab71e5688178a14befb955e97092de9f496b6b02d6aa8c1ed4d77c5e67

See more details on using hashes here.

Provenance

The following attestation bundles were made for novetest-0.3.1.tar.gz:

Publisher: pypi-publish.yml on Nove-Lab/Nove-Test

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file novetest-0.3.1-py3-none-any.whl.

File metadata

  • Download URL: novetest-0.3.1-py3-none-any.whl
  • Upload date:
  • Size: 2.9 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for novetest-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 552d8e42ec9934baf0c6cdd6da686513ccde26f4ba8d18c3d7e1e7749b41c98a
MD5 af1e30676e7677dc713c5142c3d35fd4
BLAKE2b-256 5961d3f14d84edf77832091b420fdca2c0e668c2606d5870f201ece2960cf07b

See more details on using hashes here.

Provenance

The following attestation bundles were made for novetest-0.3.1-py3-none-any.whl:

Publisher: pypi-publish.yml on Nove-Lab/Nove-Test

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.3.1 This release

2 files

0.3.0

2 files

0.2.1

2 files

0.2.0

2 files

0.1.3

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page