Lightweight grading toolkit for environment-based tasks.
Project description
rewardkit
A lightweight grading toolkit for defining and running verifiers that output structured reward scores.
Installation
uv tool install rewardkit
Example: Programmatic criteria
# tests/check.py
from rewardkit import criteria
criteria.file_exists("output.txt")
criteria.file_contains("output.txt", "hello")
Example: LLM judge
# tests/quality.toml
[judge]
judge = "anthropic/claude-sonnet-4-6"
files = ["/app/main.py"]
[[criterion]]
description = "Is the code correct?"
type = "binary"
Usage
Add rewardkit to your test.sh file:
# tests/test.sh
uvx rewardkit /tests
See the documentation and a full working example.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
harbor_rewardkit-0.1.0.tar.gz
(21.6 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file harbor_rewardkit-0.1.0.tar.gz.
File metadata
- Download URL: harbor_rewardkit-0.1.0.tar.gz
- Upload date:
- Size: 21.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.10.8 {"installer":{"name":"uv","version":"0.10.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ad0cb14400c70ece4ba1204892eb88ffbbc95220284cc2cac49e0e187eba8a1a
|
|
| MD5 |
5378d46d45b37f480d588b0413373779
|
|
| BLAKE2b-256 |
7dd965b01ff6e67834514ac998b9c2fa518fba0e704f957657aa9543bba91d12
|
File details
Details for the file harbor_rewardkit-0.1.0-py3-none-any.whl.
File metadata
- Download URL: harbor_rewardkit-0.1.0-py3-none-any.whl
- Upload date:
- Size: 36.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.10.8 {"installer":{"name":"uv","version":"0.10.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9bcf16e52707738eb34f587576ce01f9bc52f0e80c028e92035f39c7b596da05
|
|
| MD5 |
6d1d5ce3e800d184377bbc729f632964
|
|
| BLAKE2b-256 |
214e13b247a220897749dc6345181f75f9d7a0429c934f3a932d5c6d98dbd74a
|
