Lightweight grading toolkit for environment-based tasks.
Project description
Harbor Rewardkit
The Harbor Rewardkit is a lightweight package to define and run verifiers. Rewardkit is designed to be used with the Harbor task format but you can use it on its own.
Installation
uv tool install harbor-rewardkit
Example: Programmatic criteria
# tests/check.py
from rewardkit import criteria
criteria.file_exists("output.txt")
criteria.file_contains("output.txt", "hello")
Example: LLM judge
# tests/quality.toml
[judge]
judge = "anthropic/claude-sonnet-4-6"
files = ["/app/main.py"]
[[criterion]]
description = "Is the code correct?"
type = "binary"
Usage
Add rewardkit to your test.sh file:
# tests/test.sh
uvx harbor-rewardkit@0.1 /tests
See the documentation and a full working example.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file harbor_rewardkit-0.1.dev3.tar.gz.
File metadata
- Download URL: harbor_rewardkit-0.1.dev3.tar.gz
- Upload date:
- Size: 22.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.10.8 {"installer":{"name":"uv","version":"0.10.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
40815e0b281d7a9c6b42e1a34c749e0c8186c67ab98cfae6ffe76c179721c9a2
|
|
| MD5 |
d8850f8851b1cd1bdc65b41bd06277e1
|
|
| BLAKE2b-256 |
36e4ef9919c9e57dd416f1de12558fccd132c2e81514302242d8386473254315
|
File details
Details for the file harbor_rewardkit-0.1.dev3-py3-none-any.whl.
File metadata
- Download URL: harbor_rewardkit-0.1.dev3-py3-none-any.whl
- Upload date:
- Size: 38.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.10.8 {"installer":{"name":"uv","version":"0.10.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
09972209703009a1d1986182104527c00a9a3fd6878ffbc1f6d2b6480e08b0b8
|
|
| MD5 |
08373c187dbdb6e49f4a779ceaf18213
|
|
| BLAKE2b-256 |
90e959e7d3a5ea79cbdf69650c168e9d424855f3846b868a46b0cc272852d9df
|
