Git for prompts. Cross-model regression testing CLI.
Project description
promptfork
Git for prompts. Cross-model regression testing CLI.
Install
pip install promptfork
Quick start
export PROMPTFORK_API_KEY=pf_xxxxx
# 1. Init a prompt + first version from a file
promptfork push summarize_ticket --file prompts/summarize.txt --message "initial"
# 2. Add a test case
promptfork add-test summarize_ticket angry_refund \
--input ticket="I want my money back!" \
--rubric "must mention refund"
# 3. Run across models
promptfork test summarize_ticket
# 4. Compare against a baseline version (regression check)
promptfork test summarize_ticket --baseline 1
Exits non-zero on regression — drop it into CI.
Config
PROMPTFORK_API_KEY — your account key from https://promptfork.online/dashboard
PROMPTFORK_API_BASE — defaults to https://promptfork.online
License
MIT.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
promptfork-0.1.0.tar.gz
(3.9 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file promptfork-0.1.0.tar.gz.
File metadata
- Download URL: promptfork-0.1.0.tar.gz
- Upload date:
- Size: 3.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.10.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2bf60a2c21c67f0923d6dd4f9bb52dc79ca4b7080eeb8108f24e6f2d8098deb6
|
|
| MD5 |
ff3a4dc62f49b0b5d54e14dfc24c2430
|
|
| BLAKE2b-256 |
ea37ccff9ff9e0517d6fbccd40592decd3d2b031abdb521162c74bab5bb5db83
|
File details
Details for the file promptfork-0.1.0-py3-none-any.whl.
File metadata
- Download URL: promptfork-0.1.0-py3-none-any.whl
- Upload date:
- Size: 4.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.10.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
52506df28cf9d4c9ad3167aa9fe19b282256a2859378d74020538f23a6af9c0c
|
|
| MD5 |
9ccf454f6c70a4b225e95d421a524b6a
|
|
| BLAKE2b-256 |
766caf3ca2a3371097667b11a37e3813888cb93ca79a47046a06da47040ada59
|
