GitHub

Install the Fenwick app on the repositories that hold your prompts. Every pull request that touches a prompt file, a grader or a model setting starts a run against the datasets you pick.

The check posts the pass rate, the cases that changed and the cost difference as a comment. When a rule fails, the check turns red and the merge button waits.

Fenwick reads prompt files and writes check results. It never pushes code.