What a prompt pull request should show a reviewer

A diff of the prompt text is not enough. Reviewers need the cases that changed.

Workflow

5 min read

Dana Okafor

Engineer

A printed review page with a green pencil

When a prompt changes, reviewers see a few lines of English and have to guess what they do. So they approve.

A useful check shows three things: the pass rate before and after, the cases that flipped, and the cost difference. Everything else is detail.

We cap the comment at ten flipped cases and link to the rest. Reviewers read ten. They do not read two hundred.

Try this on your own prompts. The free plan includes 500 runs a month.

Try this on your own prompts. The free plan includes 500 runs a month.

Use this free template

Create a free website with Framer, the website builder loved by startups, designers and agencies.