When a customer flags a bad answer, the trace already holds the input, the retrieved context and the output. That is a test case.
Adding it to a dataset takes one click. The next prompt change will be checked against it forever.
Traces are test cases you have not written yet
Every bad answer in production is a free test case. Most teams throw them away.
Workflow
4 min read
Dana Okafor
Engineer
