Cheaper models, same answers: a test plan

How one team cut tagging cost to a third without losing accuracy, and how to know when you can.

Cost

6 min read

Priya Raman

Founder

A receipt calculator and a pencil on a desk

Tallow tags every inbound ticket. The tagger ran on a large model because that is what the prototype used.

They ran 180 labeled tickets through three smaller models. One matched the large model on 176 of 180 and cost a third as much.

The four misses were all tickets written in two languages. They route those to the large model now.

Try this on your own prompts. The free plan includes 500 runs a month.

Try this on your own prompts. The free plan includes 500 runs a month.

Use this free template

Create a free website with Framer, the website builder loved by startups, designers and agencies.