Product Talk · Teresa Torres
articleplaybook4 New Evals and 16 Experiment Variants to Fix 1 Customer Complaint
16 September 2026Product
Source excerpt
About Product Talk"That is a lot of first layer opportunities there. I wish I could click on this card and be like, 'Clean this up.'"This was a Vistaly customer reviewing her first AI-generated opportunity solution tree. Up until this point, the feedback was extremely positive. But
This is a limited feed-provided excerpt, not the full original work.
Apollo layer
What a founder can learn
Founder takeaway
Treat a customer complaint as evidence to investigate, not a specification for a one-off fix. Break the underlying friction into measurable quality criteria, then test multiple solution variants against them before committing to a change.
Why it matters
A systematic approach turns isolated feedback into reusable product knowledge. This is especially valuable for AI features, where outputs can fail along several dimensions and the most obvious fix may not address the customer’s real need.
Relevant guides
Put it to work
Take one recent complaint and ask: What distinct quality criteria would define a successful experience, and what three materially different experiments could we run against those criteria?