The Success Metric That Improved Because the Model Declined the Hard Cases
A rising task-completion rate after a model upgrade can mean the agent got better — or that it stopped attempting the hard cases. Decompose your success metric or watch churn pay the bill.
llm-evaluation
agent-metrics
abstention
observability
