Compare3 of 4 selected

Model comparison

Two to four models, side by side on the five measurements behind the shopping score.

Select models
AnthropicAnthropicClaude Opus 4.829Weak
84,335 tok31.2s
AnthropicAnthropicClaude Sonnet 4.638Fair
69,644 tok33.8s
OpenAIOpenAIGPT-5.521Weak
59,279 tok33.9s
Measurementsranked within each band
Checkout rate40% of score
Claude Sonnet 4.634.7✓
Claude Opus 4.822.3
GPT-5.510.2
Cart rate20% of score
Claude Sonnet 4.647.5✓
Claude Opus 4.831.6
GPT-5.524.5
Search rate10% of score
Claude Sonnet 4.679.6✓
GPT-5.570
Claude Opus 4.863.6
Turn efficiency15% of score
Claude Opus 4.846✓
Claude Sonnet 4.644
GPT-5.524
Token efficiency15% of score
GPT-5.58✓
Claude Opus 4.80
Claude Sonnet 4.60
Best of the selectionper measurement
Checkout rateClaude Sonnet 4.634.7/100
Cart rateClaude Sonnet 4.647.5/100
Search rateClaude Sonnet 4.679.6/100
Turn efficiencyClaude Opus 4.846/100
Token efficiencyGPT-5.58/100
These rates are averages across every store in the harness. Yours will differ — the same model scores differently against a strict store and an unenforced one. Run Agent session