Compare2 of 4 selected
Model comparison
Two to four models, side by side on the five measurements behind the shopping score.
Anthropic
GoogleMeasurementsranked within each band
Checkout rate40% of score
Gemini 3.5 Flash38.9✓
Claude Sonnet 4.636.7
Cart rate20% of score
Gemini 3.5 Flash56.3✓
Claude Sonnet 4.648
Search rate10% of score
Claude Sonnet 4.679.9✓
Gemini 3.5 Flash79.6
Turn efficiency15% of score
Gemini 3.5 Flash53✓
Claude Sonnet 4.645
Token efficiency15% of score
Gemini 3.5 Flash7✓
Claude Sonnet 4.60
Best of the selectionper measurement
Checkout rateGemini 3.5 Flash38.9/100
Cart rateGemini 3.5 Flash56.3/100
Search rateClaude Sonnet 4.679.9/100
Turn efficiencyGemini 3.5 Flash53/100
Token efficiencyGemini 3.5 Flash7/100
These rates are averages across every store in the harness. Yours will differ — the same model scores differently against a strict store and an unenforced one. Run Agent session