GoogleGoogle

Gemini 2.5 Flash

The fastest model in the benchmark at 11 seconds average. Moderate checkout rate but takes more turns (9.4 avg) than frontier models to get there. Low token cost makes it ideal for high-volume testing. Occasionally fabricates buyer data when identity linking is unavailable.

Avg tokens per run
45,522
Avg duration
15.3s
Turns to checkout
9.2
Checkout22.3Cart38.4Search75.4Turn efficiency35Token efficiency40
Shopping score
35/100Fair

Scores come from runs on UCP stores, not estimates: every figure is a tool call, a checkout attempt or a store’s answer.

Shopping score breakdown

  • Checkout rate40%22.3%
  • Cart rate20%38.4%
  • Search rate10%75.4%
  • Turn efficiency15%35%
  • Token efficiency15%40%

23.8% of runs failed with errors.

Top stores

Development stores are hidden.

Store Checkout Cart
store hidden100% 100%
thebodyshop.com100% 100%
store hidden100% 100%
store hidden100% 100%
perfume-empire.com66.7% 66.7%
ucp.travel61.5% 61.5%
kyliecosmetics.com57.1% 57.1%
sini.fi50% 50%
pier1.com50% 50%
houseofparfum.nl49.2% 61.9%

Known issues

  • MediumData Fabrication

    Occasionally fabricates buyer data (fake names/emails) when identity linking is unavailable.

  • LowTurn Inefficiency

    9.4 avg turns to checkout — takes more attempts than frontier models.

Token usage

Avg per run
45,522
Average of all models
78,184
Against the average
−42%
Median (p50)
22,669
p90
101,464

Prompt and completion

Prompt 44,607 (99%)Completion 355 (1%)

Daily average tokens per run, last 30 days

Nov 4Total 115,151Prompt 114,984Completion 167

Range

Min
0
p25
10,634
p50
22,669
p75
45,954
p90
101,464
Max
860,031

Test Gemini 2.5 Flash on your store

Start a run to see how Gemini 2.5 Flash handles your store’s checkout, call by call.

Start a run