UCP PlaygroundGemini 2.5 Flash/Models/Gemini 2.5 Flash
InspectorAgentDocs
GoogleGoogle

Gemini 2.5 Flash

The fastest model in the benchmark at 11 seconds average. Moderate checkout rate but takes more turns (9.4 avg) than frontier models to get there. Low token cost makes it ideal for high-volume testing. Occasionally fabricates buyer data when identity linking is unavailable.

Avg Tokens45,891Avg Duration15.5sTurns to Checkout9.2
CheckoutCartSearchTurnsTokens23.338.574.93540
Shopping Score36/100
Fair

Scores computed from real agent sessions against live UCP-enabled stores. Not estimated — every data point is from an actual tool call, checkout attempt, and store response.

Shopping Score Breakdown

Checkout Rate40%23.3%
Cart Rate20%38.5%
Search Rate10%74.9%
Turn Efficiency15%35%
Token Efficiency15%40%
24.2% of sessions failed with errors.

Top Stores

StoreCheckout %Cart %
••••••••••••••••100%100%
thebodyshop.com100%100%
••••••••••••••••100%100%
••••••••••••••••100%100%
perfume-empire.com66.7%66.7%
ucp.travel61.5%61.5%
kyliecosmetics.com57.1%57.1%
sini.fi50%50%
pier1.com50%50%
houseofparfum.nl49.2%61.9%

Known Issues

Data Fabricationmedium

Occasionally fabricates buyer data (fake names/emails) when identity linking is unavailable.

Turn Inefficiencylow

9.4 avg turns to checkout — takes more attempts than frontier models.

Token Usage

Avg per Session45,891
Fleet Average74,927
vs Fleet−39%
Median (p50)22,669
p90101,887
Prompt / Completion split
Prompt 44,943 (99%) Completion 363 (1%)
Daily Average Tokens (last 30 days)
Distribution range
Min0p2510,335p5022,669p7546,387p90101,887Max860,031

Test Gemini 2.5 Flash on Your Store

Run a live agent session to see how Gemini 2.5 Flash handles your store's checkout flow end-to-end.

Run Agent Session

Compare With Other Models

MetaMetaLlama 3.3 70B39.3%GoogleGoogleGemini 3.5 Flash38.1%AnthropicAnthropicClaude Sonnet 4.634.7%xAIxAIGrok 4.326.3%GoogleGoogleGemini 2.5 Flash23.3%AnthropicAnthropicClaude Opus 4.822.3%AlibabaAlibabaQwen 3.8 Flash22.2%DeepSeekDeepSeekDeepSeek V3.220.7%GoogleGoogleGemini 2.5 Pro19.8%GoogleGoogleGemini 3.1 Pro19.6%OpenAIOpenAIGPT-4o15%DeepSeekDeepSeekDeepSeek V4.1 Flash14.3%xAIxAIGrok 3 Mini (Reasoning)11.1%OpenAIOpenAIGPT-5.510.2%OpenAIOpenAIo4-mini (Reasoning)9.1%AnthropicAnthropicClaude Opus 59%xAIxAIGrok 4.58.1%AnthropicAnthropicClaude Sonnet 57.7%DeepSeekDeepSeekDeepSeek V4 Pro7.7%DeepSeekDeepSeekDeepSeek V4 Flash7.5%GoogleGoogleGemini 3.8 Flash6.7%DeepSeekDeepSeekDeepSeek R1 (Reasoning)3.6%Moonshot AIMoonshot AIKimi K33.1%AlibabaAlibabaQwen 3.7 Max2.6%MetaMetaLlama 4 Maverick2.3%GoogleGoogleGemini 3.6 Flash1.1%GoogleGoogleGemini 3.7 Flash0%OpenAIOpenAIGPT-6 Luna0%MetaMetaMuse Spark 1.30%AlibabaAlibabaQwQ 32B (Reasoning)0%
Full comparison view →