UCP PlaygroundGemini 2.5 Pro/Models/Gemini 2.5 Pro
InspectorAgentDocs
GoogleGoogle

Gemini 2.5 Pro

Google's previous-gen flagship. Highest failure rate among Google models (16%) with a near-10% tool error rate. When it succeeds, checkout takes 8.5 turns on average. Being superseded by Gemini 3.1 Pro which outperforms it on every metric.

Avg Tokens47,160Avg Duration37.4sTurns to Checkout8.8
CheckoutCartSearchTurnsTokens19.93968.84047
Shopping Score36/100
Fair

Scores computed from real agent sessions against live UCP-enabled stores. Not estimated — every data point is from an actual tool call, checkout attempt, and store response.

Shopping Score Breakdown

Checkout Rate40%19.9%
Cart Rate20%39%
Search Rate10%68.8%
Turn Efficiency15%40%
Token Efficiency15%47%
31.2% of sessions failed with errors.

Top Stores

StoreCheckout %Cart %
••••••••••••••••••••••••••••••••75%75%
pier1.com66.7%66.7%
ucp.travel58.3%58.3%
roxy.com50%50%
••••••••••••••••••••••••••••••••50%100%
•••••••••••••••50%50%
•••••••••••••••••••50%66.7%
houseofparfum.nl31.3%37.5%
•••••••••••••••••••••••••••••20%70%
allbirds.com20%20%

Known Issues

High Failure Ratehigh

16% of sessions fail — highest among Google models. Primarily timeout and connection issues.

Tool Error Ratemedium

9.9% error rate on tool calls.

Token Usage

Avg per Session47,160
Fleet Average68,722
vs Fleet−31%
Median (p50)29,936
p90106,657
Prompt / Completion split
Prompt 45,108 (96%) Completion 2,053 (4%)
Daily Average Tokens (last 30 days)
Distribution range
Min0p2512,587p5029,936p7562,821p90106,657Max260,362

Test Gemini 2.5 Pro on Your Store

Run a live agent session to see how Gemini 2.5 Pro handles your store's checkout flow end-to-end.

Run Agent Session

Compare With Other Models

MetaMetaLlama 3.3 70B39.3%GoogleGoogleGemini 3.6 Flash38.6%GoogleGoogleGemini 3.5 Flash38.5%GoogleGoogleGemini 3.8 Flash37.5%AnthropicAnthropicClaude Sonnet 4.635.9%xAIxAIGrok 4.326.3%GoogleGoogleGemini 2.5 Flash25.2%AnthropicAnthropicClaude Opus 4.822.9%DeepSeekDeepSeekDeepSeek V3.222%GoogleGoogleGemini 3.1 Pro20.6%GoogleGoogleGemini 2.5 Pro19.9%OpenAIOpenAIGPT-4o15%xAIxAIGrok 3 Mini (Reasoning)11.1%OpenAIOpenAIGPT-5.510.8%OpenAIOpenAIo4-mini (Reasoning)9.2%AnthropicAnthropicClaude Opus 58.6%DeepSeekDeepSeekDeepSeek V4 Pro8.3%xAIxAIGrok 4.56.7%DeepSeekDeepSeekDeepSeek V4 Flash5.9%AnthropicAnthropicClaude Sonnet 54.3%DeepSeekDeepSeekDeepSeek R1 (Reasoning)3.8%Moonshot AIMoonshot AIKimi K33.4%MetaMetaLlama 4 Maverick2.5%OpenAIOpenAIGPT-6 Luna0%AlibabaAlibabaQwen 3.7 Max0%AlibabaAlibabaQwQ 32B (Reasoning)0%
Full comparison view →