DeepSeek R1 (Reasoning)
DeepSeek's reasoning model with chain-of-thought. Slow (76s avg) but deliberate — the reasoning traces show it carefully planning each tool call. Moderate error rate (12.5%) partly from JSON formatting issues. Small sample size but shows promise for complex checkout flows where thinking through validation errors matters.
Avg Tokens22,859Avg Duration63.8sTurns to Checkout6.7
Shopping Score23/100
Weak
Scores computed from real agent sessions against live UCP-enabled stores. Not estimated — every data point is from an actual tool call, checkout attempt, and store response.
Shopping Score Breakdown
Checkout Rate
Cart Rate
Search Rate
Turn Efficiency
Token Efficiency
61.9% of sessions failed with errors.
Top Stores
| Store | Checkout % | Cart % |
|---|---|---|
| everlane.com | 33.3% | 33.3% |
| allbirds.com | 33.3% | 33.3% |
| houseofparfum.nl | 20% | 40% |
| •••••••••••••••• | 0% | 0% |
| •••••••••••••••• | 0% | 0% |
| •••••••••••••••• | 0% | 0% |
| •••••••••••••••• | 0% | 0% |
| •••••••••••••••• | 0% | 0% |
| •••••••••••••••• | 0% | 0% |
| •••••••••••••••• | 0% | 0% |
Known Issues
High Latencymedium
76 seconds average — reasoning overhead adds significant time.
JSON Formattingmedium
12.5% error rate partly from JSON formatting issues in tool arguments.
Token Usage
Avg per Session22,859
Fleet Average74,927
vs Fleet−69%
Median (p50)14,328
p9051,089
Prompt / Completion split
Prompt 21,626 (95%) Completion 1,233 (5%)
Daily Average Tokens (last 30 days)
Distribution range
Min0p257,425p5014,328p7531,881p9051,089Max116,012