DeepSeek V4 Pro
DeepSeek's V4-generation flagship, succeeding V3.2 — which held the highest checkout rate in our prior benchmark (68%) with an autonomous, push-through-errors style. Newly added to the lineup; playground benchmarking is in progress, so no V4 completion metrics yet.
Avg Tokens119,314Avg Duration68.6sTurns to Checkout15.8
Shopping Score18/100
Weak
Scores computed from real agent sessions against live UCP-enabled stores. Not estimated — every data point is from an actual tool call, checkout attempt, and store response.
Shopping Score Breakdown
Checkout Rate
Cart Rate
Search Rate
Turn Efficiency
Token Efficiency
23.1% of sessions failed with errors.
Top Stores
| Store | Checkout % | Cart % |
|---|---|---|
| •••••••••••••••• | 50% | 50% |
| •••••••••••••••• | 9.5% | 57.1% |
| •••••••••••••••• | 0% | 50% |
| everlane.com | 0% | 16.7% |
| singon.com.np | 0% | 0% |
| allbirds.com | 0% | 0% |
| •••••••••••••••• | 0% | 66.7% |
| •••••••••••••••• | 0% | 50% |
| •••••••••••••••• | 0% | 66.7% |
Known Issues
No known issues documented for this model yet.
Token Usage
Avg per Session119,314
Fleet Average74,927
vs Fleet+59%
Median (p50)52,774
p90312,563
Prompt / Completion split
Prompt 117,274 (98%) Completion 2,040 (2%)
Daily Average Tokens (last 30 days)
Distribution range
Min2,711p2518,669p5052,774p75159,220p90312,563Max666,190