DeepSeekDeepSeek

DeepSeek V4 Pro

DeepSeek's V4-generation flagship, succeeding V3.2 — which held the highest checkout rate in our prior benchmark (68%) with an autonomous, push-through-errors style. Newly added to the lineup; playground benchmarking is in progress, so no V4 completion metrics yet.

Avg Tokens119,314Avg Duration68.6sTurns to Checkout15.8
CheckoutCartSearchTurnsTokens7.735.976.900
Shopping Score18/100
Weak

Scores computed from real agent sessions against live UCP-enabled stores. Not estimated — every data point is from an actual tool call, checkout attempt, and store response.

Shopping Score Breakdown

Checkout Rate40%7.7%
Cart Rate20%35.9%
Search Rate10%76.9%
Turn Efficiency15%0%
Token Efficiency15%0%
23.1% of sessions failed with errors.

Top Stores

StoreCheckout %Cart %
••••••••••••••••50%50%
••••••••••••••••9.5%57.1%
••••••••••••••••0%50%
everlane.com0%16.7%
singon.com.np0%0%
allbirds.com0%0%
••••••••••••••••0%66.7%
••••••••••••••••0%50%
••••••••••••••••0%66.7%

Known Issues

No known issues documented for this model yet.

Token Usage

Avg per Session119,314
Fleet Average74,927
vs Fleet+59%
Median (p50)52,774
p90312,563
Prompt / Completion split
Prompt 117,274 (98%) Completion 2,040 (2%)
Daily Average Tokens (last 30 days)
Distribution range
Min2,711p2518,669p5052,774p75159,220p90312,563Max666,190

Test DeepSeek V4 Pro on Your Store

Run a live agent session to see how DeepSeek V4 Pro handles your store's checkout flow end-to-end.

Run Agent Session