DeepSeekDeepSeek

DeepSeek R1 (Reasoning)

DeepSeek's reasoning model with chain-of-thought. Slow (76s avg) but deliberate — the reasoning traces show it carefully planning each tool call. Moderate error rate (12.5%) partly from JSON formatting issues. Small sample size but shows promise for complex checkout flows where thinking through validation errors matters.

Avg Tokens22,859Avg Duration63.8sTurns to Checkout6.7
CheckoutCartSearchTurnsTokens3.68.338.16642
Shopping Score23/100
Weak

Scores computed from real agent sessions against live UCP-enabled stores. Not estimated — every data point is from an actual tool call, checkout attempt, and store response.

Shopping Score Breakdown

Checkout Rate40%3.6%
Cart Rate20%8.3%
Search Rate10%38.1%
Turn Efficiency15%66%
Token Efficiency15%42%
61.9% of sessions failed with errors.

Top Stores

StoreCheckout %Cart %
everlane.com33.3%33.3%
allbirds.com33.3%33.3%
houseofparfum.nl20%40%
••••••••••••••••0%0%
••••••••••••••••0%0%
••••••••••••••••0%0%
••••••••••••••••0%0%
••••••••••••••••0%0%
••••••••••••••••0%0%
••••••••••••••••0%0%

Known Issues

High Latencymedium

76 seconds average — reasoning overhead adds significant time.

JSON Formattingmedium

12.5% error rate partly from JSON formatting issues in tool arguments.

Token Usage

Avg per Session22,859
Fleet Average74,927
vs Fleet−69%
Median (p50)14,328
p9051,089
Prompt / Completion split
Prompt 21,626 (95%) Completion 1,233 (5%)
Daily Average Tokens (last 30 days)
Distribution range
Min0p257,425p5014,328p7531,881p9051,089Max116,012

Test DeepSeek R1 (Reasoning) on Your Store

Run a live agent session to see how DeepSeek R1 (Reasoning) handles your store's checkout flow end-to-end.

Run Agent Session