MetaLlama 4 Maverick
Meta's current open-weight flagship (mixture-of-experts, large context), replacing the 2024-era Llama 3.3 70B. Newly added to the lineup; playground benchmarking is in progress, so no completion metrics yet. The prior Llama generation favoured completion over efficiency.
Avg Tokens46,159Avg Duration14.5sTurns to Checkout5
Shopping Score22/100
Weak
Scores computed from real agent sessions against live UCP-enabled stores. Not estimated — every data point is from an actual tool call, checkout attempt, and store response.
Shopping Score Breakdown
Checkout Rate
Cart Rate
Search Rate
Turn Efficiency
Token Efficiency
58.3% of sessions failed with errors.
Top Stores
| Store | Checkout % | Cart % |
|---|---|---|
| ••••••••••••••••••••••••••••• | 0% | 33.3% |
| ucp.travel | 0% | 0% |
| singon.com.np | 0% | 0% |
| everlane.com | 0% | 0% |
| allbirds.com | 0% | 0% |
Known Issues
No known issues documented for this model yet.
Token Usage
Avg per Session46,159
Fleet Average66,097
vs Fleet−30%
Median (p50)14,391
p9096,661
Prompt / Completion split
Prompt 45,923 (99%) Completion 236 (1%)
Daily Average Tokens (last 30 days)
Distribution range
Min2,093p259,782p5014,391p7530,528p9096,661Max418,874
Compare With Other Models
GoogleGemini 3.5 Flash39.6%MetaLlama 3.3 70B39.3%
AnthropicClaude Sonnet 4.636.9%GoogleGemini 2.5 Flash26.5%
xAIGrok 4.326.3%AnthropicClaude Opus 4.823.3%
DeepSeekDeepSeek V3.222.1%GoogleGemini 3.1 Pro21.4%GoogleGemini 2.5 Pro20.1%
OpenAIGPT-4o15.8%AnthropicClaude Sonnet 511.4%OpenAIGPT-5.511.3%xAIGrok 3 Mini (Reasoning)11.1%OpenAIo4-mini (Reasoning)9.7%DeepSeekDeepSeek V4 Pro9%
Moonshot AIKimi K35%xAIGrok 4.54.5%DeepSeekDeepSeek R1 (Reasoning)4.1%DeepSeekDeepSeek V4 Flash3.4%MetaLlama 4 Maverick2.8%AnthropicClaude Opus 52%GoogleGemini 3.6 Flash2%
AlibabaQwen 3.7 Max0%AlibabaQwQ 32B (Reasoning)0%