MetaLlama 4 Maverick
Meta's current open-weight flagship (mixture-of-experts, large context), replacing the 2024-era Llama 3.3 70B. Newly added to the lineup; playground benchmarking is in progress, so no completion metrics yet. The prior Llama generation favoured completion over efficiency.
Avg Tokens40,015Avg Duration14.1sTurns to Checkout5
Shopping Score21/100
Weak
Scores computed from real agent sessions against live UCP-enabled stores. Not estimated — every data point is from an actual tool call, checkout attempt, and store response.
Shopping Score Breakdown
Checkout Rate
Cart Rate
Search Rate
Turn Efficiency
Token Efficiency
63.6% of sessions failed with errors.
Top Stores
| Store | Checkout % | Cart % |
|---|---|---|
| •••••••••••••••• | 0% | 33.3% |
| ucp.travel | 0% | 0% |
| singon.com.np | 0% | 0% |
| everlane.com | 0% | 0% |
| allbirds.com | 0% | 0% |
| •••••••••••••••• | 0% | 0% |
Known Issues
No known issues documented for this model yet.
Token Usage
Avg per Session40,015
Fleet Average74,927
vs Fleet−47%
Median (p50)14,065
p9079,351
Prompt / Completion split
Prompt 39,802 (99%) Completion 214 (1%)
Daily Average Tokens (last 30 days)
Distribution range
Min2,093p259,025p5014,065p7529,048p9079,351Max418,874
Compare With Other Models
MetaLlama 3.3 70B39.3%
GoogleGemini 3.5 Flash38.1%
AnthropicClaude Sonnet 4.634.7%
xAIGrok 4.326.3%GoogleGemini 2.5 Flash23.3%AnthropicClaude Opus 4.822.3%
AlibabaQwen 3.8 Flash22.2%
DeepSeekDeepSeek V3.220.7%GoogleGemini 2.5 Pro19.8%GoogleGemini 3.1 Pro19.6%
OpenAIGPT-4o15%DeepSeekDeepSeek V4.1 Flash14.3%xAIGrok 3 Mini (Reasoning)11.1%OpenAIGPT-5.510.2%OpenAIo4-mini (Reasoning)9.1%AnthropicClaude Opus 59%xAIGrok 4.58.1%AnthropicClaude Sonnet 57.7%DeepSeekDeepSeek V4 Pro7.7%DeepSeekDeepSeek V4 Flash7.5%GoogleGemini 3.8 Flash6.7%DeepSeekDeepSeek R1 (Reasoning)3.6%
Moonshot AIKimi K33.1%AlibabaQwen 3.7 Max2.6%MetaLlama 4 Maverick2.3%GoogleGemini 3.6 Flash1.1%GoogleGemini 3.7 Flash0%OpenAIGPT-6 Luna0%MetaMuse Spark 1.30%AlibabaQwQ 32B (Reasoning)0%