Wordle Bench

Evaluating LLMs on their Wordle-solving capabilities

Leaderboard

Rank Model Provider Success Rate Avg Guesses Avg Cost
1 gpt-5 openai
99%
3.59 $0.20
2 claude-sonnet-4.6 anthropic
98%
3.7 $0.14
3 gpt-5.4 openai
98%
3.57 $0.09
4 claude-fable-5 anthropic
97%
3.51 $0.18
5 gpt-5.5 openai
97%
3.57 $0.22
6 gpt-5.6-sol openai
97%
3.53 $0.07
7 claude-sonnet-5 anthropic
96%
3.74 $0.04
8 gpt-5.6-terra-pro openai
96%
3.5 $0.12
9 qwen3.7-plus qwen
96%
3.66 $0.02
10 claude-opus-4.6 anthropic
95%
3.58 $0.14
11 gpt-5.1 openai
95%
3.6 $0.13
12 grok-4.20-beta x-ai
95%
3.68 $0.07
13 claude-opus-4.8 anthropic
94%
3.51 $0.08
14 gemini-3-pro-preview google
94%
3.53 $0.14
15 gpt-5-mini openai
94%
3.62 $0.04
16 gpt-5.6-luna openai
94%
3.69 $0.01
17 gpt-5.6-sol-pro openai
94%
3.5 $0.34
18 claude-opus-4.5 anthropic
93%
3.62 $0.29
19 gemini-3.1-flash-lite-preview google
93%
3.69 $0.01
20 qwen3.7-max qwen
92%
3.53 $0.06
21 grok-4.5 x-ai
92%
3.62 $0.10
22 gpt-5.6-luna-pro openai
91%
3.54 $0.08
23 gpt-5.6-terra openai
91%
3.49 $0.03
24 qwen3.6-plus qwen
90%
3.56 $0.06
25 gpt-5.4-mini openai
89%
3.72 $0.05
26 grok-4.1-fast x-ai
89%
3.73 $0.01
27 claude-opus-4.7 anthropic
87%
3.53 $0.10
28 claude-sonnet-4.5 anthropic
87%
3.63 $0.08
29 gemma-4-31b-it google
87%
3.56 $0.00
30 gpt-5.2 openai
87%
3.68 $0.03
31 kimi-k2.5 moonshotai
86%
3.59 $0.05
32 gpt-5.4-nano openai
86%
3.72 $0.01
33 qwen3-max-thinking qwen
86%
3.74 $0.24
34 gpt-5-nano openai
85%
3.69 $0.01
35 grok-4.3 x-ai
85%
3.74 $0.05
36 mimo-v2-flash xiaomi
85%
3.65 $0.00
37 mistral-medium-3-5 mistralai
84%
3.87 $0.30
38 qwen3-next-80b-a3b-thinking qwen
83%
3.69 $0.04
39 kimi-k2.6 moonshotai
81%
3.75 $0.21
40 mimo-v2-pro xiaomi
81%
3.77 $0.03
41 claude-haiku-4.5 anthropic
80%
3.71 $0.08
42 mimo-v2.5-pro xiaomi
80%
3.76 $0.04
43 glm-5.2 z-ai
78%
3.74 $0.07
44 gemini-3.1-pro-preview google
75%
3.64 $0.19
45 glm-5-turbo z-ai
75%
3.73 $0.03
46 gemini-2.5-pro google
72%
3.6 $0.16
47 gpt-oss-120b openai
72%
3.74 $0.01
48 nemotron-3-ultra-550b-a55b nvidia
71%
3.79 $0.03
49 gemini-3.5-flash google
66%
3.44 $0.06
50 gemini-2.5-flash google
63%
3.83 $0.03
51 qwen3.5-397b-a17b qwen
63%
3.63 $0.08
52 glm-5 z-ai
63%
3.59 $0.06
53 mistral-small-2603 mistralai
61%
3.98 $0.01
54 nemotron-3-nano-30b-a3b nvidia
58%
3.66 $0.01
55 gpt-oss-20b openai
55%
3.85 $0.01
56 qwen3.6-27b qwen
54%
3.5 $0.05
57 deepseek-v4-flash deepseek
52%
3.52 $0.00
58 gemini-3-flash-preview google
52%
3.46 $0.02
59 qwen3.5-122b-a10b qwen
52%
3.56 $0.14
60 qwen3.5-27b qwen
51%
3.61 $0.06
61 mimo-v2.5 xiaomi
51%
3.67 $0.02
62 qwen3.6-flash qwen
50%
3.76 $0.06
63 gemma-4-26b-a4b-it google
49%
3.41 $0.01
64 glm-5.1 z-ai
48%
3.5 $0.08
65 glm-4.7 z-ai
46%
3.67 $0.07
66 minimax-m2.5 minimax
42%
4.24 $0.01
67 qwen3.5-35b-a3b qwen
38%
3.79 $0.04
68 minimax-m3 minimax
35%
3.77 $0.05
69 qwen3.6-35b-a3b qwen
35%
3.49 $0.07
70 deepseek-v4-pro deepseek
25%
3.08 $0.08
71 minimax-m2.7 minimax
22%
4.14 $0.01
72 mistral-large-2512 mistralai
10%
3.7 $0.00
73 glm-4.7-flash z-ai
7%
4.0 $0.01
74 trinity-large-thinking arcee-ai
3%
2.67 $0.04

Hardest words to solve

Rank Word
1 WAFER
2 PIPER
3 EAGER
4 EXPEL
5 BOOZY
6 PROXY
7 FIFTY
8 CATCH
9 MUMMY
10 VALUE

Models with most errors

Rank Model
1 trinity-large-thinking
2 glm-4.7-flash
3 deepseek-v4-pro
4 minimax-m3
5 qwen3.6-35b-a3b
6 gemma-4-26b-a4b-it
7 gemini-3-flash-preview
8 glm-5.1
9 deepseek-v4-flash
10 mimo-v2.5