Intelligence vs. Seconds to Output 500 Tokens, including reasoning model 'thinking' time by Gemini Endpoint

Rank Model Name Score Organization
1 GPT-5 (high) 69.00 OpenAI
2 GPT-5 (medium) 67.50 OpenAI
3 Grok 4 67.50 xAI
4 o3 67.10 OpenAI
5 O3 Pro 67.10 OpenAI
6 O3 Mini 67.10 OpenAI
7 o4-mini (high) 65.00 OpenAI
8 Gemini 2.5 Pro 64.60 Google
9 Gemini 2 5 Pro 05 06 64.60 Google
10 Gemini 2 5 Pro 03 25 64.60 Google
11 Gpt 5 Mini 63.70 OpenAI
12 Qwen3 235B 2507 (Reasoning) 63.60 Alibaba
13 GPT-5 (low) 63.40 OpenAI
14 gpt-oss-120B (high) 61.30 OpenAI
15 Claude 4.1 Opus Thinking 61.00 Anthropic
16 Claude 4 Sonnet Thinking 58.80 Anthropic
17 DeepSeek R1 0528 58.60 Unknown
18 Gemini 2.5 Flash (Reasoning) 58.40 Google
19 Gemini 2 5 Flash Reasoning 04 2025 58.40 Google
20 Gemini 2.5 Pro (May' 25) 58.00 Google
21 Grok 3 mini Reasoning (high) 58.00 xAI
22 GLM-4.5 56.10 Zhipu AI
23 Glm 4 5 Air 56.10 Zhipu AI
24 O3 Mini High 55.50 OpenAI
25 Claude 4 Opus Thinking 55.30 Anthropic
26 Gpt 5 Nano 53.80 OpenAI
27 MiniMax M1 80k 53.10 Unknown
28 Llama Nemotron Super 49B v1.5 (Reasoning) 52.40 Meta
29 O1 51.70 Unknown
30 MiniMax M1 40k 51.10 Unknown
31 EXAONE 4.0 32B (Reasoning) 50.70 Unknown
32 Sonar Reasoning Pro 50.70 Unknown
33 o1-preview 49.30 Unknown
34 gpt-oss-20B (high) 49.00 OpenAI
35 Claude 4 1 Opus 49.00 Anthropic
36 Kimi K2 48.60 Unknown
37 QwQ-32B 47.70 Unknown
38 Gemini 2.5 Flash-Lite (Reasoning) 47.30 Google
39 Gemini 2 5 Flash 47.30 Google
40 Claude 3 7 Sonnet Thinking 47.00 Anthropic
41 GPT-4.1 46.80 OpenAI
42 Gpt 4 1 Nano 46.80 OpenAI
43 Gpt 4 1 Mini 46.80 OpenAI
44 Claude 4 Opus 46.60 Anthropic
45 Llama Nemotron Ultra Reasoning 46.40 Meta
46 Claude 4 Sonnet 45.70 Anthropic
47 o1-pro 45.60 Unknown
48 Qwen3 Coder 480B 45.20 Alibaba
49 Qwen3 Coder 480b A35b Instruct 45.20 Alibaba
50 Qwen3 32B (Reasoning) 44.30 Alibaba
51 DeepSeek V3 0324 (Mar '25) 44.00 Unknown
52 GPT-5 (minimal) 43.80 OpenAI
53 Solar Pro 2 (Reasoning) 43.30 Unknown
54 O1 Mini 43.30 Unknown
55 Nvidia Nemotron Nano 9b V2 Reasoning 43.20 Unknown
56 GPT-4.5 (Preview) 42.40 OpenAI
57 Llama 4 Maverick 41.70 Meta
58 Gemini 2.0 Flash Thinking exp. (Jan '25) 41.70 Google
59 Deepseek R1 Distill Qwen 32b 41.20 Alibaba
60 Llama 3.3 Nemotron Super 49B Reasoning 40.50 Meta
61 Grok 3 39.90 xAI
62 GPT-4o (March 2025) 39.50 OpenAI
63 Mistral Medium 3 38.60 Unknown
64 Gemini 2 0 Pro Experimental 02 05 38.40 Google
65 DeepSeek R1 Distill Qwen 14B 38.20 Alibaba
66 Gemini 2.5 Flash (April '25) 38.00 Google
67 Mistral Medium 3 1 38.00 Unknown
68 Sonar Reasoning 38.00 Unknown
69 Gemini 2.0 Flash 37.80 Google
70 Magistral Medium 37.60 Unknown
71 Deepseek R1 Distill Llama 70b 37.40 Meta
72 Claude 3.7 Sonnet 37.30 Anthropic
73 EXAONE 4.0 32B 37.20 Unknown
74 Qwen3 4B (Reasoning) 36.40 Alibaba
75 Reka Flash 3 36.30 Unknown
76 Magistral Small 36.00 Unknown
77 Gemini 2 0 Flash Experimental 35.50 Google
78 Gemini 2.5 Flash-Lite 34.90 Google
79 Nova Premier 34.80 Unknown
80 DeepSeek V3 (Dec '24) 34.60 Unknown
81 Qwen2.5 Max 34.30 Alibaba
82 Gemini 1.5 Pro (Sep) 33.60 Google
83 Solar Pro 2 Preview 33.60 Unknown
84 Claude 3.5 Sonnet (Oct) 33.50 Anthropic
85 Qwen3 Coder 30B 33.40 Alibaba
86 Qwen3 Coder 30b A3b Instruct 33.40 Alibaba
87 Qwen3 235B 33.30 Alibaba
88 Qwen3 235b A22b Instruct 33.30 Alibaba
89 Solar Pro 2 33.20 Unknown
90 Llama 4 Scout 33.10 Meta
91 Sonar 32.40 Unknown
92 Mistral Small 3 2 31.80 Unknown
93 Sonar Pro 31.70 Unknown
94 Command A 31.60 Unknown
95 Devstral Medium 31.30 Unknown
96 Llama 3.3 70B 31.20 Meta
97 Qwen3 30b A3b Instruct 29.90 Alibaba
98 Qwen3 14B 29.80 Alibaba
99 Qwen3 32B 29.80 Alibaba
100 Qwen3 14b Instruct 29.80 Alibaba
101 Qwen3 32b Instruct 29.80 Alibaba
102 Gemini 2 0 Flash Lite Preview 29.70 Google
103 GPT-4o (Aug '24) 29.40 OpenAI
104 Llama 3.1 405B 29.30 Meta
105 Qwen2.5 72B 29.20 Alibaba
106 Qwen2 5 72b Instruct 29.20 Alibaba
107 Minimax Text 01 29.10 Unknown
108 Claude 3.5 Sonnet (June) 28.80 Anthropic
109 Nova Pro 28.80 Unknown
110 Tulu3 405b 28.70 Unknown
111 GPT-4o (ChatGPT) 28.60 OpenAI
112 Grok 2 28.00 xAI
113 Grok 2 1212 28.00 xAI
114 Phi-4 27.90 Unknown
115 Gemini 1.5 Flash (Sep) 27.70 Google
116 Gpt 4 Turbo 27.50 OpenAI
117 Mistral Large 2 (Nov '24) 27.00 Unknown
118 Qwen3 1.7B (Reasoning) 26.90 Alibaba
119 Llama Nemotron Super 49b V1 5 26.90 Meta
120 Mistral Small 3 1 26.40 Unknown
121 Grok Beta 26.30 xAI
122 Qwen2.5 Instruct 32B 26.10 Alibaba
123 Pixtral Large 2411 26.10 Unknown
124 Qwen3 8B 25.40 Alibaba
125 Qwen3 8b Instruct 25.40 Alibaba
126 Gemma 3 27b 25.20 Unknown
127 Qwen2 5 Coder 32b Instruct 25.00 Alibaba
128 GPT-4 24.60 OpenAI
129 Nova Lite 24.50 Unknown
130 Gpt 4o Mini 24.30 OpenAI
131 Llama 3.1 70B 24.00 Meta
132 Gemma 3 12b 24.00 Unknown
133 DeepSeek-V2.5 (Dec '24) 23.90 Unknown
134 Mistral Small 3 23.90 Unknown
135 Qwen3 4b Instruct 23.80 Alibaba
136 Claude 3 Opus 23.70 Anthropic
137 DeepSeek-V2.5 23.30 Unknown
138 Claude 3.5 Haiku 23.30 Anthropic
139 Gemini 2.0 Flash Thinking exp. (Dec '24) 23.30 Google
140 Deepseek V2 5 Sep 2024 23.30 Unknown
141 Devstral Small (May '25) 22.70 Unknown
142 Mistral Saba 22.60 Unknown
143 Deepseek R1 Distill Llama 8b 22.60 Meta
144 Reka Core 22.40 Unknown
145 R1 1776 22.20 Unknown
146 Gemini 1.5 Pro (May) 22.20 Google
147 Gemini 1 5 Pro May 2024 22.20 Google
148 Qwen2.5 Turbo 22.10 Alibaba
149 Reka Flash 22.10 Unknown
150 Solar Mini 21.90 Unknown
151 Reka Edge 21.50 Unknown
152 Grok 1 21.20 xAI
153 Qwen2 72b Instruct 21.10 Alibaba
154 Devstral Small 20.50 Unknown
155 Nova Micro 20.20 Unknown
156 Gemma 2 27B 20.10 Unknown
157 Gemini 1.5 Flash-8B 19.20 Google
158 Llama 3.1 8B 19.00 Meta
159 Gemma 3n E4B 18.50 Unknown
160 Deephermes 3 Mistral 24b Preview 18.40 Unknown
161 Jamba 1.7 Large 17.90 Unknown
162 Jamba 1.5 Large 17.70 Unknown
163 Granite 3.3 8B 17.60 Unknown
164 Granite 3 3 8b Instruct 17.60 Unknown
165 Hermes 3 Llama 3 1 70b 17.50 Meta
166 Deepseek Coder V2 17.30 Unknown
167 Jamba 1.6 Large 17.10 Unknown
168 Gemini 1.5 Flash (May) 16.80 Google
169 Gemini 1 5 Flash May 2024 16.80 Google
170 Yi-Large 16.20 Unknown
171 Claude 3 Sonnet 16.00 Anthropic
172 Mistral Small (Sep '24) 15.70 Unknown
173 Gemini 1 0 Ultra 15.60 Google
174 Phi-4 Multimodal 15.10 Unknown
175 Qwen2 5 Coder 7b Instruct 14.90 Alibaba
176 Jamba Instruct 14.50 Unknown
177 Mixtral 8x22B 14.40 Unknown
178 Phi 4 Mini 14.20 Unknown
179 Llama 2 Chat 7B 13.90 Meta
180 Gemma 3 4b 13.50 Unknown
181 Claude 2.1 12.20 Anthropic
182 Claude 3 Haiku 12.10 Anthropic
183 Qwen3 0.6B (Reasoning) 11.30 Alibaba
184 Claude 2.0 11.10 Anthropic
185 DeepSeek-V2 11.10 Unknown
186 Mistral Medium 10.90 Unknown
187 Gemma 3n E2B 10.40 Unknown
188 Ministral 8b 10.40 Unknown
189 Gemma 2 9B 10.20 Unknown
190 Phi-3 Mini 10.10 Unknown
191 Qwen Chat 72b 10.00 Alibaba
192 Arctic Instruct 10.00 Unknown
193 Lfm 40b 9.70 Unknown
194 Llama 3 8B 9.50 Meta
195 Command R Plus 9.50 Unknown
196 PALM-2 9.00 Unknown
197 Gemini 1 0 Pro 8.50 Google
198 DeepSeek Coder V2 Lite 8.40 Unknown
199 Aya Expanse 32b 8.00 Unknown
200 Llama 2 Chat 13B 7.90 Meta
201 Llama 2 Chat 70b 7.90 Meta
202 OpenChat 3.5 7.70 Unknown
203 Dbrx 7.70 Unknown
204 Mistral Nemo 7.50 Unknown
205 Ministral 3b 7.50 Unknown
206 Llama 3.2 3B 7.40 Meta
207 Deepseek R1 Distill Qwen 1 5b 7.10 Alibaba
208 Jamba 1.5 Mini 6.30 Unknown
209 Jamba 1 7 Mini 5.80 Unknown
210 Jamba 1.6 Mini 5.50 Unknown
211 Mixtral 8x7b Instruct 4.80 Unknown
212 Qwen3 0.6B 4.50 Alibaba
213 DeepHermes 3 - Llama-3.1 8B 4.00 Meta
214 Deephermes 3 Llama 3 1 8b Preview 4.00 Meta
215 Aya Expanse 8B 3.80 Unknown
216 Command-R+ 2.50 Unknown
217 Claude Instant 1.70 Anthropic
218 Qwen Chat 14b 1.70 Alibaba
219 Codestral-Mamba 1.60 Unknown
220 Gemma 3 1b 1.10 Unknown
221 Llama 3.2 1B 1.00 Meta
222 Mistral 7b Instruct 1.00 Unknown
223 Llama 65b 1.00 Meta
224 GPT-4o Realtime (Dec '24) N/A OpenAI
225 Grok 3 mini Reasoning (low) N/A xAI
226 Gpt 3 5 Turbo 0613 N/A OpenAI