Skip to content

Coding Models

Updated

Which model writes the better working software, from real engineering tests and developers' side-by-side votes.

Coding model leaderboard

147 models · ToolsGuide Score out of 1,000, where 1,000 is a flawless model

20 of 147 models in the chart · ·

All models

Compare#ModelCreatorLicenceInput / 1MScoreFrom votes From tests · countVotes
1Claude Opus 5.5 (Max) AnthropicProprietary$4.00674672 675 · 62,925
2Claude Sonnet 5.5 (xHigh) AnthropicProprietary$2.00636628 641 · 63,428
3Claude Sonnet 5.5 (High) AnthropicProprietary$2.00609562 641 · 65,158
4GPT-6 Astra (Max) OpenAIProprietary$10.00604635 584 · 36,169
5Claude Fable 5.1 (Max) AnthropicProprietary$10.00599599 –7,744
6Claude Opus 5 (Max) AnthropicProprietary$5.00552538 561 · 318,555
7Gemini 4 Argon (High)GoogleProprietary$2.00549527 583 · 21,728
8Claude Opus 5 (High) AnthropicProprietary$5.00538506 561 · 324,739
9Muse Wonder (Max)MetaProprietary$4.00538498 565 · 32,289
10GPT-6.1 Sol (Max) OpenAIProprietary$2.00536611 435 · 23,072
11Claude Fable 5 (High) AnthropicProprietary$10.00526471 564 · 715,899
12Muse Wonder Full (Max)MetaProprietary–525580 449 · 21,639
13DeepSeek-V4.1-Flash-20261017 (Max)DeepSeekMIT–512512 –2,008
14Kimi K3 (Max) Moonshot AIKimi K3 license$2.85511502 517 · 619,592
15GPT-5.6 Sol (xHigh, Codex Harness) OpenAIProprietary$5.00505462 535 · 617,786
16Grok 4.7 (xHigh) xAIProprietary$2.00496483 516 · 25,303
17Claude Haiku 5.5 (High) AnthropicProprietary$0.10495434 540 · 53,514
18GLM-5.3 (Max) Z.aiMIT$1.20489468 503 · 69,828
19MiMo-V2.6-ProXiaomiMIT$0.43488471 500 · 45,041
20MiniMax-M3.1-FlashMiniMaxMiniMax Community License$0.15485435 521 · 31,853
21Muse Spark 1.3 (Max)MetaProprietary$0.10482507 447 · 29,407
22GPT-6 Sol (Max) OpenAIProprietary$2.00482532 413 · 24,608
23MiMo-V2.6-FlashXiaomiMIT$0.14477480 474 · 45,293
24Qwen3.8-Max (0902)AlibabaProprietary$1.65472523 440 · 514,421
25Qwen3.8-MaxAlibabaProprietary$1.65471520 440 · 53,428
26DeepSeek-V4.1-Flash-20260910 (Max)DeepSeekMIT–465465 –3,528
27Mistral Large 4MistralProprietary$0.68460394 508 · 32,832
28Muse Spark 1.3 (xHigh)MetaProprietary$0.10459468 447 · 28,767
29Grok 4.6 (High) xAIProprietary$2.00458463 452 · 210,483
30Gemini 3.8 Flash (High)GoogleProprietary$0.75457432 473 · 310,851
31Hy4 previewTencentApache 2.0–449477 430 · 74,798
32GPT-5.6 Terra (xHigh, Codex Harness) OpenAIProprietary$2.00442377 491 · 613,919
33Claude Opus 4.8 (High) AnthropicProprietary$5.00438406 460 · 918,493
34GLM-5.2 (Max) Z.aiMIT$0.75433451 422 · 916,657
35Claude Opus 4.8 AnthropicProprietary$5.00431389 460 · 917,398
36Gemini 3.7 Flash (High)GoogleProprietary$0.75430438 425 · 312,636
37DeepSeek-V4-Pro (High, 20260813)DeepSeekMIT–430430 –4,714
38DeepSeek-V4-Flash (High)DeepSeekMIT–430430 –4,947
39GPT-5.6 Luna (xHigh, Codex Harness) OpenAIProprietary$0.20430374 470 · 612,501
40GLM-5.3-Flash Z.aiMIT$0.15423453 404 · 318,264
41Grok 4.5 xAIProprietary$2.00421404 433 · 611,082
42Step 5 Preview (High)StepfunProprietary–416416 –4,728
43GPT-6 Luna (Max) OpenAIProprietary$0.10412426 392 · 221,622
44GPT-5.5 (xHigh, Codex Harness) OpenAIProprietary$5.00408369 435 · 615,612
45Claude Sonnet 5 (High) AnthropicProprietary$2.00403393 411 · 715,755
46Qwen3.8-Flash-NextAlibabaqwen-community-1.0–403475 359 · 48,382
47GPT-5.5 (High, Codex Harness) OpenAIProprietary$5.00399348 435 · 617,939
48Claude Opus 4.7 (High) AnthropicProprietary$5.00396408 389 · 617,910
49Claude Opus 4.7 AnthropicProprietary$5.00396406 389 · 618,230
50Muse Spark 1.1MetaProprietary$1.25392394 391 · 47,985
51GPT-5.5 (Codex Harness) OpenAIProprietary$5.00388324 435 · 615,860
52Muse Spark Open (Max)Metamuse-model-license$1.25386382 389 · 41,380
53Muse Spark 1.2 (xHigh)MetaProprietary$0.10384387 380 · 22,163
54Seed2.1 Pro PreviewByteDanceProprietary–375375 –15,123
55Qwen3.8-27BAlibabaApache 2.0$0.40369440 326 · 416,385
56Gemini 3.6 Flash (High)GoogleProprietary$1.50363390 345 · 38,762
57Claude Opus 4.6 (High) AnthropicProprietary$5.00363398 340 · 519,383
58Claude Opus 4.6 AnthropicProprietary$5.00360390 340 · 520,644
59Gemini 3.5 Flash (High)GoogleProprietary$1.50352358 347 · 49,382
60Gemini 3.5 Flash (Medium)GoogleProprietary$1.50349351 347 · 412,137
61GPT-5.4 (High, Codex Harness) OpenAIProprietary$2.50348330 360 · 51,350
62Hy3TencentApache 2.0$0.14347364 335 · 86,256
63Qwen3.7-Max (20260517)AlibabaProprietary$1.25345371 328 · 88,887
64Qwen3.6-Max-PreviewAlibabaProprietary–344344 –2,708
65Kimi K2.6 Moonshot AIModified MIT$0.75343366 328 · 710,166
66GPT-5.4 (Medium, Codex Harness) OpenAIProprietary$2.50341315 360 · 51,380
67Kimi K2.7 Code Moonshot AIModified MIT$0.68337337 336 · 44,962
68GLM-5.1 Z.aiMIT$1.05335365 316 · 510,703
69DeepSeek-V4-Pro Preview (High)DeepSeekMIT–330330 –13,161
70MiniMax-M3MiniMaxMiniMax Community License$0.28330344 321 · 719,803
71GPT-5.4 OpenAIProprietary$2.50328283 360 · 54,130
72MiMo-V2.5-ProXiaomiMIT$0.43323343 310 · 422,493
73DeepSeek-V4-ProDeepSeekMIT–317317 –13,979
74Claude Sonnet 4.6 AnthropicProprietary$3.00316378 279 · 422,822
75Claude Opus 4.5 (High, 32K, 20251101) AnthropicProprietary–315353 290 · 311,029
76beam-1.0-501b-a23bReflectionApache 2.0–309309 –2,930
77MiMo-V2.5XiaomiMIT$0.17308311 306 · 314,910
78Qwen3.6-PlusAlibabaProprietary$0.50307328 294 · 818,587
79Claude Opus 4.5 (20251101) AnthropicProprietary–307334 290 · 313,418
79Gemini 3.1 Pro PreviewGoogleProprietary$2.00307317 301 · 724,199
80DeepSeek-V4-Flash Preview (High)DeepSeekMIT–305305 –10,105
81Inkling-SmallThinkyApache 2.0$0.30303290 313 · 55,323
82InklingThinkyApache 2.0$0.95299293 304 · 315,778
83MiMo-V2-ProXiaomiProprietary–299307 293 · 47,249
84Gemini 3 ProGoogleProprietary–297312 276 · 214,092
85GLM-5 Z.aiMIT$1.00295308 286 · 37,496
86GPT-5.3-Codex (Codex Harness) OpenAIProprietary$1.75293263 341 · 22,641
87Kimi K2.5 (Thinking) Moonshot AIModified MIT–292309 281 · 620,091
88MiniMax-M2.7MiniMaxModified MIT$0.30292282 299 · 415,972
89Gemini 3.5 Flash-LiteGoogleProprietary$0.30291308 268 · 2238
90GPT-5.2 OpenAIProprietary$1.75288295 279 · 21,081
91NVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4)NVIDIAOpenMDW-1.1–286286 –1,843
92GLM-5V-Turbo Z.aiProprietary–284284 –2,403
93GPT-5 (Medium) OpenAIProprietary–284295 276 · 33,092
94Kimi K2.5 (Instant) Moonshot AIModified MIT–283287 281 · 63,264
95Gemini 3 FlashGoogleProprietary$0.50282312 263 · 310,889
96MiniMax-M2.5MiniMaxModified MIT$0.30281274 292 · 27,621
97GPT-5.1 (Medium) OpenAIProprietary$1.25280280 –4,910
98Claude Sonnet 4.5 (High, 32K, 20250929) AnthropicProprietary$3.00279279 –13,250
98Qwen3.5-397B-A17BAlibabaApache 2.0$0.45279283 276 · 321,156
99GPT-5.4 mini (High) OpenAIProprietary$0.75278281 276 · 311,942
100Claude Sonnet 4.5 (20250929) AnthropicProprietary$3.00273273 –15,722
101MiniMax-M2.1 PreviewMiniMaxMIT–272272 –7,638
102Gemini 3 Flash (Minimal)GoogleProprietary$0.50267273 263 · 322,154
103Grok 4.20 Beta (Reasoning, 0309) xAIProprietary–266266 –15,448
104GPT-5.2-Codex OpenAIProprietary$1.75265243 301 · 26,718
105Claude Opus 4.1 (20250805) AnthropicProprietary–263276 244 · 26,927
106Gemma 4 31BGoogleApache 2.0$0.09261261 –14,666
107Solar Pro 4UpstageProprietary$0.30259263 257 · 34,655
108GLM-4.7 Z.aiMIT$0.40259308 229 · 44,007
109DeepSeek-V3.2 (Thinking)DeepSeekMIT$0.28258258 –6,914
110Qwen3.5-122B-A10BAlibabaApache 2.0$0.29258256 259 · 28,235
111Gemma 4 26B A4BGoogleApache 2.0$0.07256256 –1,501
112Grok 4.3 xAIProprietary$1.25255255 –14,954
113Hy3 previewTencenttencent-hunyuan-community–254254 –1,448
114Muse GlimmerMetaApache-2.0–253253 –1,643
115Qwen3.5-27BAlibabaApache 2.0$0.26252255 248 · 27,782
116GPT-5.1-Codex OpenAIProprietary–252242 268 · 25,007
117Laguna M.1PoolsideApache 2.0–250250 –5,395
118GPT-5.1 OpenAIProprietary$1.25244244 –10,711
119GLM-4.6 Z.aiMIT$0.50239244 232 · 26,781
120Claude Haiku 4.5 (20251001) AnthropicProprietary$1.00238237 239 · 229,061
121DeepSeek-V3.2DeepSeekMIT$0.28235235 –9,382
122Kimi K2 Thinking Turbo Moonshot AIModified MIT–232232 –13,092
123MiMo-V2-Flash (Non-Thinking)XiaomiMIT–231237 226 · 45,689
124MiniMax-M2MiniMaxApache 2.0$0.30227217 233 · 56,714
125MiMo-V2-Flash (Thinking)XiaomiMIT–222215 226 · 41,685
126Laguna XS.2PoolsideApache 2.0–221221 –4,228
127Qwen3.5-35B-A3BAlibabaApache 2.0$0.14211194 240 · 21,617
128DeepSeek-V3.2-ExpDeepSeekMIT–210203 215 · 53,969
129Qwen3-Coder-480B-A35B-InstructAlibabaApache 2.0$0.30204205 204 · 412,709
130Mistral Medium 3.5MistralModified MIT$1.50199199 –2,317
131Gemini 2.5 ProGoogleProprietary$1.25196179 223 · 22,730
132Gemini 3.1 Flash-Lite PreviewGoogleProprietary$0.25195195 –14,390
133KAT-Coder-Pro V1UnknownProprietary–195195 –1,504
134GPT-5.1-Codex-Mini OpenAIProprietary–188188 –1,154
134Qwen3.5-FlashAlibabaProprietary–188188 –1,328
135Grok 4.1 Fast (Reasoning) xAIProprietary$0.20187187 –5,489
136Trinity Large ThinkingUnknownApache 2.0–185185 –1,361
137Mistral Large 3MistralApache 2.0$0.50181181 –839
138Grok 4.1 (Thinking) xAIProprietary–174174 –961
139Mercury 2 InceptionProprietary$0.25171153 201 · 2954
140Devstral 2MistralModified MIT–165165 –1,182
141Granite 4.1 8BIBMApache 2.0–163163 –1,768
142Grok Code Fast 1 xAIProprietary$0.20151151 –789
143Grok 4 Fast (Reasoning) xAIProprietary$0.20148148 –742
144Devstral Medium (2507)MistralProprietary–115115 –842

Leaders by app type

The top model for each kind of task, scored from votes on that task alone, and how many models were ranked.

TaskLeaderScoreModels ranked
HTML apps GPT-6.1 Sol (Max) 664146
React apps Claude Opus 5.5 (Max) 722131
Screenshot to web app Claude Opus 5.5 (Max) 61064
Web apps Claude Opus 5.5 (Max) 672147

Fixed tests with right and wrong answers, scored out of 100%.

SWE-Bench Verified

Fixing real bugs in real GitHub projects, checked by the projects' own tests. · Top 10 of 120 · Higher is better

SWE-Bench Pro

Harder, longer software engineering tasks from real codebases. · Top 10 of 61 · Higher is better

Terminal-Bench 2.0

Getting real work done in a command-line terminal. · Top 10 of 54 · Higher is better