Skip to content

Coding Models

Updated

Which model writes the better working software, from real engineering tests and developers' side-by-side votes.

Coding model leaderboard

151 models · ToolsGuide Score out of 1,000, where 1,000 is a flawless model

20 of 151 models in the chart · ·

All models

Compare#ModelCreatorLicenceInput / 1MScoreFrom votes From tests · countVotes
1Claude Opus 5.5 (Max) AnthropicProprietary$4.00648675 630 · 63,473
2Gemini 4 Carbon (High)GoogleProprietary–628628 –2,230
3Claude Sonnet 5.5 (xHigh) AnthropicProprietary$2.00609630 595 · 64,469
4Claude Fable 5.1 (Max) AnthropicProprietary$10.00603603 –8,614
5GPT-6 Astra (Max) OpenAIProprietary$10.00589634 558 · 37,210
6Claude Sonnet 5.5 (High) AnthropicProprietary$2.00582563 595 · 66,371
7Kimi K3.1 Pro (Max) Moonshot AIProprietary$2.00540545 533 · 22,671
8Gemini 4 Argon (High)GoogleProprietary$2.00539528 556 · 23,437
9Claude Opus 5 (Max) AnthropicProprietary$5.00538540 537 · 319,641
10Claude Opus 5 (High) AnthropicProprietary$5.00524505 537 · 326,887
11Muse Wonder (Max)MetaProprietary$4.00524499 541 · 33,724
12GPT-6.1 Terra (Max) OpenAIProprietary$1.00521521 –1,821
13GPT-6.1 Sol (Max) OpenAIProprietary$2.00520608 405 · 24,092
14DeepSeek-V4.1-Flash-20261017 (Max)DeepSeekMIT–513513 –7,842
15Muse Wonder Full (Max)MetaProprietary–509579 415 · 22,248
16Grok 4.7 (xHigh) xAIProprietary$2.00488484 494 · 26,572
17Claude Haiku 5.5 (High) AnthropicProprietary$0.10474436 501 · 54,758
18MiniMax-M3.1-FlashMiniMaxMiniMax Community License$0.15471430 501 · 33,062
19GPT-6 Sol (Max) OpenAIProprietary$2.00467527 387 · 25,714
20DeepSeek-V4.1-Flash-20260910 (Max)DeepSeekMIT–466466 –3,510
21GPT-5.6 Sol (xHigh, Codex Harness) OpenAIProprietary$5.00465462 467 · 618,884
22MiMo-V2.6-ProXiaomiMIT$0.43461472 455 · 46,820
23Mistral Large 4MistralProprietary$0.70460396 507 · 34,068
24Muse Spark 1.3 (Max)MetaProprietary$0.10459503 397 · 210,796
25MiMo-V2.6-FlashXiaomiMIT$0.14454484 435 · 47,068
26Grok 4.6 (High) xAIProprietary$2.00452463 436 · 211,966
27Claude Fable 5 (High) AnthropicProprietary$10.00448470 434 · 716,951
28Kimi K3 (Max) Moonshot AIKimi K3 license$2.85441504 403 · 621,281
29GLM-5.3 (Max) Z.aiMIT$1.20439469 420 · 611,150
30Muse Spark 1.3 (xHigh)MetaProprietary$0.10438466 397 · 210,243
31Gemini 3.8 Flash (High)GoogleProprietary$0.75433431 435 · 312,342
32Qwen3.8-Max (0902)AlibabaProprietary$1.65432524 377 · 517,936
33Qwen3.8-MaxAlibabaProprietary$1.65430520 377 · 53,406
34DeepSeek-V4-Flash (High)DeepSeekMIT–430430 –4,927
34DeepSeek-V4-Pro (High, 20260813)DeepSeekMIT–430430 –4,676
35Step 5 Preview (High)StepFunProprietary–420420 –5,966
36Hy4 previewTencentApache 2.0–412477 373 · 74,765
37GPT-5.6 Terra (xHigh, Codex Harness) OpenAIProprietary$2.00411375 436 · 615,388
38Gemini 3.7 Flash (High)GoogleProprietary$0.75405437 385 · 314,473
39GPT-6 Luna (Max) OpenAIProprietary$0.10404427 370 · 227,808
40GLM-5.3-Flash Z.aiMIT$0.15403453 371 · 321,587
41GPT-5.6 Luna (xHigh, Codex Harness) OpenAIProprietary$0.20401374 420 · 612,522
42GLM-5.2 (Max) Z.aiMIT$0.75397452 363 · 917,817
43Grok 4.5 xAIProprietary$2.00397404 392 · 611,018
44Qwen3.8-Flash-NextAlibabaqwen-community-1.0–395475 348 · 49,703
45Claude Opus 4.8 (High) AnthropicProprietary$5.00385406 372 · 918,408
46Claude Opus 4.8 AnthropicProprietary$5.00378389 372 · 917,323
47Seed2.1 Pro PreviewByteDanceProprietary–374374 –16,294
48Muse Spark 1.2 (xHigh)MetaProprietary$0.10374387 356 · 22,155
49Muse Spark 1.1MetaProprietary$1.25374394 361 · 47,935
50Claude Sonnet 5 (High) AnthropicProprietary$2.00370392 356 · 716,832
51GPT-5.5 (xHigh, Codex Harness) OpenAIProprietary$5.00365368 362 · 615,553
52Muse Spark Open (Max)Metamuse-model-license$1.25364380 353 · 41,721
53Claude Opus 4.7 (High) AnthropicProprietary$5.00363408 336 · 617,859
53Qwen3.8-27BAlibabaApache 2.0$0.40363437 319 · 418,752
54Claude Opus 4.7 AnthropicProprietary$5.00363406 336 · 618,167
55GPT-5.5 (High, Codex Harness) OpenAIProprietary$5.00356348 362 · 617,853
56Gemini 3.6 Flash (High)GoogleProprietary$1.50356390 334 · 38,722
57Claude Opus 4.6 (High) AnthropicProprietary$5.00347398 315 · 519,316
58GPT-5.5 (Codex Harness) OpenAIProprietary$5.00346324 362 · 615,811
59Spark-X2.6SynlanProprietary–344344 –1,210
60Qwen3.6-Max-PreviewAlibabaProprietary–344344 –2,700
61Claude Opus 4.6 AnthropicProprietary$5.00344390 315 · 520,576
62Gemini 3.5 Flash (High)GoogleProprietary$1.50343358 333 · 49,331
63Gemini 3.5 Flash (Medium)GoogleProprietary$1.50340351 333 · 412,075
64Kimi K2.6 Moonshot AIModified MIT$0.75332366 311 · 710,119
65Qwen3.7-Max (20260517)AlibabaProprietary$1.25331371 306 · 88,855
66DeepSeek-V4-Pro Preview (High)DeepSeekMIT–330330 –13,087
67Hy3TencentApache 2.0$0.14328363 306 · 86,844
68GLM-5.1 Z.aiMIT$1.05328365 305 · 510,647
68Kimi K2.7 Code Moonshot AIModified MIT$0.68328337 322 · 44,950
69GPT-5.4 (High, Codex Harness) OpenAIProprietary$2.50328330 327 · 51,345
70Claude Sonnet 4.6 AnthropicProprietary$3.00325377 292 · 422,733
71MiniMax-M3MiniMaxMiniMax Community License$0.28323345 308 · 721,032
72GPT-5.4 (Medium, Codex Harness) OpenAIProprietary$2.50322314 327 · 51,374
73Claude Opus 4.5 (High, 32K, 20251101) AnthropicProprietary–318353 296 · 310,981
74MiMo-V2.5-ProXiaomiMIT$0.43318343 301 · 422,604
75DeepSeek-V4-ProDeepSeekMIT–317317 –13,931
76Claude Opus 4.5 (20251101) AnthropicProprietary–311334 296 · 313,362
77Gemini 3.1 Pro PreviewGoogleProprietary$2.00310317 305 · 724,129
78GPT-5.4 OpenAIProprietary$2.50309284 327 · 54,499
79Qwen3.6-PlusAlibabaProprietary$0.50308328 295 · 818,511
80DeepSeek-V4-Flash Preview (High)DeepSeekMIT–305305 –10,074
81MiMo-V2.5XiaomiMIT$0.17304311 300 · 314,837
82Gemini 3 ProGoogleProprietary–303312 290 · 214,054
83MiMo-V2-ProXiaomiProprietary–301307 297 · 47,225
84Inkling-SmallThinkyApache 2.0$0.30300289 307 · 55,295
85GLM-5 Z.aiMIT$1.00299309 294 · 37,465
86Beam 1.0 501B A23BReflectionApache 2.0$0.40299309 292 · 82,932
87InklingThinkyApache 2.0$0.95298294 301 · 317,073
88Kimi K2.5 (Thinking) Moonshot AIModified MIT–297309 289 · 620,008
89Gemini 3 FlashGoogleProprietary$0.50294312 283 · 310,845
90Gemini 3.5 Flash-LiteGoogleProprietary$0.30294307 275 · 2236
91GPT-5.2 OpenAIProprietary$1.75293295 291 · 21,082
92MiniMax-M2.7MiniMaxModified MIT$0.30292282 299 · 415,890
93GPT-5.3-Codex (Codex Harness) OpenAIProprietary$1.75289263 329 · 22,639
94Kimi K2.5 (Instant) Moonshot AIModified MIT–288287 289 · 63,246
95Qwen3.5-397B-A17BAlibabaApache 2.0$0.45287283 289 · 321,096
96GPT-5.4 mini (High) OpenAIProprietary$0.75285281 287 · 311,893
97GLM-4.7 Z.aiMIT$0.40284308 269 · 43,948
98GLM-5V-Turbo Z.aiProprietary–284284 –2,394
99MiniMax-M2.5MiniMaxModified MIT$0.30283273 299 · 27,594
100NVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4)NVIDIAOpenMDW-1.1–282282 –3,193
101GPT-5 (Medium) OpenAIProprietary–282295 273 · 33,089
102GPT-5.1 (Medium) OpenAIProprietary$1.25280280 –4,891
103Claude Sonnet 4.5 (High, 32K, 20250929) AnthropicProprietary$3.00279279 –13,213
103Gemini 3 Flash (Minimal)GoogleProprietary$0.50279272 283 · 322,080
104Claude Opus 4.1 (20250805) AnthropicProprietary–276276 276 · 26,904
105Solar Pro 4UpstageProprietary$0.30274263 281 · 34,630
106Claude Sonnet 4.5 (20250929) AnthropicProprietary$3.00273273 –15,679
107MiniMax-M2.1 PreviewMiniMaxMIT–272272 –7,573
108Grok 4.20 Beta (Reasoning, 0309) xAIProprietary–266266 –15,404
109Qwen3.5-122B-A10BAlibabaApache 2.0$0.29266256 281 · 28,210
110GPT-5.2-Codex OpenAIProprietary$1.75265242 303 · 26,705
111Qwen3.5-27BAlibabaApache 2.0$0.26263255 275 · 27,767
112Gemma 4 31BGoogleApache 2.0$0.09262262 –15,489
113GPT-5.1-Codex OpenAIProprietary–258242 286 · 24,981
114DeepSeek-V3.2 (Thinking)DeepSeekMIT$0.28258258 –6,860
115Gemma 4 26B A4BGoogleApache 2.0$0.07255255 –1,494
116MiMo-V2-Flash (Non-Thinking)XiaomiMIT–255237 267 · 45,645
117GLM-4.6 Z.aiMIT$0.50255244 272 · 26,755
118Grok 4.3 xAIProprietary$1.25255255 –14,906
119Hy3 previewTencenttencent-hunyuan-community–254254 –1,444
120Muse GlimmerMetaApache-2.0–253253 –1,632
121Claude Haiku 4.5 (20251001) AnthropicProprietary$1.00252237 274 · 228,961
122MiniMax-M2MiniMaxApache 2.0$0.30251217 275 · 56,683
123Laguna M.1PoolsideApache 2.0–249249 –5,359
124MiMo-V2-Flash (Thinking)XiaomiMIT–245214 267 · 41,681
125GPT-5.1 OpenAIProprietary$1.25244244 –10,675
126DeepSeek-V3.2-ExpDeepSeekMIT–240203 267 · 53,968
127Qwen3-Coder-480B-A35B-InstructAlibabaApache 2.0$0.30235205 257 · 412,675
128DeepSeek-V3.2DeepSeekMIT$0.28234234 –9,327
129Kimi K2 Thinking Turbo Moonshot AIModified MIT–232232 –13,045
130Qwen3.5-35B-A3BAlibabaApache 2.0$0.14222194 271 · 21,612
131Laguna XS.2PoolsideApache 2.0–221221 –4,204
132Gemini 2.5 ProGoogleProprietary$1.25211179 265 · 22,724
133Mistral Medium 3.5MistralModified MIT$1.50199199 –2,299
134Gemini 3.1 Flash-Lite PreviewGoogleProprietary$0.25195195 –14,350
135KAT-Coder-Pro V1UnknownProprietary–195195 –1,503
136Mercury 2 InceptionProprietary$0.25192153 262 · 2954
137GPT-5.1-Codex-Mini OpenAIProprietary–188188 –1,154
137Qwen3.5-FlashAlibabaProprietary–188188 –1,321
138Grok 4.1 Fast (Reasoning) xAIProprietary$0.20187187 –5,473
139Trinity Large ThinkingUnknownApache 2.0–185185 –1,352
140Mistral Large 3MistralApache 2.0$0.50182182 –838
141Grok 4.1 (Thinking) xAIProprietary–174174 –961
142Devstral 2MistralModified MIT–165165 –1,182
143Granite 4.1 8BIBMApache 2.0–163163 –1,766
144Grok Code Fast 1 xAIProprietary$0.20151151 –789
145Grok 4 Fast (Reasoning) xAIProprietary$0.20148148 –742
146Devstral Medium (2507)MistralProprietary–115115 –842

Leaders by app type

The top model for each kind of task, scored from votes on that task alone, and how many models were ranked.

TaskLeaderScoreModels ranked
HTML apps GPT-6.1 Sol (Max) 659150
React apps Claude Opus 5.5 (Max) 727135
Web apps Claude Opus 5.5 (Max) 675151

Fixed tests with right and wrong answers, scored out of 100%.

SWE-Bench Verified

Fixing real bugs in real GitHub projects, checked by the projects' own tests. · Top 10 of 123 · Higher is better

SWE-Bench Pro

Harder, longer software engineering tasks from real codebases. · Top 10 of 63 · Higher is better

Terminal-Bench 2.0

Getting real work done in a command-line terminal. · Top 10 of 54 · Higher is better