Leaderboard
DeepSWE
12 models scored · metric: resolve rate. Prices are the cheapest listed across all serving providers. Pts/$ = score ÷ blended price (3×input + output) / 4 — how much score each dollar buys.
Best value · top 5 by pts per dollar
- 1.DeepSeek V4 Flash 0731518
- 2.GPT-5.6 Luna299
- 3.Gemini 3.7 Flash87.1
- 4.Gemini 3.6 Flash32.7
- 5.GPT-5.6 Terra30.9
| # | Model | Score | Best in /M | Best out /M | Pts / $ | Context |
|---|---|---|---|---|---|---|
| 🥇 | GPT-5.6 Solopenai | 72.7 | $2.50 | $15 | 12.9 | 1.05M |
| 🥈 | GPT-5.6 Terraopenai | 69.6 | $1 | $6 | 30.9 | 1.05M |
| 🥉 | Claude Opus 5anthropic | 68.8 | $5 | $25 | 6.9 | 1M |
| 4 | Kimi K3moonshotai | 67.5 | $2.50 | $13.50 | 12.9 | 1.05M |
| 5 | GPT-5.6 Lunaopenai | 67.2 | $0.1 | $0.6 | 299 | 1.05M |
| 6 | Gemini 3.7 Flashgoogle | 65.3 | $0.375 | $1.88 | 87.1 | 1.05M |
| 7 | Grok 4.5xai | 62 | $2 | $6 | 20.7 | 500K |
| 8 | DeepSeek V4 Flash 0731deepseek | 54.4 | $0.08 | $0.18 | 518 | 1M |
| 9 | Muse Spark 1.1meta | 53.3 | $1.25 | $4.25 | 26.6 | 1M |
| 10 | Grok 4.5xai | 53 | $2 | $6 | 17.7 | 500K |
| 11 | Gemini 3.6 Flashgoogle | 49 | $0.75 | $3.75 | 32.7 | 1.05M |
| 12 | GLM-5.2zhipuai | 46.2 | $1.40 | $4.40 | 21.5 | 1M |
Cheapest scorer: DeepSeek V4 Flash 0731 at $0.08 input /M.