Leaderboard
SWE-Atlas Codebase QnA
26 models scored · metric: score. Prices are the cheapest listed across all serving providers. Pts/$ = score ÷ blended price (3×input + output) / 4 — how much score each dollar buys.
Best value · top 5 by pts per dollar
- 1.DeepSeek V4 Pro125
- 2.Kimi K2.658.3
- 3.GLM-5.134.0
- 4.MiniMax-M2.519.6
- 5.Kimi K2.518.7
| # | Model | Score | Best in /M | Best out /M | Pts / $ | Context |
|---|---|---|---|---|---|---|
| 🥇 | Claude Opus 4.7anthropic | 81 | $5 | $25 | 8.1 | 1M |
| 🥈 | GPT-5.5openai | 80.8 | $4.55 | $27.27 | 7.9 | 1.05M |
| 🥉 | GPT-5.5openai | 79.1 | $4.55 | $27.27 | 7.7 | 1.05M |
| 4 | Claude Opus 4.7anthropic | 78.4 | $5 | $25 | 7.8 | 1M |
| 5 | GPT-5.5openai | 75 | $4.55 | $27.27 | 7.3 | 1.05M |
| 6 | GLM-5.1zhipuai | 73.2 | $1.40 | $4.40 | 34.0 | 200K |
| 7 | GPT-5.4openai | 72.9 | $2.20 | $14 | 14.2 | 1.05M |
| 8 | GPT-5.4openai | 72.4 | $2.20 | $14 | 14.1 | 1.05M |
| 9 | Claude Opus 4.6anthropic | 71.9 | $5 | $25 | 7.2 | 1M |
| 10 | Claude Opus 4.7anthropic | 71.7 | $5 | $25 | 7.2 | 1M |
| 11 | Claude Sonnet 4.6anthropic | 70.3 | $3 | $15 | 11.7 | 1M |
| 12 | DeepSeek V4 Prodeepseek | 67.8 | $0.435 | $0.87 | 125 | 1M |
| 13 | Kimi K2.6moonshotai | 59.8 | $0.5 | $2.60 | 58.3 | 262K |
| 14 | Gemini 3.1 Pro Previewgoogle | 45.6 | $2 | $12 | 10.1 | 1.05M |
| 15 | GPT-5.5openai | 45.43 | $4.55 | $27.27 | 4.4 | 1.05M |
| 16 | GPT-5.4openai | 40.8 | $2.20 | $14 | 7.9 | 1.05M |
| 17 | GPT-5.4openai | 36.3 | $2.20 | $14 | 7.0 | 1.05M |
| 18 | Claude Opus 4.6anthropic | 33.3 | $5 | $25 | 3.3 | 1M |
| 19 | GPT-5.3 Codexopenai | 32.6 | $1.60 | $13 | 7.3 | 400K |
| 20 | Claude Sonnet 4.6anthropic | 31.2 | $3 | $15 | 5.2 | 1M |
| 21 | Claude Opus 4.6anthropic | 30 | $5 | $25 | 3.0 | 1M |
| 22 | GLM-5zhipuai | 20.5 | $1 | $3.20 | 13.2 | 205K |
| 23 | Gemini 3.1 Pro Previewgoogle | 13.5 | $2 | $12 | 3.0 | 1.05M |
| 24 | Kimi K2.5moonshotai | 13.1 | $0.3 | $1.90 | 18.7 | 262K |
| 25 | MiniMax-M2.5minimax | 10.3 | $0.3 | $1.20 | 19.6 | 205K |
| 26 | Gemini 3 Flash Previewgoogle | 8.2 | $0.5 | $3 | 7.3 | 1.05M |
Cheapest scorer: Kimi K2.5 at $0.3 input /M.