Leaderboard
SWE-Atlas Refactoring
11 models scored · metric: score. Prices are the cheapest listed across all serving providers. Pts/$ = score ÷ blended price (3×input + output) / 4 — how much score each dollar buys.
Best value · top 5 by pts per dollar
- 1.MiniMax-M2.537.2
- 2.Kimi K2.529.9
- 3.GLM-515.6
- 4.GPT-5.3 Codex9.5
- 5.Gemini 3 Flash Preview8.9
| # | Model | Score | Best in /M | Best out /M | Pts / $ | Context |
|---|---|---|---|---|---|---|
| 🥇 | Claude Opus 4.7anthropic | 48.57 | $5 | $25 | 4.9 | 1M |
| 🥈 | GPT-5.5openai | 44.79 | $4.55 | $27.27 | 4.4 | 1.05M |
| 🥉 | GPT-5.4openai | 44.29 | $2.20 | $14 | 8.6 | 1.05M |
| 4 | GPT-5.3 Codexopenai | 42.38 | $1.60 | $13 | 9.5 | 400K |
| 5 | Claude Opus 4.6anthropic | 35.58 | $5 | $25 | 3.6 | 1M |
| 6 | Gemini 3.1 Pro Previewgoogle | 33.81 | $2 | $12 | 7.5 | 1.05M |
| 7 | Claude Sonnet 4.6anthropic | 32.21 | $3 | $15 | 5.4 | 1M |
| 8 | GLM-5zhipuai | 24.24 | $1 | $3.20 | 15.6 | 205K |
| 9 | Kimi K2.5moonshotai | 20.95 | $0.3 | $1.90 | 29.9 | 262K |
| 10 | MiniMax-M2.5minimax | 19.52 | $0.3 | $1.20 | 37.2 | 205K |
| 11 | Gemini 3 Flash Previewgoogle | 10 | $0.5 | $3 | 8.9 | 1.05M |
Cheapest scorer: Kimi K2.5 at $0.3 input /M.