Leaderboard
SWE-Atlas Test Writing
12 models scored · metric: score. Prices are the cheapest listed across all serving providers. Pts/$ = score ÷ blended price (3×input + output) / 4 — how much score each dollar buys.
Best value · top 5 by pts per dollar
- 1.Kimi K2.536.8
- 2.MiniMax-M2.535.4
- 3.Gemini 3 Flash Preview26.9
- 4.GLM-518.5
- 5.GPT-5.3 Codex8.8
| # | Model | Score | Best in /M | Best out /M | Pts / $ | Context |
|---|---|---|---|---|---|---|
| 🥇 | GPT-5.4openai | 44.36 | $2.20 | $14 | 8.6 | 1.05M |
| 🥈 | GPT-5.5openai | 42.59 | $4.55 | $27.27 | 4.2 | 1.05M |
| 🥉 | GPT-5.4openai | 40 | $2.20 | $14 | 7.8 | 1.05M |
| 4 | GPT-5.3 Codexopenai | 38.98 | $1.60 | $13 | 8.8 | 400K |
| 5 | Claude Opus 4.6anthropic | 36.67 | $5 | $25 | 3.7 | 1M |
| 6 | Claude Opus 4.6anthropic | 36.08 | $5 | $25 | 3.6 | 1M |
| 7 | Claude Sonnet 4.6anthropic | 31.76 | $3 | $15 | 5.3 | 1M |
| 8 | Gemini 3 Flash Previewgoogle | 30.3 | $0.5 | $3 | 26.9 | 1.05M |
| 9 | Gemini 3.1 Pro Previewgoogle | 29.84 | $2 | $12 | 6.6 | 1.05M |
| 10 | GLM-5zhipuai | 28.74 | $1 | $3.20 | 18.5 | 205K |
| 11 | Kimi K2.5moonshotai | 25.77 | $0.3 | $1.90 | 36.8 | 262K |
| 12 | MiniMax-M2.5minimax | 18.6 | $0.3 | $1.20 | 35.4 | 205K |
Cheapest scorer: Kimi K2.5 at $0.3 input /M.