Leaderboard
SciCode
30 models scored · metric: percent correct. Prices are the cheapest listed across all serving providers. Pts/$ = score ÷ blended price (3×input + output) / 4 — how much score each dollar buys.
Best value · top 5 by pts per dollar
- 1.Step 3.5 Flash284
- 2.Step 3.5 Flash 2603257
- 3.Gemini 2.5 Flash-Lite193
- 4.GPT-4o mini174
- 5.Mistral Small 4145
| # | Model | Score | Best in /M | Best out /M | Pts / $ | Context |
|---|---|---|---|---|---|---|
| 🥇 | Fugusakana | 60.1 | — | — | — | 1M |
| 🥈 | Fugu Ultrasakana | 58.7 | $5 | $30 | 5.2 | 1M |
| 🥉 | Qwen3.7 Maxalibaba | 53.5 | $2.50 | $7.50 | 14.3 | 1M |
| 4 | Gemini 2.5 Progoogle | 42.8 | $0.87 | $7 | 17.8 | 1.05M |
| 5 | GPT-5-Codexopenai | 40.9 | $1.10 | $9 | 13.3 | 400K |
| 6 | Step 3.5 Flashstepfun | 40.4 | $0.09 | $0.3 | 284 | 256K |
| 7 | Step 3.7 Flashstepfun | 40 | $0.185 | $1.11 | 96.1 | 256K |
| 8 | Gemini 2.5 Flashgoogle | 39.4 | $0.21 | $1.80 | 64.9 | 1.05M |
| 9 | Step 3.5 Flash 2603stepfun | 38.5 | $0.1 | $0.3 | 257 | 256K |
| 10 | GLM-4.6zhipuai | 38.4 | $0.6 | $2.20 | 38.4 | 205K |
| 11 | Qwen3 Maxalibaba | 38.3 | $1.20 | $6 | 16.0 | 262K |
| 12 | Mistral Small 4mistral | 38 | $0.15 | $0.6 | 145 | 256K |
| 13 | Mistral Large 3mistral | 36.2 | $0.5 | $1.50 | 48.3 | 262K |
| 14 | DeepSeek-R1deepseek | 35.7 | $0.7 | $2.50 | 31.0 | 128K |
| 15 | GLM-4.5zhipuai | 34.8 | $0.6 | $2.20 | 34.8 | 131K |
| 16 | GPT-4o (2024-11-20)openai | 33.3 | $2.50 | $10 | 7.6 | 128K |
| 17 | Devstral 2mistral | 33.1 | $0.4 | $2 | 41.4 | 262K |
| 18 | Mistral Medium 3mistral | 33.1 | $0.4 | $2 | 41.4 | 131K |
| 19 | GPT-4o (2024-08-06)openai | 33.1 | $2.50 | $10 | 7.6 | 128K |
| 20 | GPT-4 Turboopenai | 31.9 | $9 | $27 | 2.4 | 128K |
| 21 | GPT-4o (2024-05-13)openai | 30.9 | $5 | $15 | 4.1 | 128K |
| 22 | GLM-4.5-Airzhipuai | 30.6 | $0.2 | $1.10 | 72.0 | 131K |
| 23 | Mistral Large 2.1mistral | 29.2 | $2 | $6 | 9.7 | 131K |
| 24 | Qwen3-Coder 30B-A3B Instructalibaba | 27.8 | $0.45 | $2.25 | 30.9 | 262K |
| 25 | Llama-3.3-70B-Instructmeta | 26 | $0.22 | $0.5 | 89.7 | 128K |
| 26 | GPT-4o miniopenai | 22.9 | $0.075 | $0.3 | 174 | 128K |
| 27 | Sonarperplexity | 22.9 | $0.25 | $2.50 | 28.2 | 128K |
| 28 | Sonar Properplexity | 22.6 | $3 | $15 | 3.8 | 200K |
| 29 | GLM-4.5Vzhipuai | 22.1 | $0.6 | $1.80 | 24.6 | 64K |
| 30 | Gemini 2.5 Flash-Litegoogle | 19.3 | $0.1 | $0.1 | 193 | 1.05M |
Cheapest scorer: GPT-4o mini at $0.075 input /M.