Skip to content
Model Pulse

Lab

llmgateway

189 canonical models tracked · RSS feed for this lab

ModelBest in /MBest out /MContextProvidersReleased
Auto Route1
Claude Fable 5$10$501
Claude Haiku 4.5 (latest)$1$51
Claude Haiku 4.5$1$51
Claude Opus 4.1$15$751
Claude Opus 4.5$5$251
Claude Opus 4.6$5$251
Claude Opus 4.7$5$251
Claude Opus 4.8$5$251
Claude Opus 5$5$251
Claude Sonnet 4.5 (latest)$3$151
Claude Sonnet 4.5$3$151
Claude Sonnet 4.6$3$151
Claude Sonnet 5$2$101
Codestral$0.3$0.91
Cosmos 3 Super Reasoner$0.1$0.31
Custom Model1
DeepSeek V3.2$0.26$0.381
DeepSeek V4 Flash$0.076$0.1531
DeepSeek V4 Pro$0.435$0.871
Devstral 21
ERNIE 4.5 VL 424B A47B$0.42$1.251
Fugu Ultra$5$301
Gemini 2.5 Flash$0.3$2.501
Gemini 2.5 Flash-Lite$0.1$0.41
Gemini 2.5 Pro$1.25$101
Gemini 3 Flash Preview$0.5$31
Gemini 3.1 Flash Lite$0.25$1.501
Gemini 3.1 Pro Preview$2$121
Gemini 3.5 Flash$1.50$91
Gemini 3.5 Flash Lite$0.3$2.501
Gemini 3.6 Flash$0.75$3.751
Gemini 3.7 Flash$0.75$3.751
Gemini Pro Latest$2$121
Gemma 3 27B$0.1$0.31
Gemma 4 26B A4B IT$0.07$0.341
Gemma 4 31B IT$0.102$0.2971
GLM-4 32B (0414-128k)$0.1$0.11
GLM-4.5$0.6$2.201
GLM-4.5-Air$0.13$0.851
GLM-4.5 AirX$1.10$4.501
GLM-4.5 X$2.20$8.901
GLM-4.5V$0.6$1.801
GLM-4.6$0.55$2.201
GLM-4.6V$0.3$0.91
GLM-4.6V FlashX$0.04$0.41
GLM-4.7$0.38$1.981
GLM-4.7-Flash$0.06$0.41
GLM-4.7-FlashX$0.07$0.41
GLM-5$0.72$2.301
GLM-5.1$0.931$2.931
GLM-5.2$0.55$1.781
GLM-5.2$1.99$6.161
GLM-5.3$1.40$4.401
GPT-3.5-turbo$0.5$1.501
GPT-4$30$601
GPT-4 Turbo$10$301
GPT-4.1$2$81
GPT-4.1 mini$0.4$1.601
GPT-4.1 nano$0.1$0.41
GPT-4o$2.50$101
GPT-4o mini$0.15$0.61
GPT-4o Mini Search Preview$0.15$0.61
GPT-4o Mini Transcribe$1.25$51
GPT-4o Search Preview$2.50$101
GPT-4o Transcribe$2.50$101
GPT-5$1.25$101
GPT-5 Mini$0.25$21
GPT-5 Nano$0.05$0.41
GPT-5 Pro$15$1201
GPT-5.1$1.25$101
GPT-5.1 Codex$1.25$101
GPT-5.1 Codex mini$0.25$21
GPT-5.2$1.75$141
GPT-5.2 Codex$1.75$141
GPT-5.2 Pro$21$1681
GPT-5.3 Codex$1.75$141
GPT-5.4$2.50$151
GPT-5.4 mini$0.75$4.501
GPT-5.4 nano$0.2$1.251
GPT-5.4 Pro$30$1801
GPT-5.5$5$301
GPT-5.5 Pro$30$1801
GPT-5.6 Luna$0.2$1.201
GPT-5.6 Sol$5$301
GPT-5.6 Terra$2$121
GPT OSS 120B$0.032$0.141
GPT OSS 20B$0.05$0.21
Grok 4$3$151
Grok 4.1 Fast Non-Reasoning$0.2$0.51
Grok 4.1 Fast Reasoning$0.2$0.51
Grok 4.20 (Non-Reasoning)$2$61
Grok 4.20 (Reasoning)$2$61
Grok 4.20 (Non-Reasoning)$1.25$2.501
Grok 4.20 (Reasoning)$1.25$2.501
Grok 4.3$1.25$2.501
Grok 4.5$2$61
Grok 4.6$2$61
Grok Build 0.1$1$21
Hermes 4 405B$1$31
Hermes 4 70B$0.13$0.41
Hy3$0.14$0.581
Kimi K2$0.57$2.301
Kimi K2 Thinking$0.6$2.501
Kimi K2.5$0.405$1.981
Kimi K2.6$0.22$1.141
Kimi K2.7 Code$0.95$41
Kimi K2.7 Code Highspeed$1.90$81
Kimi K3$3$151
Kimi K3$4.50$22.501
InclusionAI Ling 3.0 Flash$0.06$0.181
Llama 3 70B Instruct$0.51$0.741
Llama 3.1 70B Instruct$0.72$0.721
Llama 3.1 Nemotron Ultra 253B$0.6$1.801
Llama 3.2 11B Instruct$0.07$0.331
Llama 3.2 3B Instruct$0.03$0.051
Llama-3.3-70B-Instruct$0.13$0.41
Llama 4 Maverick 17B Instruct$0.27$0.851
Llama 4 Scout 17B Instruct$0.18$0.591
MiMo-V2.5$0.14$0.281
MiMo-V2.5-Pro$0.435$0.871
MiniCPM-V 4.5$0.658$1.111
MiniMax-M2$0.2$11
MiniMax-M2.1$0.27$1.101
MiniMax M2.1 Lightning$0.12$0.481
MiniMax-M2.5$0.3$1.201
MiniMax-M2.5-highspeed$0.6$2.401
MiniMax-M2.7$0.08$0.321
MiniMax-M2.7-highspeed$0.6$2.401
MiniMax-M3$0.3$1.201
MiniMax Text 01$0.2$1.101
Ministral 14B$0.2$0.21
Ministral 3B$0.1$0.11
Ministral 8B$0.15$0.151
Mistral Large 3$0.5$1.501
Mistral Large (latest)$4$121
Mistral Small 3.2$0.1$0.31
Muse Spark 1.1$1.25$4.251
Muse Spark 1.2$1.25$4.251
Nemotron 3 Nano 30B$0.06$0.241
Nemotron 3 Nano Omni$0.06$0.241
Nemotron 3 Super 120B$0.3$0.91
Nemotron 3 Ultra 550B A55B$0.5$2.201
o1$15$601
o3$2$81
o3-mini$1.10$4.401
o4-mini$1.10$4.401
Qwen Coder Plus$0.502$11
Qwen Flash$0.05$0.41
Qwen Max$1.60$6.401
Qwen-Omni Turbo$0.2$0.81
Qwen Plus$0.4$1.201
Qwen Plus Latest$0.4$1.201
Qwen2.5-VL 72B Instruct$0.25$0.751
Qwen3 235B A22B FP8$0.2$0.81
Qwen3 235B A22B Instruct (2507)$0.09$0.581
Qwen3 235B A22B Thinking (2507)$0.3$31
Qwen3 30B A3B Instruct (2507)$0.1$0.31
Qwen3 32B$0.1$0.31
Qwen3-Coder 30B-A3B Instruct$0.07$0.271
Qwen3-Coder 480B-A35B Instruct$0.38$1.551
Qwen3 Coder Flash$0.3$1.501
Qwen3 Coder Next$0.108$0.6751
Qwen3 Coder Plus$6$601
Qwen3 Max$0.845$3.381
Qwen3-Next 80B-A3B Instruct$0.15$1.201
Qwen3-Next 80B-A3B (Thinking)$0.15$1.201
Qwen3 VL 235B A22B Instruct$0.2$0.881
Qwen3 VL 235B A22B Thinking$0.98$3.951
Qwen3 VL 30B A3B Instruct$0.15$0.61
Qwen3 VL Flash$0.05$0.41
Qwen3-VL Plus$0.2$1.601
Qwen3.5 9B$0.1$0.151
Qwen3.6 35B-A3B$0.248$1.491
Qwen3.6 Flash$0.25$1.501
Qwen3.6 Max Preview$1.30$7.801
Qwen3.6 Plus$0.5$31
Qwen3.7 Flash$0.03$0.131
Qwen3.7 Max$1.25$3.751
Qwen3.7 Plus$0.4$1.601
Qwen3.8 Max Preview$1.81$5.451
Qwen3.5 397B-A17B$0.6$3.601
Seed 1.6 (250615)$0.25$21
Seed 1.6 (250915)$0.25$21
Seed 1.6 Flash (250715)$0.07$0.31
Seed 1.8 (251228)$0.25$21
Sonar$1$11
Sonar Pro$3$151
Sonar Reasoning Pro$2$81