Leaderboard · Compare · GPT-5 vs Grok 4 · Updated
GPT-5 vs Grok 4
GPT-5 edges out Grok 4 on the composite (86.0 vs 83.6). The gap is meaningful but not decisive — see the per-benchmark breakdown below.
At a glance
| Spec | GPT-5 | Grok 4 |
|---|---|---|
| Provider | OpenAI | xAI |
| Released | 2025-08 | 2025-07 |
| Tier | frontier | frontier |
| License | Closed | Closed |
| Context window | 400k | 256k |
| $ in / out (per 1M) | $1.25 / $10.00 | $3.00 / $15.00 |
Benchmark scoreboard
Higher is better on every benchmark. Δ shows GPT-5 − Grok 4.
| Benchmark | GPT-5 | Grok 4 | Δ |
|---|---|---|---|
| Chatbot Arena Elo | 1410 | 1378 | +32 |
| MMLU-Pro | 86.8 | 86.6 | +0.2 |
| GPQA Diamond | 87.3 | 87.7 | -0.4 |
| MATH | 96.7 | 95.0 | +1.7 |
| HumanEval | 95.1 | 93.0 | +2.1 |
| SWE-Bench Verified | 74.9 | 72.0 | +2.9 |
Numbers compiled from provider technical reports and Chatbot Arena snapshots — see methodology.
OpenRouter routes GPT-5, Grok 4, and 100+ other LLMs behind a single API key — pay-as-you-go, no monthly minimum, fallback if a provider is down. Try OpenRouter → (affiliate · supports this site)
GPT-5 vs Grok 4: where each one wins
GPT-5 is stronger on
- Arena
- MMLU-Pro
- MATH
- HumanEval
- SWE-Bench
Grok 4 is stronger on
- GPQA
Cost comparison
At 10M tokens/day (50/50 split), GPT-5 costs ~$56.25/day vs $90.00/day for Grok 4 — GPT-5 is the cheaper pick at this volume.
Verdict
GPT-5 edges out Grok 4 on the composite (86.0 vs 83.6). The gap is meaningful but not decisive — see the per-benchmark breakdown below.
If you can only pick one and your workload is unclear, route via OpenRouter and switch by request — same key, no lock-in.
Frequently asked questions
Which is better, GPT-5 or Grok 4?
GPT-5 edges out Grok 4 on the composite (86.0 vs 83.6). The gap is meaningful but not decisive — see the per-benchmark breakdown below. GPT-5 wins on Arena, MMLU-Pro, MATH, HumanEval, SWE-Bench; Grok 4 wins on GPQA.
What does GPT-5 cost compared to Grok 4?
At 10M tokens/day (50/50 split), GPT-5 costs ~$56.25/day vs $90.00/day for Grok 4 — GPT-5 is the cheaper pick at this volume.
What is the context window of GPT-5 vs Grok 4?
GPT-5: 400k tokens. Grok 4: 256k tokens. GPT-5 has the larger window — useful for long-document RAG and full-codebase prompting.
Is GPT-5 or Grok 4 open source?
GPT-5: closed / proprietary. Grok 4: closed / proprietary.
Can I try GPT-5 and Grok 4 on the same API key?
Yes — OpenRouter routes both models behind a single key, so you can A/B test GPT-5 against Grok 4 without juggling provider accounts.
Model deep-dives: GPT-5 · Grok 4 · Full leaderboard
Spotted out-of-date numbers? Open an issue — corrections usually ship within 24h.
Try GPT-5 and Grok 4 now
One API key, both models — switch between them per request and let real traffic pick the winner.