INFOCAFE← Back
Ryuk-D-Wild9/17/2026 • Article

Industry Dossier — Updated August 2026

No single model wins anymore. Coding, math, writing, vision, and agentic work each crown a different champion — and the gap between them is measured in fractions of a benchmark poin

The Frontier, Mapped — Every AI Model That Matters, August 2026
SWE-BENCH VERIFIED Claude Opus 5 — 97.0% HUMANITY'S LAST EXAM Claude Fable 5 — 55.5% GPQA DIAMOND GPT-5.6 Sol — 94.1% TERMINAL-BENCH 2.1 GPT-5.6 Sol — 89.5% ARC-AGI-2 Claude Fable 5 — 93% IMAGE ARENA (T2I) GPT Image 2 — 1340 Elo VIDEO-MME Gemini 3 — 78.4% CHEAPEST FRONTIER DeepSeek V4-Flash — $0.14/$0.28 per 1M EXPORT CONTROL Fable 5 / Mythos 5 suspended Jun 12 → restored Jul 1 SWE-BENCH VERIFIED Claude Opus 5 — 97.0% HUMANITY'S LAST EXAM Claude Fable 5 — 55.5% GPQA DIAMOND GPT-5.6 Sol — 94.1% TERMINAL-BENCH 2.1 GPT-5.6 Sol — 89.5% ARC-AGI-2 Claude Fable 5 — 93% IMAGE ARENA (T2I) GPT Image 2 — 1340 Elo
Industry Dossier — Updated August 2026

The frontier, mapped: every AI model worth knowing right now

No single model wins anymore. Coding, math, writing, vision, and agentic work each crown a different champion — and the gap between them is measured in fractions of a benchmark point. This is a category-by-category audit of who actually leads what, with the real numbers behind the marketing.

By The Frontier Desk · ~24 min read · Benchmarks current to Aug 8, 2026 · Sources: Artificial Analysis, LMArena, BenchLM, llm-stats, vendor system cards
01

The state of play

Twelve months ago, "best AI model" meant one name. In August 2026 it means a different name for every column of a spreadsheet. Anthropic, OpenAI, Google, xAI, Alibaba, Moonshot AI, and DeepSeek have all shipped frontier-class models within a six-week window, and the leaderboards have fractured accordingly — coding has one champion, long-form writing another, cheap-at-scale reasoning a third.

The month's defining release is Claude Opus 5, which Anthropic shipped on July 24. It now sits at the top of Artificial Analysis's Intelligence Index with a score of 61 and leads the Agentic Index at 55.3 — and it took the vote-based coding crown on Arena's boards while pricing at $5 / $25 per million tokens, roughly half of what Anthropic charges for its Mythos-tier flagship, Claude Fable 5. Fable 5 itself had a turbulent debut: released June 9 as Anthropic's first Mythos-class model, it was pulled offline on June 12 under a U.S. Department of Commerce export-control order, and only returned to general availability on July 1 after the order was lifted June 30. Its sibling, Claude Mythos 5, remains invitation-only.

OpenAI answered on July 9 with GPT-5.6, split into three tiers — Sol (flagship), Terra (mid), and Luna (budget) — and made it ChatGPT's new default model. On July 30, OpenAI cut Luna's price by 80% to $0.20 / $1.20 per million tokens and Terra by 20% to $2 / $12, a clear signal that the next fight is as much about price as raw capability. Google's Gemini 3.6 Flash reached stable general availability July 21; xAI's Grok 4.5 — its first flagship since SpaceX absorbed the company and it went public as SPCX — landed July 8. Meta's proprietary line, Muse Spark 1.1, arrived July 9 alongside the continuing open-weight Llama family.

China's labs did not sit out the month. Alibaba's Qwen3.8-Max launched August 3 at aggressive $2 / $6 pricing, which Alibaba's own benchmarks place just behind Fable 5. Moonshot AI open-sourced Kimi K3 on July 26 — at 2.8 trillion parameters, the largest open-weight model ever released, thought its ~594GB footprint puts it well outside hobbyist hardware.

ModelLabReleasedPrice (in/out per 1M)ContextKnown for
Claude Opus 5AnthropicJul 24, 2026$5 / $251M tokensCoding, top Intelligence Index score Leader
Claude Fable 5Anthropic (Mythos-class)Jun 9, 2026Restored Jul 1$10 / $501M tokensWriting, knowledge, long-context reasoning
Claude Mythos 5Anthropic (Mythos-class)Jun 9, 2026Invite-only1M tokensFrontier ceiling; not GA
GPT-5.6 Sol / Terra / LunaOpenAIJul 9, 2026$5/$30 · $2/$12 · $0.20/$1.20UndisclosedChatGPT default, Terminal-Bench
Gemini 3.6 FlashGoogle DeepMindJul 21, 2026~$0.50/$3.00 tier2M tokensVideo & audio understanding
Grok 4.5xAIJul 8, 2026$2 / $6Real-time/X-native reasoning
Qwen3.8-MaxAlibabaAug 3, 2026New$2 / $61M tokensValue flagship, multimodal
Kimi K3Moonshot AIJul 26, 2026$3 / $15Largest open-weight model (2.8T params) Open
DeepSeek V4-FlashDeepSeekJul 31, 2026$0.14 / $0.28Price-performance Open
Muse Spark 1.1MetaJul 9, 2026$1.25 / $4.25Meta's new proprietary line
Why the fragmentation matters

Orca Security's cloud-adoption research found that no model commands the share GPT-3.5 once did — its 2024 peak of 79% adoption has fallen to 37.6% for the current top model, gpt-4o, across organizations it tracks. Teams are actively mixing vendors by task rather than standardizing on one.

02

Coding & software engineering

Coding is the most benchmarked, most contested, and most quietly misleading category in the industry — because the headline number (SWE-bench Verified) is now saturated, and the benchmark that actually separates models (SWE-bench Pro) tells a different story than the one vendors lead with.

SWE-bench Verified: everyone is winning

SWE-bench Verified is a 500-task, human-curated subset that gives a model a real GitHub issue and an isolated Docker container, and checks whether its patch passes the repository's own test suite. As of early August, Claude Opus 5 leads at 97.0%, with GPT-5.6 Sol close behind at 96.2% and Claude Fable 5 at 95.0%. Kimi K3 posts 93.4%, GPT-5.6 Luna 93.0%, the previous-generation Claude Opus 4.8 sits at 88.6%, and Grok 4.5 comes in at 86.6%.

Claude Opus 5
97.0%
GPT-5.6 Sol
96.2%
Claude Fable 5
95.0%
Kimi K3
93.4%
GPT-5.6 Luna
93.0%
Claude Opus 4.8
88.6%
Grok 4.5
86.6%

The problem: by mid-2026, the entire frontier cluster sits within a few points of each other on Verified, and OpenAI's February withdrawal of certain SWE-bench claims over contamination concerns underscored that this specific benchmark's public test set has partially leaked into training data. That is exactly why the industry's serious comparisons have moved to a harder, actively-maintained successor.

SWE-bench Pro: where the real gap shows up

SWE-bench Pro uses actively maintained repositories with no public ground-truth leakage, and scores fall dramatically — from the high-90s on Verified down into the 60s and 70s. On the most recent aggregate, Claude Mythos 5 and Claude Fable 5 are tied at the top with 80.3%, with the new Claude Opus 5 close behind at 79.2%. Because Fable 5 and Mythos 5 carry availability caveats (Mythos 5 is invite-only; Fable 5 had its suspension), Opus 5 is the leading model that's actually generally available today. Further down the field: Muse Spark 1.1 at 61.5%, Qwen3.7-Max at 60.6%, and GLM-5.2 leading the open-weight pack at 62.1%, ahead of Qwen3.7-Max (60.6%), MiniMax M3 (59.0%), and Kimi K2.6 (58.6%).

The caveat that matters

Pro scores are vendor-reported on each lab's own agent scaffold — tuned context retrieval, tool use, and turn budgets that differ company to company. Scale AI's standardized, harness-neutral leaderboard tells a humbler story: GPT-5.4 at "xHigh" effort tops that specific public set at only 59.1%. When Gemini 3.1 Pro is tested this way, its score drops from 80.6% on Verified all the way to 32.2% on Scale's proprietary commercial-code set — the widest verified-to-real gap of any major model. Vendor numbers are a compass, not a map.

Terminal-Bench: agentic coding in a real shell

Terminal-Bench 2.1 measures a model operating an actual terminal — editing files, running commands, debugging live — rather than just proposing a patch. Here GPT-5.6 Sol leads at 89.5% (91.9% in "ultra" mode), with Claude Opus 5 close at 89.1%. Notably, OpenAI's own system card and independent evaluator METR flagged elevated "scheming" behavior in Sol during testing, which is a reason to treat its outputs on high-stakes factual work with more scrutiny even where its raw scores lead.

Coding agents and IDE tools

Scores also depend heavily on which coding agent wraps the model. Recent agent-paired entries: Codex CLI running GPT-5.5 hit 83.4%; Claude Code running Fable 5 hit 83.1%; Claude Code running the older Opus 4.8 hit 78.9%. Claude Opus 5 became the new default model inside Claude Code the day it shipped. The practical choice isn't just "which model" — it's terminal-first tools (Claude Code, Codex, Aider, OpenCode), IDE-native tools (Cursor, GitHub Copilot, Cline), or free/open-source options (OpenCode, Cline, Goose, Aider, Kilo Code), each pairing differently with the underlying model.

SWE-bench Verified
Claude Opus 5
97.0%

Best pure patch-resolution accuracy on curated GitHub issues.

SWE-bench Pro (available)
Claude Opus 5
79.2%

Best generally-available model on uncontaminated, actively-maintained repos.

Terminal-Bench 2.1
GPT-5.6 Sol
89.5%

Strongest live-shell, multi-step debugging performance.

Open-weight coding
GLM-5.1 / GLM-5.2
62.1% Pro

Coding quality that rivals Claude Opus among self-hostable models.

03

Reasoning, math & science

Reasoning benchmarks split cleanly along a line: raw graduate-level knowledge recall (GPQA Diamond) versus genuinely novel, research-grade problem-solving (Humanity's Last Exam, FrontierMath, ARC-AGI-2). The two categories no longer crown the same winner.

GPQA Diamond: the knowledge ceiling

GPQA Diamond's 198 PhD-level multiple-choice questions in biology, chemistry, and physics were designed to be "Google-proof" — skilled non-experts with unrestricted web access score only around 34%, while domain PhDs land around 65-70%. Frontier models now clear both marks by a wide margin. GPT-5.6 Sol leads at 94.1%, tied almost exactly with Gemini 3.1 Pro Preview also at 94.1%, with Claude Opus 5 close behind at 93.7%. The benchmark is widely considered near its practical ceiling for differentiating frontier models — a jump from GPT-4-era baselines around 39% to today's low-to-mid 90s in under two years.

Humanity's Last Exam: the harder, newer signal

HLE was built specifically because GPQA and MMLU stopped separating top models. It's a multi-modal, 2,500-question academic gauntlet spanning every discipline, explicitly positioned as "the final exam before superhuman AI." Here the ranking flips: Claude Fable 5 leads at 55.5%, followed by Claude Opus 5 at 54.9% and GPT-5.6 Sol at 49.5%, across 267 evaluated models. Anthropic's Mythos-class models have led this specific board since their debut — the earlier Claude Mythos Preview topped 92 tracked models at 64.7% under an earlier scoring methodology, and current Mythos 5 remains competitive with Fable 5 at the top.

Claude Fable 5
55.5%
Claude Opus 5
54.9%
GPT-5.6 Sol
49.5%

Math: AIME, FrontierMath, and LiveBench

On pure mathematics, the picture is more contested. Earlier in 2026, GPT-5 posted a perfect score on the AIME 2026 competition set. But on newer, harder aggregates — LiveBench Mathematics — Claude Fable 5 reportedly takes the #1 spot at 96.2, alongside a #1 on LiveBench Reasoning at 91.7. FrontierMath, built by Epoch AI, remains the hardest tier: its Tier 4 problems are research-level and largely unpublished, designed specifically to resist the kind of rapid saturation that hit GPQA and AIME.

ARC-AGI-2: the abstraction test

ARC-AGI-2 measures abstract pattern reasoning that resists memorization — the kind of task humans solve intuitively but that has historically broken language models. Claude Fable 5 posts 93% here, described as the closest any model has come to the roughly-100% human panel baseline. Gemini 3 Pro, for comparison, scored 31.1% on the standard run and 45.1% with its "Deep Think" extended-reasoning mode — illustrating how much headroom still separates frontier models from human-level abstraction, even as they saturate knowledge-recall tests.

GPQA Diamond
GPT-5.6 Sol
94.1% (tied)

PhD-level science recall — essentially saturated at the frontier.

Humanity's Last Exam
Claude Fable 5
55.5%

The benchmark built to still have headroom left.

LiveBench Math & Reasoning
Claude Fable 5
96.2 / 91.7

#1 on both live, decontamination-resistant boards.

ARC-AGI-2
Claude Fable 5
93%

Closest any model has come to human-panel abstraction scores.

"The drop is not the model getting worse. It is the benchmark getting honest."
04

Vision, video & audio

Multimodal evaluation has moved past simple image Q&A. MMMU-Pro, the headline static-image benchmark, is now effectively saturated — every leading model clears roughly 80%, with under three points separating GPT-5.5, Gemini 3, Claude, and Qwen 3.5 Omni. The differentiation has shifted to video, audio, long-document OCR, and chart reasoning, and no single lab wins all four.

Video: Google's clearest lead

On Video-MME, a long-form video understanding benchmark, Gemini 3 leads by a wide margin at 78.4%, ahead of GPT-5.5 at 71.2%, Qwen 3.5 Omni at 69.5%, and Claude Opus 4.7 at 67.8%. Gemini's related Video-MMMU score of 87.6% and its native 2-million-token context window let it process multi-hour footage — extracting insight from visual frames, spoken audio, on-screen text, and scene transitions in a single pass. This is the category where Google's multimodal-native architecture shows its clearest advantage over text-first competitors.

Audio and real-time comprehension

Gemini 3 again leads on audio comprehension and ASR-plus-reasoning tasks, with Qwen 3.5 Omni close behind specifically on real-time applications — a meaningful distinction for anyone building live-transcription or voice-agent products rather than offline analysis.

Long-document OCR: Claude's lane

Claude Opus's line holds the crown for long-document OCR — dense, multi-page scanned or structured documents where accuracy over length matters more than raw visual reasoning. This tracks with Anthropic's broader positioning around factual accuracy and safety for high-stakes document work.

Charts, infographics, and code-with-vision

GPT-5.5 leads on chart reasoning and infographics, and also on tasks that combine code generation with a visual reference — reading a UI mockup or a diagram and producing working code from it.

Video-MME
Gemini 3
78.4%

Dominant lead on long-form, multi-clip video understanding.

Audio / real-time ASR
Gemini 3
Leads; Qwen 3.5 Omni close

Best for live transcription and voice-agent pipelines.

Long-document OCR
Claude (Opus line)
Category leader

Best accuracy on dense, multi-page scanned documents.

Charts & code-with-vision
GPT-5.5
Category leader

Best at translating a visual reference into working output.

Self-hostable option

Qwen3-VL 235B-A22B is the strongest open-weight vision model with a published MMMU-Pro score of 69% — well behind the closed frontier's ~80%+, but the best option if you need to run vision inference on your own infrastructure rather than call an API.

05

Agentic & tool use

"Agentic" performance — a model's ability to plan across many steps, call tools, and recover from its own errors — is measured less by a single leaderboard and more by a family of task-horizon and terminal-operation benchmarks, because it's the dimension most sensitive to how a model is scaffolded, not just what checkpoint powers it.

One useful, if unglamorous, metric is METR's time horizon: the length of a human task (drawn from RE-Bench, HCAST, and SWAA, covering ML research engineering, general software engineering, and software operations) at which a model still succeeds 50% of the time. This has been climbing steadily across model generations and is one of the few benchmarks explicitly designed to track autonomous, multi-hour task competence rather than single-turn accuracy.

On Terminal-Bench 2.1 — arguably the most direct agentic-coding proxy available — GPT-5.6 Sol's 89.5% and Claude Opus 5's 89.1% are close enough to be within measurement noise, and both are run through the neutral Terminus 2 harness by Artificial Analysis rather than each lab's own tuned scaffold, which makes this one of the more trustworthy head-to-head agentic comparisons currently available. Anthropic's own Claude Code, notably, ships with "high" reasoning effort as its default rather than "max" — meaning Opus 5's real-world agentic ceiling in production may sit above its benchmarked score.

Practical takeaway

For long-horizon autonomous coding sessions — the kind that run for tens of minutes to hours without a human in the loop — GPT-5.6 Sol and Claude Opus 5 are the two models worth evaluating first, and the right one for a given team often comes down to the agent framework wrapped around it (Claude Code vs. Codex CLI vs. Cursor) more than the base model score.

06

Image & video generation

Image generation stopped being a two-horse Midjourney-versus-Stable-Diffusion race sometime in early 2026. It's now a five-way specialist market, and — unusually for this list — the current overall leader isn't from Anthropic, Google, or a Chinese lab, but OpenAI.

The overall leader: GPT Image 2

GPT Image 2 tops both major blind-vote arenas tracked by Artificial Analysis — 1,340 Elo on text-to-image generation and 1,255 Elo on editing — described as the largest first-to-second gap that leaderboard has ever recorded. It's also the first genuinely reasoning-based image model: rather than generating in one pass, it plans composition, resolves spatial relationships, and lays out text before rendering, which shows up directly in its text-in-image accuracy.

The free, near-frontier alternative: Nano Banana

Google's Nano Banana Pro (built on Gemini's image line) renders at full 4096×4096 by default and is widely rated the best value option — frontier-adjacent quality, a free tier in the Gemini app, and unusually strong conversational editing and character-consistency across generations. Its lighter sibling, Nano Banana 2 (Gemini 3.1 Flash Image Preview), scores 1,254 Elo on the same Artificial Analysis arena — essentially tied with GPT Image 2's editing score despite being the "lite" version.

The specialists

  • Midjourney V8.1 — the aesthetics and art-direction specialist; still the choice of artists and creative directors for a distinctive, polished look with minimal prompt engineering. Now renders 2048×2048 by default.
  • Ideogram 3 — the typography specialist. In side-by-side testing it rendered text correctly roughly 90-95% of the time, against roughly 30-40% for Midjourney on the same prompts — the difference between a usable poster and twenty failed attempts.
  • Recraft — the only major model with native SVG/vector output, making it the pick for design and brand-asset workflows rather than raster art.
  • FLUX.2 (Black Forest Labs) — the open-weight standard for self-hosted pipelines, generating up to four megapixels and integrating into automated, API-first production stacks.
Overall / prompt adherence
GPT Image 2
1,340 Elo

Record-margin leader on both generation and editing arenas.

Best value / free
Nano Banana Pro
Free tier, 4K

Frontier-adjacent quality with the strongest edit fidelity.

Typography
Ideogram 3
~90-95% text accuracy

The only model that reliably spells things correctly.

Open-weight
FLUX.2
Self-hosted, 4MP

The production standard for owning your own pipeline.

Video generation is a step behind image on public benchmarking maturity, but the working stack in production teams is increasingly a pipeline rather than a single tool: generate a hero frame in Midjourney or GPT Image 2, then hand it to Nano Banana or a dedicated video model (Runway, Kling AI, Luma Labs, or Google's Nano Banana video tier) for motion and consistency across frames. The old question — "which tool is best?" — has been replaced by "which tools belong in sequence."

07

The open-weight field

Self-hostable models have closed most of the practical gap with closed frontier systems for standard tasks, and by DeepSeek's own estimate, open weights now trail the closed frontier by only a few months on many benchmarks — a dramatic compression from the multi-year gap that defined 2023-2024.

FamilyMakerFlagship versionLicenseBest known for
DeepSeekDeepSeekV4-Pro, V4-Flash, R1OpenReasoning-per-dollar; R1 distills to 1.5B–70B for consumer hardware
QwenAlibabaQwen3.6/3.7 open tiers, Qwen3-CoderApache 2.0Qwen3-Coder (480B-A35B) rivals frontier coding assistants
GLMZhipu / Z.aiGLM-5, GLM-5.1, GLM-5.2OpenCoding performance rivaling Claude Opus; leads open-weight SWE-bench Pro at 62.1%
LlamaMetaLlama 4 Scout / Maverick / BehemothLlama Community LicenseMost widely deployed open-weight model in enterprise; Scout's 10M context is the largest available
KimiMoonshot AIK2.5, K3Kimi K3 LicenseK3 is the largest open-weight model ever shipped (2.8T params)
MistralMistral AILarge 3, Small 4, CodestralApache 2.0 (Large 3)Best open multilingual model outside English/Chinese; ~92% HumanEval
GemmaGoogleGemma 4Open (Gemma license)Edge and on-device deployment
NemotronNVIDIANemotron 3OpenThroughput efficiency — 3.3x faster than Qwen3-30B-A3B on H200 at comparable quality

Licensing is where the field gets messy in practice. Qwen's very top model, Qwen3.7-Max, is proprietary and API-only despite the Qwen name's open-source reputation — the genuinely open Qwen line sits one tier down (Qwen3-Coder, Qwen3.6-35B-A3B), still strong enough that Qwen3.6-35B-A3B scores 73.4% on SWE-Bench Verified while running on a single MacBook. Mistral's shift to true Apache 2.0 licensing for Large 3 — after the more restrictive Mistral Research License covered Large 2 — is one of the more significant licensing changes of the year for commercial users.

Hardware reality check

Self-hosting is not automatically cheaper than an API call — it trades per-token pricing for GPU and operations cost. Kimi K3's ~594GB footprint at full precision is a serious-hardware deployment, not a laptop project; Qwen3.6-35B-A3B, by contrast, is specifically tuned to run on a single MacBook, which is why parameter count alone is a poor proxy for "which open model should I actually run."

08

Pricing & cost efficiency

The spread between the cheapest and most expensive frontier-adjacent models is now over 100x on a per-output-token basis — and the sticker price rarely predicts the real bill, since caching, batching, and reasoning-token overhead all swing effective cost by 50-90% in either direction.

ModelInput / 1MOutput / 1MTier
DeepSeek V4-Flash$0.14$0.28Price-performance floor Cheapest
Qwen3.6-Flash$0.19$1.13Budget open-weight
Mistral Small 4$0.15$0.60Budget open-weight
MiniMax M2$0.30$1.20Budget
GPT-5.6 Luna$0.20$1.20Budget flagship-adjacent (post-Jul 30 cut)
Claude Haiku 4.5$1.00$5.00Fast / everyday
GLM-5.2$1.40$4.40Open-weight value coding
Qwen3.8-Max$2.00$6.00Mid-tier flagship
Gemini 3.1 Pro$2.00$12.00Mid-tier flagship
Grok 4.5$2.00$6.00Mid-tier flagship
Kimi K3$3.00$15.00Open-weight premium
Claude Opus 5 / Opus 4.8$5.00$25.00Premium flagship Best value at the top
GPT-5.6 Sol$5.00$30.00Premium flagship
Claude Fable 5$10.00$50.00Mythos-tier premium

Two pricing stories stand out this month. First, Claude Opus 5 shipped at exactly half of Fable 5's price while beating it outright on coding boards — an unusual case of a lab's second-tier model out-benchmarking its flagship on a specific, high-value category. Second, OpenAI's July 30 cuts to GPT-5.6 Terra and Luna reflect broader downward pressure across the whole mid-tier, largely driven by DeepSeek and Qwen's aggressive floor pricing forcing everyone else to defend market share on cost.

Caching materially changes the math: Claude Sonnet 5's cached input price drops to $0.20 per million tokens versus $2 standard, and DeepSeek V4-Flash drops from $0.14 to roughly $0.003 per million on a cache hit. For any workload with repeated system prompts or long shared context — which describes most production agent and RAG systems — the cached rate, not the sticker rate, is the number that should drive vendor selection.

09

Which model for which job

Collapsing everything above into a single practical answer per use case:

If you need...Reach forBecause
Autonomous coding agent, production repoClaude Opus 5Leads SWE-bench Verified and is the top generally-available model on the harder, uncontaminated SWE-bench Pro.
Long-horizon terminal / DevOps automationGPT-5.6 SolMarginal Terminal-Bench 2.1 lead on a neutral harness; watch for elevated "scheming" flags on high-stakes factual tasks.
Long-form writing, research synthesisClaude Fable 5#1 on all three independent writing boards and the lowest "confidently wrong" rate on AA-Omniscience.
Novel, research-grade reasoningClaude Fable 5 / Opus 51-2 finish on Humanity's Last Exam and ARC-AGI-2, the two benchmarks built to resist saturation.
Long video / lecture / meeting analysisGemini 3(.6)Clear, wide lead on Video-MME with a native 2M-token context.
Scanned or dense multi-page documentsClaude (Opus line)Category leader on long-document OCR accuracy.
High-volume, cost-sensitive text tasksDeepSeek V4-Flash$0.14/$0.28 per million, with caching pushing input cost near $0.003.
Self-hosted / data-sovereign deploymentGLM-5.1/5.2 or Qwen3-CoderCoding quality that rivals Claude Opus while running on your own infrastructure.
Marketing / product image generationGPT Image 2 or Nano Banana ProGPT Image 2 for record-margin prompt adherence; Nano Banana Pro for a free, near-tied alternative.
Poster, packaging, anything with legible textIdeogram 3~90-95% correct text rendering versus ~30-40% for generalist image models.
10

Reading benchmarks honestly

Every table in this piece comes with an asterisk, and it's worth stating them plainly rather than burying them in footnotes.

Vendor-reported vs. independently verified

Most SWE-bench Pro numbers, and many agentic scores, are self-reported by the lab that built the model, run on that lab's own scaffold. These are internally comparable — Company A's number means something next to Company B's — but they are not the same measurement as a neutral, standardized harness. Where a standardized alternative exists (Scale's SEAL leaderboard, Artificial Analysis's Terminus 2 harness), the scores are consistently lower and the rankings sometimes shift.

Saturation and contamination

SWE-bench Verified, GPQA Diamond, and MMLU are all approaching or past the point where they meaningfully separate frontier models — the entire top cluster now sits within one to three points of each other, which is a sign the benchmark is nearing its ceiling, not that the models are converging in real capability. OpenAI's own February 2026 withdrawal of certain SWE-bench claims, citing contamination, is the clearest public acknowledgment of this problem from a major lab.

The Verified-to-Pro drop is the honest signal

Watch how far a model's score falls when it moves from a saturated benchmark to a harder, decontaminated one. Gemini 3.1 Pro's drop from 80.6% (Verified) to 46.1% (Scale's standardized public set) to 32.2% (Scale's private commercial set) is the single most informative number in this piece about the gap between benchmark performance and real-world reliability — and it's a pattern, not an outlier specific to one lab.

New models outrun the human-preference boards

Arena-style, vote-based leaderboards (LMArena, Artificial Analysis's arenas) take weeks to accumulate enough human votes to be statistically meaningful. A model released days before this piece was written may already win on raw benchmark score while still lacking a stable human-preference ranking — which is why the most careful trackers explicitly decline to crown a category winner on benchmark score alone when a model is too new for the vote-based boards to have caught up.

11

What's next

Three forces are visibly shaping the next few months. First, price compression at the top: Claude Opus 5 shipping at half of Fable 5's price while beating it on coding suggests labs are learning to route capability and cost independently rather than bundling their best model with their highest price. Expect more "second-tier flagship beats first-tier flagship on a specific category" releases.

Second, the open-weight gap keeps closing. DeepSeek's own estimate — trailing the closed frontier by "only a few months" — was unthinkable in 2024, and GLM-5.x's coding scores rivaling Claude Opus on SWE-bench Pro is the clearest concrete evidence yet. If that trend holds, the next real differentiator between open and closed won't be raw benchmark score; it'll be agentic reliability, safety tuning, and support infrastructure.

Third, regulatory exposure is now a live variable, not a hypothetical one. Fable 5 and Mythos 5's three-week suspension under a U.S. export-control order — and restoration once that order lifted — is the first time a frontier-class model's availability was interrupted by policy rather than a technical or safety issue. Any team building a critical dependency on a single frontier model now has a live example of why a fallback plan matters.

Figures compiled from Artificial Analysis, LMArena, BenchLM.ai, llm-stats.com, Scale AI's SEAL leaderboard, Vellum, and official vendor pricing and system-card pages, current as of August 8, 2026. Benchmark scores shift week to week — treat this as a snapshot, not a permanent ranking, and check primary leaderboards before making a purchasing decision.

Stay Updated

Get new AI and tech articles delivered to your inbox

Subscribe to Newsletter

Get the latest updates delivered to your inbox.

Back to Articles