Prediction Open AI assessment confidence: 95% certainty 4/5 debate potential 3/5

Swyx: AI context windows will remain capped near 1M for 5-10 years

Shawn Wang · Claude Code for Finance + The Global Memory Shortage: Doug O'Laughlin, SemiAnalysis · Feb 24, 2026 · at 1:48:33

Shawn Wang (Swyx) discusses hardware and DRAM memory constraints preventing frontier AI context windows from expanding further.

0:00 / 0:09exact quote · 9.2s

▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark

“And, like, this is not gonna go to a hundred million context windows. It's not gonna go to a trillion. Like, we're, this is it. This is it for, like, five years. 10 years.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

The claim, plainly

AI model context windows will not scale to 100 million or 1 trillion tokens and will remain effectively capped near one million tokens for the next five to ten years.

a quote alone can be ambiguous, so this restates it with the references and context of the conversation around it resolved. AI-written; the tape below the player is the source.

Assessment

Shawn Wang predicted on February 24, 2026, that AI model context windows would not scale to 100 million or 1 trillion tokens and would remain capped near 1 million tokens for five to ten years (running through at least February 24, 2031). As of September 2, 2026, standard commercial production models remain at 1M to 2M tokens, with the highest claimed frontier model window being Meta's Llama 4 Scout at 10M tokens (April 2025). While Magic demonstrated a 100M token model (LTM-2-mini) in August 2024, it has not been deployed as a generally available commercial foundation model API by a major provider. Because the stated five-year horizon has not elapsed and no major provider has released a verified >=100M token public API model to resolve the claim early, the prediction remains active and cannot yet be determined.

As of September 2026, flagship production API context windows from OpenAI, Anthropic, DeepSeek, and Google remain standardized between 1M and 2M tokens.
Meta released Llama 4 Scout in April 2025 with an advertised 10M token context window, the highest from a major commercial provider to date.
Magic.dev demonstrated a 100M token context window in August 2024 (LTM-2-mini), but only in research/demo benchmarks rather than a generally available commercial foundation model deployment.
The stated 5-to-10-year evaluation horizon extends through February 24, 2031.

Checked against

[1] blog.google [2] presenc.ai [3] medium.com [4] morphllm.com [5] codingscape.com [6] sourceforge.net [7] hidekazu-konishi.com [8] elvex.com

Magic ai 100 million token context window LTM 2-mini Gemini context window 2 million tokens 10 million tokens largest LLM context window 2024 2025 2026

assessed as of 2026-09-02

This assessment is an AI reading of a public statement, made against the cited references with the confidence shown. It can be wrong. The quote, the tape and the references are all on this page; if something is off, use report an error below. full disclaimer →

⏳ prediction date: 2031-02-24; checked again automatically on the next resolution wave

Mentioned

AI context windows Swyx

⚑ Spot an error? Report it

More from Shawn Wang

Opinion

Google's internal compute credit market caused it to miss GPT

“This is a thing that has been tried internally within Google, and it led to Google missing GPT.”

Shawn Wang Jun 18, 2026 ▶ 13:46 Why AI Labs With Unlimited GPUs Still Fail — Anjney Midha, AMP

Opinion

Swix: Standalone Vector Databases Are Over as a Category

“Everyone has vector indexes now, but like, I think it's fair to say vector databases as a standalone category are over.”

Shawn Wang Apr 18, 2026 ▶ 4:53 ⚡️ How to turn Documents into Knowledge: Graphs in Modern AI — Emil Eifrem, CEO Neo4J

Prediction Not checkable as stated

Swix: Pull requests and code reviews are dying, replaced by prompt requests

“The pull request is dying. Yeah. Right? It's going to be the prompt request. And then beyond that, code review is also kind of dying”

Shawn Wang May 20, 2026 ▶ 1:12:23 The Agent-Native Cloud: 3M Users, 100K Signups/Wk, Data Centers, & Death PRs — Jake Cooper, Railway

Prediction Didn’t hold up

Swix: OpenAI will issue a cryptocurrency token to fund compute

“There is still one more shoe to drop, which is the non sovereign wealth funding that open AI needs to get, which they've promised to drop by the end of this year. And my money is on, they have to do a coin. Like it's, I'm not a crypto guy at all, but like, y…”

Shawn Wang Oct 16, 2025 ▶ 49:13 Why RL Won — Kyle Corbitt, OpenPipe (acq. CoreWeave)

Prediction Not checkable as stated

Swyx: AI models hit a 2T parameter wall, won't reach 10T

“As far as everyone is concerned, Claude, you know, Opus 3.5 is not coming out. GPT 4.5 is not coming out. And Gemini two, like we don't have pro whatever we've hit that wall, whatever that wall is. Maybe I'll call it like the two trillion parameter wall. Like …”

Shawn Wang Jan 1, 2025 ▶ 40:13 2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents

Prediction Not checkable as stated

Swyx predicts coding SaaS will outlive all other SaaS

“Coding SAS will be the last SAS in the world because all the other SAS will just be buildable via coding SAS.”

Shawn Wang Sep 7, 2026 ▶ 23:22 Orbs: Shifting Coding to Cloud — Quinn Slack, Amp Code

Swyx: AI context windows will remain capped near 1M for 5-10 years

More from Shawn Wang

Turn any episode into a week of clips.