Masad: LLMs market million-token context but fail after 200,000 tokens
Amjad Masad · Marc Andreessen & Amjad Masad on “Good Enough” AI, AGI, and the End of Coding · Oct 23, 2025 · at 14:35
Amjad Masad, founder and CEO of Replit, discusses the effective boundaries of context windows in current large language models when powering autonomous AI coding agents.
0:00 / 0:11exact quote · 11.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I would say LLMs today, you know, they're marketed as a million token length. Which is like a million words almost. In reality, it's about 200,000, and then they start to struggle.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Amjad Masad
Masad: Laypersons will soon match senior Google software engineers via AI
“I think that the lay person will be as good as a what a senior software engineer that works at Google is today. So I think that's happening very soon.”
Amjad Masad: Papers predicting AGI by 2027 are vibe-based hype, not science
“So my criticism of the idea of like AGI, 20, 27, you know, that paper that I think it's called Alexander or someone else wrote and then and the situational awareness and all this hype papers that are not really science. They're just vibe.”
Amjad Masad: Current large language models are not on the path to AGI
“I don't think LLMs as they can understand are on, on the way to AGI and my definition for AGI is I think the old school RL definition, which is a machine that can go into any environment and learn efficiently in the same way that a human could go into you can …”
Masad: Bearish on true AGI breakthroughs due to current AI profitability
“I, I'm kind of bearish on, on, on true AGI breakthrough because what we built is so useful and economically valuable.”
Masad: Global developer count will reach 300 million by 2030
“So with software engineering becoming more accessible because of AI, I do think we're going to get a lot more developers. I think we're going to get way, way more developed, probably 10 X. So right now there's like thirty million developers in the world. There…”
Masad: AI will eliminate mid-level 'glue code plumber' developer jobs
“And the way I see, so the developer market evolving to accommodate this new technology Is that there's going to be this bit of a bimodal distribution. So bimodal distribution, meaning there's no middle end, there's a large tail on both sides, right? So the mid…”