context rot
2 statements across 2 episodes · 0 bullish · 1 bearish · 2 people on the record · first statement Aug 19, 2025 by Jeff Huber · across every show →
Everything said about context rot, oldest first
Aug 19, 2025 negative
Sep 11, 2025 neutral
Martin: Context caching solves cost and latency, but not context rot
“I do think an important and subtle point here is that caching doesn't solve the long context problem. So it, of course, solves the problem of, like, latency and cost, but if you still have a 100,000 tokens in context whether it's cached or not, the LM is utili…”