long context
4 statements across 4 episodes · 3 bullish · 1 bearish · 4 people on the record · first statement May 31, 2024 by Mark Huang · across every show →
Everything said about long context, oldest first
May 31, 2024 bullish
Huang: Multimodal inputs like video will drive long-context LLM demand
“Multimodality is, in my opinion, going to be, it's going to be pivotal for long context. Just because, like, videos when you're getting into the frames per second and you're getting into lots of images and, like, things that are a lot more, like, embodied You …”
Jul 5, 2024 bullish
Oct 19, 2024 negative
Hu: Long-context accuracy degrades; RAG remains necessary for entire large codebases
“My guess would be that, like, long context works, but it's sort of a lie as far as your accuracy, and that rag matters no matter what, because even in the longest context windows, you can't fit the whole code base.”
Jun 25, 2026 positive
Chen: Compaction shortcuts expensive native long context in coding products
“Many, many coding products today have features like compaction, right? Where you can compress kind of either insights or working state and stuff like that, you know, it just shortcuts a lot of the very brutally difficult and expensive permit is that you have t…”