context window
2 statements across 2 episodes · 0 bullish · 0 bearish · 2 people on the record · first statement May 9, 2024 by Jack Clark · across every show →
Everything said about context window, oldest first
May 9, 2024 neutral
Clark: AI models need long-term storage instead of massive context windows
“Well, our AI systems today are kind of operating with short term memories that are millions of numbers in length, and it feels very unintuitive. Ultimately, we want them to instead be able to bake stuff into some kind of long term storage, and that's going to …”