infinite context windows
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Sep 25, 2023 by Dario Amodei · across every show →
Everything said about infinite context windows, oldest first
Sep 25, 2023 negative
Amodei: AI models will never have infinite context windows due to compute
“Really the main thing holding back infinite context windows is just, you know, as you make the context window longer and longer, of course, the majority of the compute starts to be in the context window. So at some point it just becomes too, too expensive in t…”