million token context
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Jan 16, 2025 by Chip Huyen · across every show →
Everything said about million token context, oldest first
Jan 16, 2025
Chip Huyen warns million-token context capacity does not imply efficient processing
“Just because a model, I think the second reason may be actually more important at least for now is that just because a model can fit in a million con token context doesn't mean that it can process that million token efficiently.”