Million Token Context
topic on 1 show · 1 statements across 1 episodes
1 statements about Million Token Context, every show
Chip Huyen warns million-token context capacity does not imply efficient processing
“Just because a model, I think the second reason may be actually more important at least for now is that just because a model can fit in a million con token context doesn't mean that it can process that million token efficiently.”