language models
2 statements across 2 episodes · 1 bullish · 1 bearish · 2 people on the record · first statement Apr 6, 2025 by Mike Knoop · across every show →
Everything said about language models, oldest first
Apr 6, 2025 bearish
Knoop: Language models operate by memorization rather than solving novel patterns
“Language models. Generally working like a memorization style regime where they're right. Learning lots of data. They're able to apply it to very similar types of patterns that they've seen before, but not novel patterns. That's what RKGI shows.”
Apr 10, 2025 positive
Huber: Language models require a multi-tiered memory hierarchy like traditional computers
“In the same way that we have a memory hierarchy in classic computers, right, we have the CPU, RAM, disk, and network we are also going to have a similar memory hierarchy in language models. And again, it already exists today. We have the actual sort of transfo…”