Continuous Learning
topic on 4 shows · 6 statements across 6 episodes
No Priors 
Invest Like the Best 
Big Technology 
20VC
6 statements about Continuous Learning, every show
Reyes: True continuous learning within a closed-loop LLM does not exist
“There was an idea of continuous learning from over the last couple of years that said that you would have a, like a literal LLM like model where all of the learning happens internal to this closed loop system. That technology has not been developed. It doesn't…”
Murdock: Continuous learning will replace frontier models rather than bolting onto them
“They're going to replace frontier models. I don't think you can bolt on continuous learning into an existing frontier model. I think they're going to try and the early stages will look like that. But I think ultimately it'll call for a new form of architecture…”
Altman: Frontier AI models still cannot learn continuously as they operate
“The model also, although brilliant, is still not learning continuously as it goes.
And that feels to me like, maybe not a hard requirement for AGI, but certainly something that I'd like.”
Lovinsky: AI models will achieve continuous learning and self-improvement by 2026
“I think we're going to crack the, like, continuous learning, self-improving. These things, you know, can just be set on a task and given the context and build the memory and are just going to get better on their own for, you know, the majority of tasks that yo…”
Altman: Frontier AI models still lack continuous learning seen in toddlers
“One thing you don't have is
The ability for the model to not be able to do something today, realize it can't, go off and figure out how to learn to get good at that thing, learn to understand it, and when you come back the next day, it gets it right.
And tha…”
Guu: Continuous Real-Time ML Weight Updating Is Rare Due to Validation Costs
“Those I initially thought would have been more popular in kind of production grade settings, but they come with a maintenance cost, which is if you have something updating live, you don't have the opportunity to validate and check that everything is going well…”