continual learning

“I think a big bottleneck these models have is their inability to learn on the job, to have continual learning. Their entire memory is extinguished at the end of a session. There's a bunch of reasons why I think this actually makes it really hard to get human-l…”

“Once continual learning is solved, you might have something that looks like a broadly deployed intelligence explosion, which is to say, That because if these models are broadly deployed to the economy, every copy that's like this copy is learning how to do plu…”

“Without being too specific you know, I think, and we already have maybe some, you know, some evidence to suggest that this is another of those problems that is, is not as difficult as it seems. That will fall to scale Plus a slightly different way of thinking …”

“When we're changing the machine and we're writing new articles and we're building new macros, it's sort of easy for the humans who own that machine to understand what's going on. Like the head of support technology can be like, yep, yep, that is the correct wo…”

“But I think to have it you want to do it more than just having your data in the context window. That's you want to have something a bit deeper than that, which is, as you say, actually changes the model over time. That's what ideally you would have. And that t…”

“Right now the progress in the research community that's working on continual learning isn't necessarily connecting to the work that's going on on scaling.”

“I confess I have a little bit of trouble with continual learning as a concept because I feel the community has never been able to nail, like, how do we articulate the problem in a way that we all agree on it? And so everyone who does work on continual learning…”