continual learning

“First, I think a lot of progress has been made on this front since in the last few years. I think this is mostly around post-training, around search, use search tools and then make search calls, then they would have access to that new information.”

“I am pretty confident we are not there at the moment. I think right now the models are still acting in isolated environments, and we are not seeing a lot of evidence for very coherent goals across different settings”

“If you have an LLM that self improves or like an agent that does something fails and learns, I don't think anything like that is feasible this year.”

“So, self-improvement is about a model getting smarter. Over time and improving its capability, like the model itself doing it. Continual learning is mostly about a model staying current, right?”