hallucination

“You're going to have models that check the accuracy of other models, and that will help us bring down hallucination to zero.”

“We figured that, I don't know, problem of hallucinations out before anyone else.”

“Saying, I don't know, or solving, you know, hallucinations is, ah, intrinsically requires reinforcement learning in many ways.”

“There was these things called hallucinations. It's still with us to some extent, but dramatically less than two years ago.”

“And that is very, very powerful because I think this is one of the Ways you can mitigate not totally mitigate, but let's say reduce hallucinations because then the LM suddenly doesn't have to remember everything anymore.”

“So, so hallucination at least the intuition that people have is that it can come, for example, from SFT, and it can come from this, like, pursuing pipeline, but if you have good reinforcement in pipeline, that shouldn't happen too often.”

“But I do think hallucinations can be also very helpful for AI when you want it to explore novel kinds of proteins.”