hallucination

“You'll hear this term, of course, hallucination, which is kind of when it starts to make things up. And of course, another term for hallucination is just simply creativity.”

“And there is a ton of work that needs to happen here and maybe introducing browsing so you can get fresh information and you can cite information and solve hallucinations. I don't think that's impossible. I think that's achievable.”

“And we also wanted to figure out the issue of hallucinations, which is always an extremely hard problem. But I do think that with this method of tree enforcement learning with human feedback, maybe that is all we need if we push this hard enough.”

“The hallucination problem, that's in some ways a good thing for startups because a lot of the existing products out there have zero tolerance for anything that's going to have a risk of producing something wrong.”

“And I think hallucinations are gonna, the rate is gonna go down as the models get better, but it's never gonna get to the point where it's a hundred percent perfect.”

“Like in LLMs, hallucination is a problem. So the fact that you're making shit up is a bad idea. But if you have to make shit up to convince someone, LLM is great and perfect.”

“When the models are able to take step by step, they actually can like pause before blurting out an answer is kind of what I, it feels like with a lot of the previous models or hallucinations.”