RLHF

“It was the RLHF and the dialogue component of ChatGBT that triggered the takeoff. And that was the capability threshold. Like it was at that time that this capability threshold passed where now it is a prior, like LLMs are a priority for every organization.”

“I think that caught pretty much everybody, but the people in OpenAI by surprise was that you can have a relatively small number of examples from people, fine tune the model on that, and then it's a lot easier to work with.”