fine-tuning

“At the end of the day, these models are like next token predictors, which is, you know, like they kind of look at like what they've predicted until now, and then, you know, figure out like what the next token they're on is. And from that, like, even with fine-…”

“Fine tuning is the technology that got from a research project in 2020 called GPT-III and turned that into ChatGPT, a billion dollar app, right?”

“That is something that is, works better than fine-tuning, for example, because if you fine-tune, then you're still dealing with potential hallucination Fair enough, with RAC that's possible too, but it's like, it's less it's less risky.”

“One common misconception about fine tuning is a lot of people think that you can inject new knowledge into a model using fine tuning. And that is not true.”

“The more focused your use case is, the smaller you can make the model through fine-tuning or through just distillation in an even smaller architecture.”