Retrieval-Augmented Generation

“If you feed in derivatives of derivatives into the model, you will basically take the wisdom of the crowd and that will shrink and you'll have a single opinion on everything, which is really bad.”

“And I think also the LLM is, is probably not going to say your product if it didn't show up anywhere on the RAG. So I think that's where most of the interesting stuff is for, from an optimization perspective.”

“Most of what I'm describing is about the RAG piece, not the core model piece to influence the core model is probably extremely hard. And maybe you will see the impact a year later.”

“We're starting to see the labeling move into enterprises and into governments because you can only get so far with off the shelf plus rag, plus some fine tuning based on recorded data.”

“Data preparations for Rack is extremely important. And I would say that's like in the, a lot of the companies that I have seen, that's like the biggest performance in their Rack solutions coming from like better data, data preparations, not agonizing over like…”