Retrieval-Augmented Generation
also referred to as: rag · retrieval augmented generation
15 statements across 9 episodes · 10 bullish · 1 bearish · 9 people on the record · first statement Oct 5, 2023 by Sarah Guo · across every show →
Everything said about Retrieval-Augmented Generation, oldest first
Oct 5, 2023 positive
Guo: Trustworthiness, Cost, and Freshness Drive Adoption of RAG Over Retraining
“I think of the core driver as like trustworthiness, right? Citation control of information source. And so now you have this architecture where people are using think of it as like traditional information retrieval techniques and search in combination with thes…”
Jan 18, 2024 bullish
Jan 18, 2024 positive
Feb 15, 2024 bullish
Zhao: Embeddings and RAG are eliminating the need for manual organization
“I think organization might be, we might be moving away from the organizational world. Why do you need to organize because you can retrieve? Why do you have index? Like index initially are file cabinets and little index are sitting on top of so you can find thi…”
Feb 15, 2024 bullish
Feb 22, 2024 bullish
Feb 22, 2024 neutral
Liberty: RAG Levels the Playing Field Across Different Foundation Models
“Interestingly enough, many of them actually start behaving quite similarly in terms of level of accuracy, even though without RAG, they actually have quite different behaviors. So it's sort of both like a uniform improvement and a little bit of leveling the pl…”
Mar 7, 2024 bullish
Guo: Large context windows expand RAG trade-offs rather than killing retrieval
“I'm more of the belief that it just opens up the set of trade-offs you can make between retrieval, more sophisticated retrieval and model reasoning by having a larger context window versus saying, like, we don't need any ability to work with a specific data se…”
Mar 28, 2024 neutral
Chase: Needle-in-a-haystack benchmarks fail to represent real RAG reasoning
“That, that actually really doesn't reflect a lot of RAG use cases in, in my opinion, because like that's the needle in the haystack is like, okay, given this long context, can I find a single information point? But oftentimes RAG is about seeing multiple infor…”
Jun 6, 2024 positive
Jun 6, 2024
Ma: RAG Response Quality Is Bottlenecked by Retrieval Quality
“Right now for implementing Rack the bottleneck seems to be that, you know, it's not very hard to implement it, right? You can just connect the components and have your Rack system ready very quickly. But the bottleneck seems to be the quality. Of the response …”
Jun 6, 2024 positive
Ma: Multimodal Embeddings Will Eliminate Image-to-Text Preprocessing
“So maybe in the future, you don't have to turn your images into description of images and then give it to the text embedding model. That's what people are doing right now. Like everything is turned into text and then use a text embedding model. But when the em…”
Sep 19, 2024 negative
Taylor: RAG is woefully insufficient for meaningful enterprise customer service
“What we found in practice is that broad category of technology investment is woefully insufficient for almost any meaningful customer experience. If you think about, you know, all of the interactions you've had with brands that you care about, what percentage …”