Guo: Large context windows expand RAG trade-offs rather than killing retrieval
Sarah Guo · No Priors Ep. 54 | With Sarah Guo & Elad Gil · Mar 7, 2024 · at 3:21
Investor Sarah Guo rejects the debate that massive context windows make retrieval-augmented generation (RAG) obsolete.
0:00 / 0:19exact quote · 19.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I'm more of the belief that it just opens up the set of trade-offs you can make between retrieval, more sophisticated retrieval and model reasoning by having a larger context window versus saying, like, we don't need any ability to work with a specific data set versus just retrain or stuff something into context.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sarah Guo
Guo: Daron Acemoglu fundamentally misunderstands AI scaling and technology
“Darren's arguing about something he doesn't understand. Like he, his claim is, you know, how do we know scale works? More data won't make customer support reps better. I think like that's just a fundamental, like misunderstanding of the technology and also obj…”
Sarah Guo: AI making human skill irrelevant is complete nonsense
“I think the idea that human skill is no longer relevant in the world of superhuman AI, just as a product of the technology itself is nonsense.”
Guo: Researchers have predicted ASI is 18 months away for five years
“The data I have is that a number of very smart and even very self-aware research scientists have felt that, you know, there was some knee in the curve on recursive self-improvement or ASI, 18 months away, every 18 months for the last five years.”
Guo: Compute and complex data are bigger AI limiters than algorithms
“The question of, like, how you are going to go gather that data for less verifiable, more complex domains, or do you run into the actual constraints on the, like, physical compute accessibility side? Like, I think that's probably more of a limiter than this be…”
Guo: High-status engineering tasks can be surprisingly easy for AI agents
“One thing I've seen is that if you have An engineering identity that's based on that, like a value based ranking of difficulty or skill, like the specific types of engineering that are considered, you know, impressive or high status can actually be like less h…”
Guo: Unreviewed AI-generated code introduces fragility into production codebases
“If you can generate an enormous amount of code and no one is reading it, you don't know the quality of the code. Nobody deeply understands the code base and there's more fragility, right? It's like the slop problem, but instead of it being like vibe coding slo…”