Guo: 2024 will end with a handful of GPT-4-level models
Sarah Guo · No Priors Ep. 59 | With Sarah Guo & Elad Gil · Apr 11, 2024 · at 0:37
Sarah Guo (Conviction VC) discusses rapid progress in frontier and open-weight models following releases from Mistral, Databricks, and others.
0:00 / 0:10exact quote · 10.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think it's very it's very likely at this point that you end this year with a handful of GPT-IV level models, and that some of those are open source, right?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sarah Guo
Guo: Daron Acemoglu fundamentally misunderstands AI scaling and technology
“Darren's arguing about something he doesn't understand. Like he, his claim is, you know, how do we know scale works? More data won't make customer support reps better. I think like that's just a fundamental, like misunderstanding of the technology and also obj…”
Sarah Guo: AI making human skill irrelevant is complete nonsense
“I think the idea that human skill is no longer relevant in the world of superhuman AI, just as a product of the technology itself is nonsense.”
Guo: Researchers have predicted ASI is 18 months away for five years
“The data I have is that a number of very smart and even very self-aware research scientists have felt that, you know, there was some knee in the curve on recursive self-improvement or ASI, 18 months away, every 18 months for the last five years.”
Guo: Compute and complex data are bigger AI limiters than algorithms
“The question of, like, how you are going to go gather that data for less verifiable, more complex domains, or do you run into the actual constraints on the, like, physical compute accessibility side? Like, I think that's probably more of a limiter than this be…”
Guo: High-status engineering tasks can be surprisingly easy for AI agents
“One thing I've seen is that if you have An engineering identity that's based on that, like a value based ranking of difficulty or skill, like the specific types of engineering that are considered, you know, impressive or high status can actually be like less h…”
Guo: Unreviewed AI-generated code introduces fragility into production codebases
“If you can generate an enormous amount of code and no one is reading it, you don't know the quality of the code. Nobody deeply understands the code base and there's more fragility, right? It's like the slop problem, but instead of it being like vibe coding slo…”