Guo: Meta's open-source models will remain a sustained alternative to proprietary labs
Sarah Guo · No Priors Ep. 35 | With Sarah Guo and Elad Gil · Oct 5, 2023 · at 12:45
Sarah Guo discusses Meta's strategy of releasing and sponsoring open-source foundational AI models like Llama.
0:00 / 0:34exact quote · 34.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And I think like, I think it is very likely to be a big mover in the ecosystem because if they sponsor some Baseline of models that are big enough to be valuable, high quality enough to be valuable with Facebook AI research. And then enough people find these models useful and strategic, and they create a developer ecosystem. It's hard for me to picture them not being sustained as an important ecosystem and alternative to these, you know, research labs that in many ways compete with Facebook or Meta in different ways and are very expensive to maintain.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sarah Guo
Guo: Daron Acemoglu fundamentally misunderstands AI scaling and technology
“Darren's arguing about something he doesn't understand. Like he, his claim is, you know, how do we know scale works? More data won't make customer support reps better. I think like that's just a fundamental, like misunderstanding of the technology and also obj…”
Sarah Guo: AI making human skill irrelevant is complete nonsense
“I think the idea that human skill is no longer relevant in the world of superhuman AI, just as a product of the technology itself is nonsense.”
Guo: Researchers have predicted ASI is 18 months away for five years
“The data I have is that a number of very smart and even very self-aware research scientists have felt that, you know, there was some knee in the curve on recursive self-improvement or ASI, 18 months away, every 18 months for the last five years.”
Guo: Compute and complex data are bigger AI limiters than algorithms
“The question of, like, how you are going to go gather that data for less verifiable, more complex domains, or do you run into the actual constraints on the, like, physical compute accessibility side? Like, I think that's probably more of a limiter than this be…”
Guo: High-status engineering tasks can be surprisingly easy for AI agents
“One thing I've seen is that if you have An engineering identity that's based on that, like a value based ranking of difficulty or skill, like the specific types of engineering that are considered, you know, impressive or high status can actually be like less h…”
Guo: Unreviewed AI-generated code introduces fragility into production codebases
“If you can generate an enormous amount of code and no one is reading it, you don't know the quality of the code. Nobody deeply understands the code base and there's more fragility, right? It's like the slop problem, but instead of it being like vibe coding slo…”