Rabois: Current AI fine-tuning and training methods may be obsolete within two years
Keith Rabois · "Work at an outstanding organization first" - Keith Rabois Advice on Starting Companies · Mar 5, 2025 · at 13:01
Keith Rabois questions the durability of AI companies built primarily on data preparation, fine-tuning, and human post-training.
0:00 / 0:23exact quote · 23.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“The advances in AI are so fast. That the way we build models today with fine tuning and different kinds of training may be also obsolete a year, two years from now. So there may be models that are built that don't require any human training. So revenues that are built on and companies are built on that kind of revenue may not be as durable as people think either.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Keith Rabois
Rabois: China is ahead of the US in humanoid robotics
“Well, spicy is that look, Chinese are ahead of us and it's very dangerous politically, geopolitically.”
Rabois: Trump administration will find a way to ban Chinese robots
“I would be shocked if this administration doesn't figure out a way to ban Chinese robots before it's too late.”
Rabois wants to fund next-generation AI that completely obsoletes LLMs
“I would love to invest in something that's a next generation replacement for LLM. It's not a better LLM, but something that will, you know, transforms a pretty good double tundra, but that's something that would Be a you know, complete it would make LLMs obsol…”
Rabois: Outsider robotics firms will fail to replace warehouse workers
“Some company from afar that doesn't understand how a warehouse works, that doesn't understand real workers and what real workers, you know, needs are and tries to run a mixed system without having any understanding of real people. I don't think it's going to b…”
Rabois: Apple's reported two-year AI delay is a devastating, generational setback
“Two years is like, you know, as other people have pointed out, two years in an AI world is an eternity. You might as well say I'm delaying something for 20 years or, you know, like two generations at this point. It's crazy. And so I think that's a serious prob…”
Rabois: Microsoft will not hold as much of a strategic lock on AI
“I think Sundar made several miscalculations, and I actually do think that Microsoft and, you know, Satya got a lot of credit, but I think they're seeing some of the downsides to some of their strategies now. Like I think they are going to wind up not having qu…”