Swyx: Stanford RL students founded pre-product startup with $500M valuation
Shawn Wang · Information Theory for Language Models: Jack Morris · Jul 2, 2025 · at 6:38
Swyx and Jack Morris discuss the frenzy in venture capital funding for reinforcement learning and reasoning models.
0:00 / 0:23exact quote · 23.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I just saw this morning that one of the recent Stanford grad students who worked on RL, they just started their company and they're worth five hundred million. It's like absolutely bonkers right now. It's just like no product, just three dudes, you know, sitting in some basement somewhere. I mean, undoubtedly cracked, but like also not worth five hundred million.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Shawn Wang
Google's internal compute credit market caused it to miss GPT
“This is a thing that has been tried internally within Google, and it led to Google missing GPT.”
Swix: Standalone Vector Databases Are Over as a Category
“Everyone has vector indexes now, but like, I think it's fair to say vector databases as a standalone category are over.”
Swix: Pull requests and code reviews are dying, replaced by prompt requests
“The pull request is dying. Yeah. Right? It's going to be the prompt request. And then beyond that, code review is also kind of dying”
Swix: OpenAI will issue a cryptocurrency token to fund compute
“There is still one more shoe to drop, which is the non sovereign wealth funding that open AI needs to get, which they've promised to drop by the end of this year.
And my money is on, they have to do a coin.
Like it's, I'm not a crypto guy at all, but like, y…”
Swyx: AI models hit a 2T parameter wall, won't reach 10T
“As far as everyone is concerned, Claude, you know, Opus 3.5 is not coming out. GPT 4.5 is not coming out. And Gemini two, like we don't have pro whatever we've hit that wall, whatever that wall is. Maybe I'll call it like the two trillion parameter wall. Like …”