Masad: Early AI startups should build around models, not train them
“You don't want to be training models, at least not yet when you're building, initially building business, but you can do a lot of other hard technical challenges on top of it to make the models work a lot better.”
Wang: Humans will always hold a reasoning advantage in long-duration thought
“The areas where humans will always have a meaningful sort of reasoning or intelligence advantage relative to models is long form thought long duration thought, thinking over long time horizons.”
Wang: True AI autopilot for tasks is closer than expected
“What I'm excited about, and I think is actually closer than we think, is the next unlock that we're talking about, where it's like actually autopilot, true autopilot for everything, and that Reliability boost in the models, I think could come here faster than …”
Roy-Chowdhury: Massive compute and data powered statistical AI's triumph
“Back in the nineties, it was very unclear that the statistical approach would actually be the one that won out, but it did. And I think the answer is exponentially larger amounts of compute, exponentially larger amounts of data unlock Incredibly high fidelity …”
Suleyman: Frontier AI Training Compute Grew 10 Billion Times in a Decade
“Over the last 10 years, the amount of compute used to train the best and the biggest models in the world has tenxed. 10 orders of magnitude in 10 years.”
Hoffman: Sudden leap in AI intelligence is quite unlikely
“Do we know if it's going to suddenly become, you know, much more intelligent? It's like, well, I can't guarantee it's not going to, although it seems quite unlikely, and it seems that there's a bunch of stuff under our control and people asking the right quest…”