why aren't all 13 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 0 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Assertion Not checkable as stated
Hendrycks: Adversaries Can Spy on Top AI Labs via Slack Zero-Day Exploits
“All they need to do is do a zero day on Slack. And then they can know what DeepMind is up to in very high fidelity and OpenAI and XAI and others.”
Opinion
Mensch: 2020 OpenAI scaling laws paper was poorly executed
“Basically the story was that everybody was training models on too few tokens because of the paper from 20 20 that happened to be not very well executed.”
Insight
Yarats: The best AI research breakthroughs came from top software engineers
“Turns out through my experience, the best research scientists, also very good engineers, like very good engineers. And we've noticed like through DeepMind and OpenAI is just like the companies that made the most progress over like last six years or five years …”
Opinion
Chen Bets on xAI to Catch Up With Top Frontier Labs
“So I would bet on XAI. I think they're just very hungry and mission-oriented in a way that gives them a lot of really unique advantages.”
What-if
Laskin: Dota and AlphaStar would have achieved superintelligence with more compute
“Dota V and AlphaStar were near super intelligent systems, and if OpenAI and DeepMind had sunk more compute into them, they would have definitely become super intelligent.”
Insight
DeepMind synthesized 80 definitions of intelligence into one engineering metric
“And it was his work in, I think he, I think for his PhD thesis, he put together like 80 definitions of intelligence. And aggregated those into a single formulation, which was how do we you know, the intelligence is the ability to perform well across a wide ran…”
Assertion Supported
Frontier AI training compute grew nine orders of magnitude in nine years
“Over the last decade, the amount of compute that we've used to train the largest models in the world has increased by an order of magnitude every single year. So I went back and had a look at the Atari DQN paper that we published in. And that used just two pet…”
Assertion Not checkable as stated
Hassabis originally wanted DeepMind to simulate the entire global economy
“Demis was way more in the kind of robotics land and sci-fi land. I mean, he was fully thinking that, you know, the way to manage the economy, the way to make economic decisions was to simulate the entire economy.”
Insight
DeepMind's founding goal was cross-domain transfer learning
“If I were to sort of summarize the core thesis of deep mind, it was that it would be possible to the motivation for generality was that you would be able to learn you know, a rewarding behavior in one environment and transfer in a more compressed or efficient …”
Opinion
Peter Thiel had significant early AI vision but exited DeepMind early
“Peter Thiel, you know, to his credit did actually have significant vision here, although he sold pretty early, I think, and now doesn't seem to be in the game.”
Assertion Partly supported
Davis: DeepMind built AlphaFold 2 with a team of just 18 people
“I think that one of the things that was so remarkable to me about AlphaFold II is, initially it was a really small team, you know, three, and then later, 18 people or so, and they solved what was kind of a fifty-year grand challenge in biology, which is a pret…”
Assertion Supported
Vinyals: Gemini formed by merging parallel LLM efforts across Brain and DeepMind
“One was that the Gemini project was formed as a result of having two sort of Parallel efforts on LLMs, mostly led by Google Brain and what we now call Legacy DeepMind. So earlier in the year, there was an effort to merge the two projects, and that's when sort …”
Assertion Supported
DeepMind's AlphaFold originated from an internal reinforcement learning hackathon
“That's part of the reason why we started the Alpha Fold project, because it was actually my group that was looking around for other applications of DQN-like, AlphaGo-like tools, and in a hackathon that we did one week someone stumbled across, across this probl…”