The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 9 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Davis: Future AI infrastructure will rely far less on massive GPU clusters
“I think this actually points the way towards like what the infrastructure future might look like. And I think it looks a lot less like everything requiring these big clusters.”
Davis: Large-scale GPU pre-training utilization is sub-80% and often below 50%
“And so even for a lot of the more sophisticated orgs running large pre-trainings at scale,
The utilization sub-eighty percent, sometimes less than 50%, actually, depending on how bad of a batch they have and the frequency of failure in the cluster.”
Tan: AI Factories and Semiconductor Foundries Require Sovereign and Government Capital
“And then in terms of the capital intensive, like AI in a factory and also the foundry, and then you really need to tap either government funding or some sovereign fund, and also some very big capital. You know, there's some big fund that doing that, and they'r…”
Davis: AI teams hold 10% to 20% of GPUs idle as healing buffer
“And so one of the consequences of that is that it's very common now to hold aside 10 to 20% minimum of the GPUs that a team has as buffer, as healing buffer, in case of a failure so you can slot something else in to keep the training workload running, right?”
Nadella: Microsoft uses the GitHub harness across all its AI products
“So we have, in our case, we have the GitHub harness, which essentially we're using across all our products. It's available in Foundry”
Davis: Democratizing AI Compute Will Increase AlphaFold-Level Breakthroughs 10x to 100x
“I think it would increase the frequency of events like AlphaFold II by 10 X, a hundred X, or maybe even more super linearly.”
Davis: AI systems will make millions of heterogeneous model calls per question
“I think that what we'll see people doing is kind of composing, this sounds funny, but massive networks, Where maybe each stage in the network will basically be maybe some best of A, best of K component with many, many calls to different language models, you kn…”
Papermaster: Semiconductor packaging requires geographic diversity beyond foundry capacity
“And so it goes beyond the foundry. It's the same thing with the packaging. So where do you, as you put those chips onto carriers and you need to interconnect it, you need that ecosystem to have geographic diversity as well.”