Foundry

“And this is the same platform that was used to build the COVID vaccine response distribution in the U S and the UK same platform that commercial companies were using to manage the supply chain crises”

“And so it goes beyond the foundry. It's the same thing with the packaging. So where do you, as you put those chips onto carriers and you need to interconnect it, you need that ecosystem to have geographic diversity as well.”

“I think this actually points the way towards like what the infrastructure future might look like. And I think it looks a lot less like everything requiring these big clusters.”

“And so one of the consequences of that is that it's very common now to hold aside 10 to 20% minimum of the GPUs that a team has as buffer, as healing buffer, in case of a failure so you can slot something else in to keep the training workload running, right?”

“I think it would increase the frequency of events like AlphaFold II by 10 X, a hundred X, or maybe even more super linearly.”

“I think that what we'll see people doing is kind of composing, this sounds funny, but massive networks, Where maybe each stage in the network will basically be maybe some best of A, best of K component with many, many calls to different language models, you kn…”

“And so even for a lot of the more sophisticated orgs running large pre-trainings at scale, The utilization sub-eighty percent, sometimes less than 50%, actually, depending on how bad of a batch they have and the frequency of failure in the cluster.”

“So we have, in our case, we have the GitHub harness, which essentially we're using across all our products. It's available in Foundry”

“And then in terms of the capital intensive, like AI in a factory and also the foundry, and then you really need to tap either government funding or some sovereign fund, and also some very big capital. You know, there's some big fund that doing that, and they'r…”