Foundry

“I tried to copy Y Combinator and start our own version in India. It's called Foundry. We give about 20, 25 kids half a million dollars each every, ah, every like six months, and they live in a house and try to build consumer companies together.”

“We put a few hundred million dollars into Anthropic from our fund earlier this year.”

“And then in terms of the capital intensive, like AI in a factory and also the foundry, and then you really need to tap either government funding or some sovereign fund, and also some very big capital. You know, there's some big fund that doing that, and they'r…”

“So we have, in our case, we have the GitHub harness, which essentially we're using across all our products. It's available in Foundry”

“We can use foundry and ontology to bring out the advantages of American worker and give them the capacity to roughly work like a Japanese engineer.”

“And so the ontology became a huge piece of foundry. It was directly informed by the learnings that we had from building that application inside that factory. And I would say it's still a very big differentiator today. Like I don't think too many other companie…”

“I think it would increase the frequency of events like AlphaFold II by 10 X, a hundred X, or maybe even more super linearly.”

“And so one of the consequences of that is that it's very common now to hold aside 10 to 20% minimum of the GPUs that a team has as buffer, as healing buffer, in case of a failure so you can slot something else in to keep the training workload running, right?”

“And so even for a lot of the more sophisticated orgs running large pre-trainings at scale, The utilization sub-eighty percent, sometimes less than 50%, actually, depending on how bad of a batch they have and the frequency of failure in the cluster.”

“I think this actually points the way towards like what the infrastructure future might look like. And I think it looks a lot less like everything requiring these big clusters.”

“I think that what we'll see people doing is kind of composing, this sounds funny, but massive networks, Where maybe each stage in the network will basically be maybe some best of A, best of K component with many, many calls to different language models, you kn…”

“And so it goes beyond the foundry. It's the same thing with the packaging. So where do you, as you put those chips onto carriers and you need to interconnect it, you need that ecosystem to have geographic diversity as well.”

“I've talked to a couple of consulting firms about, well, you guys like to learn how to do Foundries, and they say, how does it work? It's one guy for three days. That's not what we do. We do 10 guys for three years. It's not a business model. But that's a nice…”

“And this is the same platform that was used to build the COVID vaccine response distribution in the U S and the UK same platform that commercial companies were using to manage the supply chain crises”

“So, you know, an example is a winner for me from. 1112 years ago called the foundry, which was making the 35 or 40% margins when it was really not very big. And it didn't grow that fast, but it produced a 40% margin, 35, 40% margins for 10 years, growing at, y…”