Foundational AI Models
topic on 4 shows · 5 statements across 5 episodes
WTF is with Nikhil Kamath 
the MAD Podcast 
Big Technology 
All-In
5 statements about Foundational AI Models, every show
Roy: Microsoft should not attempt to build foundational AI models
“So, so if I'm Microsoft, I actually agree. I don't think that's the right approach. I think like, you know what? Let them all battle it out.”
Staniszewski: Only a few global companies will pre-train foundational AI models
“Like let's take building foundational AI models. I think the kind of, the base will be pre-trained by few companies in the world, just given the resources required. They'll be open source of course offerings in that bucket. But then Probably, as I think about …”
Buchheit: Astronomical capital costs will limit foundation model competitors
“I expect that it'll probably stay relatively stable, honestly, because I, the cost of building these foundation models is astronomical, right? We just saw XAI is raising another twenty billion, something like that. And so it, Just the capital requirements are …”
Canva's proprietary design data uniquely positions it to build foundation models
“So maybe that advice of kind of like, don't be in the foundation, foundational model Space is good general advice, but we think that we are in a quite unique position in terms of the data that we have to pursue that particular avenue.”