Foundational Models

“And the velocity at which it's happening, you see that the real business model is not in the foundational model anymore. It's at the application layer above, and it's in the infrastructure below, whether that's the cloud or whether that's chips.”

“The models themselves, like it or not, have consumed the market cap out of software and services. It is just, you know, it's like the Borg. It is consumed.”

“We can have really good foundational models, but the customer could not care less. They really care about how does it hit their top line and bottom line performance, which is either how does it impact their labor or how does it impact their shipping rates? Or …”

“I mean, in all honesty, like, we haven't, you know, invested in any of the, you know, big foundational models.”

“All the models just constantly get better and a new entrant coming in today can probably out of the box, have a product that is equally as good as yours. And so your time in market mode, frankly, doesn't exist.”

“So now you've got to compete with incumbents, foundational models, and new entrance. So competition becomes a primary risk. All of a sudden the ability to deliver incredible value is not nearly as hard as used to be, but The counter to that is competition is m…”

“All, like, there's, I think there's over 3000 hours worth of therapy transcripts, like, in the foundational model.”

“Firstly, very early on, we thought there would likely be multiple foundational models that were competing. And hence we've built our technology to be multi-model on purpose in almost every way, and that we were not going to make foundational models. It's unlik…”

“So in order to compete in foundational model world, our basic rule of thumb is you have to be able to, you know, without much product progress phrase, at least two billion dollars, because that's basically what it can cost you to train something that gets you …”

“It will change because there'll be millions of models as opposed to just singular foundational models.”

“There's not, there'll be five, six, whatever it is, foundational models before there's consolidation. But beyond that, there's gonna be millions of models. Millions and millions of models. And every brand is going to need a model, particularly like in healthca…”

“There's not, there'll be five, six, whatever it is, foundational models before there's consolidation, but beyond that, there's going to be millions of models, millions and millions of models, and every brand is going to need a model, particularly like in healt…”

“On the question of foundational models, I don't think that race has been won.”

“I actually think the winners will be the specialists, not the foundational models. It's the people who will build on top of the foundational models or fine tune the foundational models.”

“I think when it comes to foundational models, maybe we are a little bit behind, but I think we'll catch up soon.”

“I don't think the foundational models are products. You're seeing this with OpenAI right now. They're more pivoting to a product company, and Satya even said this.”

“So if I compare that to somebody who's spending a bunch of money on compute for an academic lab for a very large foundational model I don't think those things accrue very well over time. I think you need to be full stack.”

“Well, I do think that there will be efforts at foundational models that won't work. And especially I think late entrance like late entrance have a harder, you know, catch up routine and a lot of kind of expense to go to it”

“Staying on the main branch, staying on the core capabilities and supplementing it with fine tuning and additional techniques like RAG seems to be the approach that's winning right now.”

“I think the bulk of the value though, so there will be valuable companies there, but the bulk of the value will be in the application side.”

“Foundational models are the fastest depreciating asset in human history.”

“We cannot touch customer service. We cannot touch it because it's going to get commoditized and run over by these foundational models within a year.”

“I think it's fairly obvious that with the foundational models, like you can ask them to think by step by step and ask them to plan and stuff, but that isn't enough because if you look at how those models score on these benchmarks and then they're not They're n…”

“Fair, we don't really build with a specific use case in mind. We try to build like these foundational models that can be applied to lots of different use cases out of the box.”

“I see like now a lot of fundamental stacks that are like the unicorn of today. Foundational models, foundational like clusters, data notations, things like that. There's a lot, but less successful yet, for now at least, application company. And it's hard to bu…”

“There is no value in foundational models economically.”

“And the added benefit to that is, by the way, that you can be GDPR compliant. You can actually delete data. So if, you know, so, you know, if you're a company like a legal company and somebody deletes a document, you can just delete it from the vector database…”

“Foundational models get it fundamentally wrong. When we learn how to Build the subsystems of AI correctly, and for each one of them to do their roles optimally. Either we're going to do, be able to do the, to achieve the same tasks much cheaper, faster, better…”

“I think foundational models will have no economic value. I think that they will be an incredibly powerful part of the substrate and they will be broadly available and entirely free.”

“There's going to be a proliferation of foundational models. The cost of those models will go to zero.”

“And so the unfortunate byproduct of a more of foundational models that are more pervasive is going to be that the internet gets a little bit more closed in the short term.”

“There's Four or five big foundational models, and then there's a bunch of small vertical use applications that you use, depending on what the task is.”

“On the question of sort of stars versus incumbents, it's hard to believe that Foundational models won't get commoditized, but I'm definitely being, I'm willing to be proven wrong there. But it does seem like, you know, over time, this should be something that …”

“So there's probably going to be some people whose job is to like, come up with that layer of thing that the consumer or the average person is never seeing. And they think they're just talking to the AI, but really they're talking to this thing that then Adds a…”

“Foundational models. I think they will get commoditized like compute, and I think the companies who deliver the last mile will be the ones to capture most value.”