foundation model

“Locating the spiritual element, or the, or intelligence, or any of these kind of things in the individual alone, and not thinking about that as a broader collective thing, I think is the root of a lot of cognitive dissonance. And from that perspective, you kno…”

“We've done a ton of work on AI on the platform over the last few years. That was what I would call more narrow specialized models. We can continue to do that, but the bigger step change are gonna come through the more general model, building foundation models,…”

“My guess is that these models will not, you know, kind of commodify. My guess is that they will diversify increasingly over time, and that the idea that there's, these models will become commodities Defined as, you know, you can hot swap them and that their ec…”

“There isn't one model to kind of rule them all. Each different model has, you know, different sweet spots, and it's my expectation that most customers will invest in not building the foundation models, but will invest in fine tuning and improving those individ…”

“And I think in the coming months and years, we're going to start to see some awkward headlines around size matters because smaller will be better in terms of actual models being used.”

“Just understanding the world's information, and then trying to sort of almost compress that into your memory, that's not enough for solving a novel math problem, or a novel, novel conjecture. So there, you know, we start needing to bring in, I think we talked …”

“The product is just as important as well, right? Because how the user interacts with the system where models are leveraged and you have the right sort of handoff from human being to the model where you've got the ability, you know, think of it from a user inte…”

“Everyone has always wanted to build a product that just answers the questions correctly the first time. That wasn't possible prior to some of these foundation models, but now it is”

“I think if one thing happened this year, I think more and more folks coming over to team products that models aren't going to solve everything.”

“Interoperability model routing based on request being model provider agnostic on the foundation model side is where I see this going. It's not gonna be one, and I mean, we've talked about this for a long time, one model to rule them all, systems that can route”

“The model alone, the foundation model alone, is, is not an AGI. No, you need the other guy, which uses all kinds of tricks to exploit The algorithmic information in the world model to come up with better plans.”