foundation model

“If you want human level intelligence from model, it'll be a big model, and there'll be a couple of them around. Some better than others, some a year or two ahead of others, but I don't think small models substitute for big models, but they do some things reall…”

“Most of the money funding foundation models is strategic, right? Versus venture capital. Venture capital maybe funds things into the hundreds of millions, and then it gets handed off to Google and Amazon and Facebook and all the other folks to invest billions …”

“So if you're slightly better at X, fine. You can make a tiny bit of money for six months being slightly better at X. There's just no way there's actually money in that business long-term.”

“But Eric Vistria from Benchmark, who you guys know well, was saying, like, even in the foundation models, a huge chunk of them aren't going to make it. Like, we are going to see companies that today have a hundred million dollars in revenue, like, just go away…”

“Like I've actually come out of this exercise more cynical even than I was a month ago. Right. Or even a few weeks ago that any of these are going to be good, sustainable businesses, despite the fact it's clearly going to be everywhere in the air.”

“There's three foundation models of any reasonable size.”

“There's no, there's going to be no technical differentiation in these foundation models, right? Unless something crazy happens, but like, you're just gonna have a bunch of models that are quite good, in which case you're competing for attention.”

“The underlying tokens Probably can come from anywhere and how much margin there is in that business over time probably does look a lot like power, like Sam's talking about. And the real value is going to be in the orchestration.”