Llama

“Some of the people who produced Llama, the open source LLMs from Meta. So the key people have left already. Okay, to do startups.”

“Right now, Llama is not as good as GPT-IV. Not even close.”

“If you want a model that's on the frontier, that's going to be closed source. Now, look, every, as I mentioned, every month it feels different with what Meta's doing with Llama, that may actually fundamentally change the game. If Meta is willing to make that h…”

“We built an AI lab at Meta and it was kind of like, huh, this AI thing is going to be pretty big. Let's like start building the skill set. And that's why you see Meta doing Lama now and a bunch of other things, because they, we had all the people, we had all t…”

“And this is actually why I think there's a very there's a very big sort of opportunity for whether it's open source models or the llama models or the mistral models or whatnot, basically these models that can go on prem and that enterprises can take. And then …”

“It is very strange from one hand for all of these people in Silicon Valley to be like, yeah, you know, AGI is coming. And then the applications they're building are like these very narrow, like, hey, I slapped something on top of llama. And you know, it's like…”

“You know, I think that in that market probably if you need a model like that, you should download llama. That's the answer. It's like, you don't need much of a cheat sheet on that, you know, and or maybe Mr. All, but pick one of the open source models that are…”

“I think the open source models, Like take Llama, for example, like they've been able to do that from their own research and perspective and data ingestion and training. And so I guess I would say distillation does not feel essential in order to unlock those th…”

“We use Anthropic a lot. It's one of our biggest models. We use, you know, multiple models which I think is what most good SaaS vendors are doing within their customers' choices, right? Like we use a lot of Gemini, a lot of Anthropic. We have a whole bunch of L…”

“Also worth noting that they're talking about being much more closed source, which is a significant thing, because at some point someone's going to need the American version of open source, and Lama was that, and now they're pivoting more to be more closed sour…”