language models

“Context is king. So the context that you provide to a language model really dictates the quality of the output of the model, especially if you're asking about things that are kind of outside the training corpus of that model.”

“It is not true that language models make search engines unnecessary. If anything, they make the search engines more valuable because now all that data that you can search Becomes like 10 x more powerful because you can use that to, you know, get to get to your…”

“Language is fundamentally a purely generated signal. There's no language out there. You don't go out in the nature and there's words written in the sky for you. Whatever data you feed in, you pretty much can just Somehow regurgitate with enough generalizabilit…”

“Language models are good enough to teach. Like, they really are, right? Like, if you want to learn something, ChatGPT is a great place to go learn something.”

“These language models are these averaging machines, and you don't, with art, you almost definitely don't want the average of all the novels or all the writing or all the authors. You want something that's at the edge.”

“Language is great, but language is not the answer. You know, when I'm looking at catching a ball that is coming to me, I'm mentally doing that simulation in my head. I'm not translating it to language to figure out where it'll land.”

“If you look at the history of Technology, it's almost always the case that the big breakthroughs are the result of, you know, usually at least 40 years of sort of work ahead of time, you know, four decades. Right, in fact, language models themselves are the cu…”

“And very quickly they stopped working on language models, and we were very upset because we really wanted to continue going there, but they didn't want to talk about any language models because no one was really working on them and that may have made us feel v…”