Q So how does it know when The user is saying, turn the lights on versus like something more esoteric. Like, is there something built within the technology? That's kind of like a switcher that determines first your intent, and then decides which part of the model to send it out to?
A The way to think about it is, you know, at, at the base level, you have large language models, and you have this model agnostic system that's even itself gonna choose the right model for the job, and the models play different roles in there. What, what's already happened is, um, even, even honestly, sort of in the way you asked a few of the questions, is that people assume the large language model is the product. A product like Alexa is. So much more than quote unquote, just a large language model. So you have models playing many different roles in the, in the system overall, even models helping us decide which model and models themselves deciding if they're the best, you know, tool for the job, so to speak. So then you have a system that progressively decides how to get something done. I wouldn't think about it like a switch or something in classic computer science that Is it, you know, it's a gate. That's not, that's not how the system works. It's, it's a collection of model behaviors and systems downstream of that, that complete specific tasks. And that, and that's where we introduced this term expert to try to help coalesce around the system behavior and explain it better. The large language models are interacting with these experts that do things like get you the sports score, play a song, play a video, know where you are in the song so that you can go to the video, like a…
AI assessment note: “I wouldn't think about it like a switch or something in classic computer science”