Multimodal AI

“Even if this is not, like, the only architecture that would be, like, in a multi-model, but it made it really simple to train these models, like, natively, because you have, like, a single architecture and you can have all the modalities in, during training.”

“I think at least I want to bet on, you know, running their work natively together, the future for simple, I would say for simple or even intermediate difficult vision tasks. For example, kind of counting with less than 20 objects. I think for this kind of simp…”

“The multimodal part still lags behind the text part to a large extent.”

“Robotics is probably just an illustration that we are not doing that well in multimodal and that we're not doing that well in general reasoning yet.”

“We have seen this play out with text and image where you had your text only models and you had your image only models, and then they started to come together and now they've come really deeply together. And so I think you're going to see that across a lot of o…”

“I think it's inevitable that in about two or three years, we will have models that are multimodal, large context windows, are capable of reasoning over, say, three hours of a screen recording.”

“But there's also like multimodal is Essential for understanding enterprise data, like PDF documents, where there's graphs and this type of thing, or understanding slide decks. A lot of the modalities that enterprises work in are visual. So it's sort of table s…”

“When we think about things in financial services, big invoice reconciliation, bill pay, you'll have these things come in as PDFs, you'll have them come in as images, you'll have them come in as text in a variety of ways. As we start looking at things holistica…”

“So more and more this, your vision, what you just said is not only possible, but likely unless people have access to your information and start sending you ads every which way.”

“So you, we're going to start seeing generations beyond text and language going into other new breakthroughs, and we're going to see the same impact in those ways.”

“So I think over time, I think the whole technology trend has been moving towards to a direction. A lot of all these things will be trained together. The multi-model model, multimedia, all get into one single model.”

“I'll tell you a whole nother category of companies, Bill that have moved into that bucket and it's all these BPO companies, business process, outsourcing businesses, right? So, you know, because remember, it's not just about language now, right? BPO companies …”

“Smartphones are great. They're really, really great at what they can do now, but they're very limited in terms of how much more they can do. And if you think about if they're able to leverage some of these multimodal inputs that use text and voice and sound an…”

“Looking ahead, these shared experiences are going to go from just being text to being multimodal.”

“I'm thinking about that as a better collaboration tool versus a production tool. Because right now, a lot of the time where we see challenges in articulating ideas is the communication. It's the clarity of thoughts. So if we can leverage AI to improve collabor…”

“Multimodal, I think we're early stages now. So you're gonna see the early models, which are audio based. So I think about it like text, then images and text with Audio. And then you're kind of combining these medias together.”

“Obvious places where content is generated actually, ironically, is going to be advertising. I can see how personalized advertising actually plays a pretty big role, especially when it gets to be multimodal.”