Multimodality
topic on 4 shows · 6 statements across 6 episodes
Latent Space 
No Priors 
Sourcery 
the a16z Podcast
6 statements about Multimodality, every show
Siddharth: Solving multimodality, reasoning, tool use, and coding yields ASI
“Turing's the world's leading research accelerator, working with all of these frontier labs to advance them along I would say the four pillars of superintelligence which is multimodality, reasoning, tool use, and coding. If you solve these four things, you will…”
Li: Multimodal training will unlock net new AI agent capabilities
“So I will actually bet on multimodality when it comes to, like, if we train more model train, like, the model with, like, Different traces of like clicking on buttons on the website, navigating the web using different devices, drawing producing vector art. I t…”
Acharya: AI companion app demand will surge with multimodality
“There's so much latent demand and it'll really increase Once you have multi-modality.”
Huang: Multimodal inputs like video will drive long-context LLM demand
“Multimodality is, in my opinion, going to be, it's going to be pivotal for long context. Just because, like, videos when you're getting into the frames per second and you're getting into lots of images and, like, things that are a lot more, like, embodied You …”
Alexandr Wang: Cross-modality training produces no positive transfer between video and text.
“I think the main thing, fundamentally, is I think there's very limited generality that we get from these models and even for multimodality, for example my understanding there's no positive transfer from learning in one modality to other modalities. So like tra…”