Multimodal Reasoning
topic on 2 shows · 2 statements across 2 episodes
2 statements about Multimodal Reasoning, every show
Goel: Multimodal AI Models Degrade in Intelligence Versus Text-Only Models
“They tend to degrade in terms of their intelligence when you try to build models that can do multimodal reasoning. Like text only models tend to be pretty smart, but when you do multimodal, they tend to get a little bit less smart.”
Programmatic tools beat end-to-end image generation for multimodal reasoning
“Where I think for a while some people were, like, speculating, like, oh, what if you have the model, like, generate images in its chain of thought reasoning where everything is, like end-to-end multimodal input and output, and it seems like you don't really ne…”