Korupati: Visual Chain-of-Thought Will Probably Generalize Across Tasks
Vik Korupati · Best of 2024 in Vision [LS Live @ NeurIPS] · Dec 22, 2024 · at 52:10
Vik Korupati, creator of Moondream, discusses applying visual grounded chain-of-thought reasoning to analog gauge and clock reading tasks.
0:00 / 0:11exact quote · 11.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“The real question is, is it going to generalize? Probably, like, there's some signs from text models that when you train on a broad number of tasks, it does generalize, and I'm seeing some signs with our model as well.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Vik Korupati
Korupati: Vision-Language Models Are Lagging Behind LLMs in Reasoning
“LLMs are showing enormous progress in reasoning, especially with the latest set of models that we've seen, but we're not really seeing, I have a feeling that VLMs are lagging behind, as we can see with these tasks that should be very simple for a human to do t…”
Korupati: Developers Can Prototype on 2B Models and Prune for Deployment
“I think the thing that's really exciting about this is it makes it possible for developers to build using the two B per model and
Just explore, build their application, and then once they're ready to deploy, figure out what exactly they need out of the model a…”
Korupati: VLMs Fail at Gauges Due to E-Commerce Training Biases
“In the case of gauges, most gauges images aren't gauges in the wild. They're product Detail images like these where it's always set to zero. It's paired with an alt text that says something like GIVTO pressure sensor PSI zero to 30 or something. And so, the mo…”