vision-language models

also referred to as: vision language models · vlms

4 statements across 3 episodes · 2 bullish · 2 bearish · 3 people on the record · first statement Oct 24, 2024 by Dmitri Dolgov · across every show →

Everything said about vision-language models, oldest first

Oct 24, 2024 negative

Opinion

Dolgov: Off-the-shelf AI models cannot achieve human-beating driverless safety records

“The power of transformers, the power of realism is mind-blowing, right? So with just a little bit of effort, you get something on the road, and it works. You can, you know, drive, I don't know, 1000 of miles, and we just, it will blow your mind. But then is th…”

Dmitri Dolgov Oct 24, 2024 ▶ 39:52 No Priors Ep. 87 | With Co-CEO of Waymo Dmitri Dolgov

Mar 20, 2025 positive

Disclosure

Physical Intelligence uses transformers and pre-trained VLMs for robot models

“And in terms of the architecture, we're using transformers and we are using pre-trained models, pre-trained vision language models, and that allows you to leverage all of the rich information on the internet.”

Chelsea Finn Mar 20, 2025 ▶ 6:51 No Priors Ep. 107 | With Physical Intelligence Co-Founder Chelsea Finn

Mar 20, 2025 bullish

Insight

Finn: Pre-trained VLMs let robots perform tasks with unseen internet concepts

“We had a research result a couple years ago where we showed that if you leverage vision language models, then you could actually get the robot to do tasks that require concepts that were never in the robot's training data, but were in the internet.”

Chelsea Finn Mar 20, 2025 ▶ 7:05 No Priors Ep. 107 | With Physical Intelligence Co-Founder Chelsea Finn

Jul 17, 2025 negative

Insight

Laskin: Sensory and vision-language model rewards are far more hackable than LLM rewards

“The challenge is that if we, if you think that language model rewards are hackable vision language model rewards or, you know, like other sensory signal rewards are infinitely more hackable.”

Misha Laskin Jul 17, 2025 ▶ 51:50 No Priors Ep. 123 | With ReflectionAI Co-Founder and CEO Misha Laskin

vision-language models

Everything said about vision-language models, oldest first

Turn any episode into a week of clips.