multimodal LLM
also referred to as: multimodal llms
2 statements across 2 episodes · 0 bullish · 2 bearish · 2 people on the record · first statement Sep 20, 2024 by Justin Johnson · across every show →
Everything said about multimodal LLM, oldest first
Sep 20, 2024 negative
Justin Johnson: Multimodal LLMs shoehorn visual data into 1D token sequences
“And now the multimodal LLMs that we're seeing now, you kind of end up shoehorning the other modalities into this underlying representation of a one D sequence of tokens. Now when we move to spatial intelligence, it's kind of going the other way. Where we're sa…”
Mar 7, 2025 negative
Biilmann: Headless browsers won't remain web agent standards long-term
“For the web, there are questions of, like, how can we simplify The way agents get, like interact with the web, where right now the state of the art is kind of like a headless browser and taking screenshots and having a multimodal LLM take action and that, righ…”