screenshot

also referred to as: screenshots

3 statements across 2 episodes · 1 bullish · 2 bearish · 2 people on the record · first statement Aug 7, 2024 by Joseph Nelson · across every show →

Everything said about screenshot, oldest first

Aug 7, 2024 negative
Opinion
Segment Anything models underperform compared to other models on screenshots
“And one place where, interestingly, segment anything may be less performant than other models is handling screenshots.”
Joseph Nelson Aug 7, 2024 ▶ 32:51 Segment Anything 2: Memory + Vision = Object Permanence — with Nikhila Ravi and Joseph Nelson
Dec 25, 2024 positive
Prediction Not checkable as stated
Neubig: Hybrid Screenshot And Text Summaries Work Best For Web Agents
“And then the third way is kind of a hybrid where you present the screenshot, but you also present like a textual summary of the output. And that's the one that I think will probably work best.”
Graham Neubig Dec 25, 2024 ▶ 36:32 Best of 2024 in Agents (from #1 on SWE-Bench Full, Prof. Graham Neubig of OpenHands/AllHands)
Dec 25, 2024 negative
Assertion Not checkable as stated
Neubig: AI Models Are Poor At Pixel-Based Web Navigation
“The first way is this, the simplest way and the newest way, but it doesn't work very well, which is you take a screenshot of the website and then you click on a particular pixel value on the website and like models are not very good at that at the moment. Like…”
Graham Neubig Dec 25, 2024 ▶ 35:23 Best of 2024 in Agents (from #1 on SWE-Bench Full, Prof. Graham Neubig of OpenHands/AllHands)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.