image captioning

2 statements across 2 episodes · 1 bullish · 0 bearish · 2 people on the record · first statement Nov 3, 2023 by Michael Royzen · across every show →

Everything said about image captioning, oldest first

Nov 3, 2023
Insight
Royzen: Users prefer text-to-image generation over image captioning
“I was also looking into image captioning, where like you give a model an image, and then it tells you what's in the image, but it turns out that what people want is the exact opposite. People want to give a description of an image, and then have the AI generat…”
Michael Royzen Nov 3, 2023 ▶ 4:20 Beating GPT-4 with Open Source Models - with Michael Royzen of Phind
Oct 13, 2024 positive
Insight
Q&A Data Drives VLM Detail Recognition Better Than Captioning
“My intuition at least is that I suspect it's really, the heavy lifting might be actually more towards the Q and A side rather than captioning side. I view captioning as a bootstrap, but at the end of the day, we want the model to generalize what they want to d…”
Eugene Xia Oct 13, 2024 ▶ 43:41 [Paper Club] Molmo + Pixmo + Whisper 3 Turbo - with Vibhu Sapra, Nathan Lambert, Amgadoz
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.