Nelson: SAM 3 Open Text Boxes Will Trigger Many Unprimed User Queries
Joseph Nelson · SAM 3: The Eyes for AI — Nikhila & Pengchuan (Meta Superintelligence), ft. Joseph Nelson (Roboflow) · Dec 18, 2025 · at 1:02:55
Joseph Nelson, CEO of Roboflow, discusses how the interface shift to natural language prompting in vision foundation models alters user demands.
0:00 / 0:11exact quote · 11.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Now that you've kind of given this open text box for media, there's going to be a flood of the types of things users are going to want to try to do, some of which SAM is already going to be really well adapted to do, some of which not.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Joseph Nelson
Nelson: Users Ran 8 Million Inferences in SAM 3's First Five Days
“I mean, in the first five days of SAM three, there was like eight million inferences of folks that were running across all diverse sets of fields.”
Nelson: A Single Negative Example Goes a Long Way in Vision Fine-Tuning
“I can offer anecdotally that a single negative example goes a long way.”
Nelson: Last-mile computer vision requires aligning intention, not knowledge
“And so this is why, like, in some ways human in the loop, because identifying human intention, not necessarily human knowledge is what's going to be important for a lot of last mile use.”
Production computer vision still requires user prompting to isolate targets
“But even if you had, like, a perfect SAM, like an omniscient SAM that could see every segment in every domain with all pixels perfectly outlined, in production, you still need some way to almost, like, signal to the model what you care about.”