SAM 2

“And we found that, you know, going from each phase, it both improved the efficiency and it improved the data quality. And in particular, when you get rid of this two-part model, one of the advantages is that when you make refinement clicks, so You prompt the m…”

“And in terms of the efficiency compared to SAM, so if we were to run SAM per frame on a video or run SAM two, it's around six times faster to run SAM two versus run SAM per frame.”

“That actually is a big limitation of current models, current video object segmentation models. Don't allow any way to recover if the model makes a mistake.”

“The smallest model is thirty-eight million parameters and can run at 45 FPS on an A-one hundred, right?”

“Combining two models and sort of just smushing things together might not actually be as effective as if you really think about how to build things in a unified way.”

“A difference to language models is probably the amount of context that you need is significantly less than maintaining a long multi-term conversation. And so, you know, coupling this short-term spatial memory with this, like, longer-term object pointers we fou…”

“Like, I'm pretty sure soon we'll see like an on-device SAM-II or, you know, maybe even running in the browser or something. So I think that could definitely unlock some of these edge use cases.”

“SAM-I model was around six hundred and thirty million parameters, a fraction of the size of these large language models, but very small. Actually SAM-II, the largest model is around two hundred and twenty-four million parameters. There's actually One third the…”

“In SAM-III we did leverage many of the open source contributions people have made on top of SAM-II. There were new data sets, there were new benchmarks, There were new kind of inference time optimizations. We adopt a lot of the things that the community builds…”

“Getting to that fully automated data engine is something that we tried to do in SAM too. We actually didn't get to that fully automated approach. In SAM one, we did, we, you know, But the SA-I-B dataset that we released was fully annotated automatically. We di…”