Nikhila Ravi
Director, Meta Superintelligence Labs · 2 appearances on the record.
computed by AI from the episodes · how this works → · full disclaimer →
scientistengineerauthor@nikhilaravi ↗LinkedIn ↗nikhilaravi.com ↗
Nikhila Ravi leads visual perception research at Meta, focusing on fundamental multimodal computer vision and 3D deep learning. She is best known as a project lead and author behind Meta's visual foundation models—Segment Anything (SAM), SAM 2, and SAM 3—as well as the PyTorch3D library.
26statements → 16claims → 16claims resolved → 94%fully supported → 3.88/5average certainty → 1.35/5average debate potential → ≈4.0/5argument clarity, estimated →
15 supported 0 partly supported 1 contradicted how the 16 claims stand · each chip opens the sources
1 prediction · 15 assertions · 1 opinion · 6 insights · 3 disclosures · every statement was checked. The prediction and assertions are the 16 claims: statements the public record can support or contradict. 16 are resolved. Everything else (opinions, insights, what ifs, disclosures) can never be settled by the record, so it carries no assessment.
The record, in short
What the tape says about how Nikhila argues and how the claims held up. Everything they said, and everything said about them, is in the tabs below.
Their most notable supported claim
Ravi: SAM 3 matches or beats single-task vision SOTA models
“We are really having a unified model that can do many different tasks in the same unified architecture. And so, you know, then the same way that LLMs can do many different tasks without needing a task-specific model. Like with SAM-III, we're able to do image-p…”
Expressed certainty vs assessment result
weighted support: a fully supported claim counts one, a partly supported claim counts half. Each filled bar is clickable and opens exactly those claims; "none yet" means nothing said at that certainty level has resolved yet
How they sound: not measured why? →
We measure speaking style by listening to the audio itself, and a fair number needs at least 2,000 words from one person on tape we have measured. There is too little of Nikhila Ravi on measured tape to publish a rate. This says nothing about how they speak.
Everything Nikhila Ravi said on Latent Space that made the record, most notable first. Filter by type, assessment or year in the ledger →
Ravi: Detection and tracking must decouple due to conflicting representation needs
“The detector needs to be identity agnostic. So if you have a concept dog, it needs to be able to find all instances of that dog. And it needs to sort of have this representation of dog that is the same for all dogs. But when you're tracking those dogs through …”
Ravi: SAM 3 matches or beats single-task vision SOTA models
“We are really having a unified model that can do many different tasks in the same unified architecture. And so, you know, then the same way that LLMs can do many different tasks without needing a task-specific model. Like with SAM-III, we're able to do image-p…”
Public demos acting as internal annotation tools directly accelerate model quality
“And the other piece here is that the demo is actually the annotation tool. So we actually Use the demo as a way to improve our annotation tool. And so then it becomes very natural to invest in building a good demo because it speeds up your annotation and impro…”
Meta limits SAM releases to step-change breakthroughs in narrow capabilities
“So as you've probably seen with SAM and SAM-II, it's a fairly narrow problem, but we really try to make it a step change in the capability. And so with each Version. We are trying to limit the focus on one thing that we can know we can do really well. And in t…”
Ravi: SAM 3 concept prompting eliminates manual per-instance clicking
“Essentially, idea of a concept prompt opens up the ability to find all instances of an object category without having to manually click on every single instance, as you would have had to do if you were using SAM-II or SAM-I.”
Ravi: Meta's SA-Co Benchmark Has Over 200,000 Unique Concepts
“If you look at the size of these benchmarks, the previous benchmark, Peng Chuan mentioned, Elvis, that everyone uses, it has about 1.2 K unique concepts and the benchmark that we created, which we're calling segment anything with concepts or Seiko, COCO for sh…”
Ravi: True AI Advantage Comes From Data Engines Rather Than Models
“That's the advantage in AIs is not just about the models, but really about the data and maybe even more so is actually the data engine to generate that data.”
Ravi: Over 70% of SAM 3 Dataset Annotations Are Negative Phrases
“We have about 70, more than 70% of the annotations are these like negative phrases that are not present in the image.”
Ravi: SAM 3 Uses a Presence Token to Separate Recognition from Localization
“We basically add this presence token to the model, which explicitly separates the task of recognition and localization.”
Ravi: Many video CV workflows require per-frame detection, not identity tracking
“I think also in many video use cases, I think, because if you were sharing on RoboFlow, Users care more about detecting the objects rather than having unique identities. So in, in some cases this, maybe it's, this isn't required to preserve the identities thro…”
Ravi: SAM 2 runs roughly six times faster on video than SAM 1
“And in terms of the efficiency compared to SAM, so if we were to run SAM per frame on a video or run SAM two, it's around six times faster to run SAM two versus run SAM per frame.”
Ravi: SAM 2 will soon run on-device and inside web browsers
“Like, I'm pretty sure soon we'll see like an on-device SAM-II or, you know, maybe even running in the browser or something. So I think that could definitely unlock some of these edge use cases.”
The three-phase architecture evolution of Meta's SAM 2 data engine
“We started with just SAM. We apply SAM per frame. That's like the most basic way of extending SAM to video. Then the most obvious thing to do is to take the output masks from SAM and then provide it as input into a video object segmentation model that takes th…”
Unified models enable faster error corrections via refinement clicks
“And we found that, you know, going from each phase, it both improved the efficiency and it improved the data quality. And in particular, when you get rid of this two-part model, one of the advantages is that when you make refinement clicks, so You prompt the m…”
Ravi: Video segmentation requires far less context than language models
“A difference to language models is probably the amount of context that you need is significantly less than maintaining a long multi-term conversation. And so, you know, coupling this short-term spatial memory with this, like, longer-term object pointers we fou…”
Unified vision models outperform composite multi-model pipelines
“Combining two models and sort of just smushing things together might not actually be as effective as if you really think about how to build things in a unified way.”
Ravi: Meta launched three separate SAM 3 models, not just one
“We launched actually three separate models this time. It was SAM-III, SAM-III objects, and SAM-III body. Those were two completely separate models and SAM III is just the image and video understanding model.”
Ravi: SAM 3 tracking compute scales with detected objects, not classes
“Each of the, it scales with the number of detected objects.”
Ravi: Meta Achieved Fully Automated Annotation in SAM 1, Not SAM 2
“Getting to that fully automated data engine is something that we tried to do in SAM too. We actually didn't get to that fully automated approach. In SAM one, we did, we, you know, But the SA-I-B dataset that we released was fully annotated automatically. We di…”
Ravi: Meta built SAM 3 using open-source community contributions to SAM 2
“In SAM-III we did leverage many of the open source contributions people have made on top of SAM-II.
There were new data sets, there were new benchmarks,
There were new kind of inference time optimizations.
We adopt a lot of the things that the community builds…”
Ravi: SAM impacts medicine more than I could have as a doctor
“Actually Sam is having so much impact in medicine, probably more than I could have ever had as a doctor myself.”
Ravi: SAM 2 tracks moving octopus tentacles zero-shot in underwater video
“There's like underwater videos that it works actually really well for, even though we, models never really seen an octopus before. And octopus have a lot of Moving parts that SAM-II can actually quite effectively keep track of all the different tentacles.”
Ravi: SAM 2's largest model is 224M parameters, one-third of SAM 1
“SAM-I model was around six hundred and thirty million parameters, a fraction of the size of these large language models, but very small. Actually SAM-II, the largest model is around two hundred and twenty-four million parameters. There's actually One third the…”
Appearances (2)
| Episode | Date | Speaking time |
|---|---|---|
| SAM 3: The Eyes for AI — Nikhila & Pengchuan (Meta Superintelligence), ft. Joseph Nelson | Dec 18, 2025 | 17m |
| Segment Anything 2: Memory + Vision = Object Permanence — with Nikhila Ravi and Joseph Nel | Aug 7, 2024 | 28m |