Matthew Turk: AR annotations require inferring intent from 2D gestures
Matthew Turk · Matthew Turk · Jul 28, 2017 · at 20:20
Matthew Turk, computer science professor presenting his augmented reality telecollaboration project 'Being There' at the a16z Academic Roundtable, discusses the challenges of projecting 2D screen markings across different 3D camera angles.
0:00 / 0:20exact quote · 20.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“So we have to figure out a way to make two D annotations on a screen be rendered correctly from different perspectives? Because we have two different people, you know, looking at things from different perspectives. So, what did the user intend is the real question. How can we infer this based on two D gestures and based on the underlying three D data that we have?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Matthew Turk
Matthew Turk defines AR by human experience, not hardware
“My definition of AR is, is not really a technical definition. It's an experiential definition, which is integrating digital information into real world experiences in real time. Ok, it's not fundamentally about technology. It's fundamentally about people and t…”
Matthew Turk: Remote AR collaboration requires independent viewpoints
“If you're just stuck with my viewpoint, seeing through my eyes, that's not really the same as if you were standing here with me and we were looking at something together. So the ability to have a independent viewpoint and the ability to independently explore t…”
Matthew Turk: AR telecollaboration outperforms Skype for physical tasks
“So the two of these two people can collaborate quite successfully on this physical task in a way that's hard to do, again, with just telephone or Skype or something like that.”
Matthew Turk: AR achieves X-ray vision, invisibility, and teleportation
“So all of those things are done these days. X-ray vision, seeing the invisible, changing size, teleportation, done in the area of augmented reality.”