Disclosure certainty 4/5 debate potential 1/5

FAIR shifted from children's book benchmarks to Wikipedia question answering

Antoine Bordes · Artificial Intelligence at Facebook // Antoine Bordes, Facebook [FirstMark's Data Driven] · Nov 9, 2016 · at 13:38

Antoine Bordes, AI research scientist at Facebook AI Research (FAIR), outlines FAIR's research timeline transitioning machine reasoning from synthetic tasks to real-world data.

0:00 / 0:15exact quote · 15.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And at the end of last year, we also released something that is the same kind of ideas using, like, ah, some short stories, but, ah, that we use from, like, children books, real children books, and now we are moved to a train to answer question, ah, directly from Wikipedia.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Antoine Bordes

Assertion Contradicted
Bordes: 2016 image recognition AI uses Yann LeCun's 1993 neural architecture
“This is exactly the same architecture of what's being used right now.”
Antoine Bordes Nov 9, 2016 ▶ 5:13 Artificial Intelligence at Facebook // Antoine Bordes, Facebook [FirstMark's Data Driven]
Prediction Held up
Bordes: Direct machine reading will eventually match IBM Watson's performance
“The goal is that, ah, eventually, by trying to understand the text directly, you can actually at least equal, all the information by Watson is in text, in free text.”
Antoine Bordes Nov 9, 2016 ▶ 20:00 Artificial Intelligence at Facebook // Antoine Bordes, Facebook [FirstMark's Data Driven]
Insight
Real-world applications must balance machine learning with rule-based extraction pipelines
“In terms of developing real application, I think you should really try to balance both, because it's true that in the example I showed, If you have a very good process to basically already isolate all the entities and if you want basically to use something lik…”
Antoine Bordes Nov 9, 2016 ▶ 24:45 Artificial Intelligence at Facebook // Antoine Bordes, Facebook [FirstMark's Data Driven]
Assertion Not checkable as stated
Most 2016 production computer vision systems lack bounding box capabilities
“This is, right now, I would say that the best systems are doing this in production. Most of them are doing this. And some are not even doing the boxes.”
Antoine Bordes Nov 9, 2016 ▶ 4:26 Artificial Intelligence at Facebook // Antoine Bordes, Facebook [FirstMark's Data Driven]
Prediction Held up
Bordes predicts large AI models will run on mobile devices by 2017
“And next year we will run them on mobile, so.”
Antoine Bordes Nov 9, 2016 ▶ 6:56 Artificial Intelligence at Facebook // Antoine Bordes, Facebook [FirstMark's Data Driven]
Assertion Not checkable as stated
Bordes: No AI model can solve bAbI's simple reasoning task
“Basically this one is still unsolved, which is, like, super easy. Actually, no machine can solve this one.”
Antoine Bordes Nov 9, 2016 ▶ 12:25 Artificial Intelligence at Facebook // Antoine Bordes, Facebook [FirstMark's Data Driven]
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.