Medlock: Neural network language models are a highly promising research avenue
Ben Medlock · Ben Medlock, SwiftKey // Building a Better Keyboard // Data Driven NYC (FirstMark Capital) · Apr 2, 2015 · at 11:49
Ben Medlock, co-founder and CTO of SwiftKey, speaks in 2015 about emerging AI research directions beyond traditional N-grams.
0:00 / 0:09exact quote · 9.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Another possibility is to move away from engrams and towards neural network-based language models, which is a really promising, ah, avenue of research at the moment.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Ben Medlock
Medlock: 2015 AI technology cannot abstract concepts across domains
“This is what the human brain does so incredibly well, and what our technology today is currently almost entirely unable to do.”
Ben Medlock: Touchscreen typing is an inference problem, not a mechanical one
“This is a virtual keyboard, and the problem of typing was now not a mechanical problem. It's an inference problem, and that means that there is a degree of uncertainty.”
Medlock: SwiftKey is used on close to a billion devices worldwide
“We designed this in 2010, and it's now used on close to a billion devices worldwide.”
Medlock: SwiftKey chose independent probability distributions over neural networks for tractability
“And we took the first one of these because it's a lot easier and a lot more tractable.”