Sidor: Machine learning math is easier to learn than good engineering
Szymon Sidor · Building Dota Bots That Beat Pros - OpenAI's Greg Brockman, Szymon Sidor, and Sam Altman · Y Combinator · Nov 8, 2017 · at 52:28
Szymon Sidor, research scientist at OpenAI, compares the skill requirements for doing applied machine learning research.
0:00 / 0:32exact quote · 32.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Getting good basics in linear algebra and in basic statistics, that's, especially when Doing experiments, it's easy to make like elementary statistics mistakes and linear algebra is just kind of most of what you need to know to like basic optimization as well to follow what's, what's happening in those models. But this is kind of compared to being a good engineer, quite easy to pick up, at least in project like the one we are doing.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Szymon Sidor
Sidor: Rigorous baseline optimization will advance AI more than complex architectures
“And you know, it's not the kind of sexy research that people want to see, where you have like some hierarchy of big RNN, but it actually, this kind of research, I think at this point will advance field the most.”
Sidor: Strong Engineering Is Much More Valuable at OpenAI than Writing Exotic Models
“So, so essentially becoming a good engineer for our team is much more valuable than, for example, people spending you know, months upon months implementing exotic models in TensorFlow.”
Sidor: AI research neglects understanding existing methods and limits
“And what people do is people kind of try to invent problems and the, such as solving some complicated games of character structure, and they try to Add kind of extra features to their models to combat those problems, but I think there's very little research ha…”
Sidor: OpenAI's RL bot beat its hand-coded bot after one to two weeks
“So I leave, there is nothing, I come back, there is this reinforcement learning bot, and actually, it's beating our scripted bot after, like a week worth of engineering effort. Possibly it was two weeks, but it was something very miniature compared to the deve…”