Opinion
Zaremba: Universal basic income is the only viable path as automation grows
“So, I believe that we'll have to offer to people a basic income. I super strongly believe that actually that's the only way.”
Insight
Zaremba: Most business problems can be solved via supervised learning
“Majority of business problems can be framed as supervised learning, and therefore they can be solved with current techniques, as long as we have sufficient number of input examples and what we want to predict”
Assertion Partly supported
Zaremba: OpenAI has secured $1 billion in total investment
“In total we gather an investment of one billion dollar in the group.”
Insight
Zaremba: Reinforcement learning struggles in reality due to reward and reset assumptions
“The assumption underlying reinforcement learning Is that then there is some environment, and environment, you are an agent, and you are acting in environment by executing actions and getting rewards from the environment. And the rewards might be taught as, let…”
Opinion
Zaremba: ImageNet is the essential dataset that enabled deep learning
“That's the essential data set that made deep learning happen.”
Assertion Supported
Zaremba: ImageNet error dropped to 3%, achieving superhuman vision performance
“Within several years, people got down, I believe, to three percent error, and that's essentially superhuman performance.”
Assertion Not checkable as stated
Zaremba: Supervised learning is the only ML paradigm ready for business
“So far the supervised learning paradigm is the only one that works so remarkably, remarkably well that it's ready to be applied in business applications. All other are not really there.”
Opinion
Zaremba: Middle-aged workers cannot reinvent themselves every decade under automation
“I don't think that it will be possible for four years old taxi driver to reinvent himself every 10 years. I think it might be extremely hard.”
Assertion Contradicted
Zaremba: Robots cannot grasp arbitrary objects without custom hand-coded programming
“So it turns out that when it comes to arbitrary objects current robots are unable to just grasp an arbitrary object. For any object, it's possible to hand-code a single solution, so, say, as long as, let's say, in factory, if you have same object like I don't …”
Assertion Supported
Zaremba: AlexNet achieved a 15% ImageNet error rate versus competitors' 25%
“A team from University of Toronto, led by Geoffrey Hinton, and that's, like, the team was Alex Krzyzewski and Ilya Suskaver. They actually got To something like 15%. So let's say all other teams, they were like at 25%, the difference was one percent. Yeah. And…”
Assertion Not checkable as stated
Zaremba: Neural network solutions outperform all alternatives despite high deployment costs
“And pretty much that's the reason why things are not largely deployed in production systems out there, but neural network based solutions are actually Outperforming anything what is out there.”
Insight
Zaremba: Humans are proof of concept that AGI is doable
“So how we know that it's even doable? Because we, ah, there is an example of a creature that has such a property.”
Disclosure
Zaremba outlines OpenAI's mission to develop safe, beneficial AGI
“So OpenAI focuses on building AI for the good of humanity. We are a group of researchers and engineers collaborating together who essentially try to figure out what are the missing pieces of artificial, of general artificial intelligence and how to build it in…”
Disclosure
Zaremba: OpenAI focuses robotics research on object manipulation
“So in terms of robotics, we are working on manipulation. We think that manipulation is the complete, it's the one of the parts of robotics, which is the most unresolved.”
Assertion Partly supported
Zaremba: RL models need three years of real-time play to learn games
“Well, for instance, in terms of real-time execution, it takes something around three, three, three years of play to learn to play simple games . I mean it, it can be hugely parallelized, therefore it takes a few days to train it on current computers”
Assertion Supported
Zaremba: Google avoided ML in Search early on over interpretability issues
“Over the time Google search started to use machine learning because it was, it helps to improve results but simultaneously, they wanted to avoid it for some time as it's more difficult to interpret the results, and it's more difficult to actually understand wh…”
Assertion Supported
Zaremba: ReLU activation empirically works way better than sigmoid in neural networks
“It turns out that the one which is even simpler
Empirically works way better, which is called ReLU, Rectify Linear Unit, and this one is ridiculously simple.”
Insight
Zaremba: Neural networks unified text, image, and sound under one methodology
“The cool thing about neural networks is, it used to be the case that people specialized in processing text, images, sound, and these days, this is the same group of people. They, we are using the same method.”
