deep learning

“That's the essential data set that made deep learning happen.”

“It's not just convolutional neural network. It was also the first time that two GPUs were put together by Alex and his team. And were used for the computing of deep learning. So, it was really the first moment of data, GPUs, and neural network coming together.”

“If you had thrown the same amount of investment into almost anything else, you would also have seen extremely exciting results, like genetic algorithms, for instance.”

“You have to break the combinatorial wall, and the way to do it is to add deep learning guidance. It's actually very similar to the principles that analyze something like AlphaGo or AlphaZero.”

“You could not really get Gradient descent to encode sort of like reasoning style algorithms. It was not because the models could not represent these algorithms. It was because gradient descent could not find them, right? So the problem was that it wasn't about…”

“And so everything you're doing with machine learning today, with parametric curves, we should be able to do it. With symbolic models in the future in a way that will be much, much closer to optimality. Much closer to optimality in the sense that you're going t…”

“The big idea of the company that was spot on is that it is possible to augment the CPU to solve problems that otherwise are too difficult to solve. And molecular dynamics is one of them. Image processing is one of them. Inverse physics is another one. And so a…”

“The breakthrough for us was realizing that AlexNet was not AlexNet. That AlexNet was an approach with deep, deep learning that allows you to learn any function.”

“The world does not understand how to intuit exponentials, and so they missed this one.”