GPU

“I think the other thing that's interesting about one is that it makes a lot of the GPU needs even bigger because it's moving a lot of the computation needs a lot higher for inference because it's taking a lot more time to do a lot of the inference. So I think …”

“It's not just convolutional neural network. It was also the first time that two GPUs were put together by Alex and his team. And were used for the computing of deep learning. So, it was really the first moment of data, GPUs, and neural network coming together.”

“Like one thing that I think is like the standard way people parallelize chips isn't the whole thing is one failure domain. Like one chip fails, the whole thing can crash.”

“The moment that you start basically going to lower concurrency because you want better interactivity and better latency, Right? The performance the throughput drops. And it drops very sharply because all of a sudden you have a lot of, like, smaller kernels, yo…”

“I think, ah, you're gonna see more and more, ah high performance and low energy inference hardware systems, because I think everyone is now realizing that inference is the key to making, you know, these agent-based systems be available to more and more people,…”