Accelerated Computing
topic on 3 shows · 7 statements across 5 episodes
BG2 Pod
No Priors
the MAD Podcast
7 statements about Accelerated Computing, every show
Catanzaro: In accelerated computing, software failure destroys hardware value
“Accelerated computing is the composition of thousands of technologies. If any of them fail to deliver acceleration, the value is destroyed. It doesn't matter whether the chip is great if the compiler sucks.”
Huang: Risk of an AI Compute Glut Is Extremely Low Until Transition Completes
“Until we fully Convert all general purpose computing to accelerated computing and AI until we do that. I think the chances are extremely low.”
Huang: AI compute glut unlikely until general-purpose computing fully transitions
“Until, until we fully Convert all general purpose computing to accelerated computing in AI until we do that. I think the chances are extremely low.”
Huang: Accelerated parallel computing cannot rely on generic compilers across architectures
“What people don't realize is that you can have, ah, three different ISAs, CPU ISAs, they all have their own C compilers, you could take software and compile down to that ISA. That's not possible in accelerated computing. That's not possible in parallel computi…”
Jensen Huang: GPU makers have no clue how to build accelerated computing
“Somebody who's really, really good at building GPUs have no clue how to be an accelerated computing company.”
Huang: For 25 years, the consensus favoring general-purpose computing was right
“At the time, the Valley was the way of designing computers was rather, rather split between general purpose computing versus using accelerators. And about 99% of the Valley was believed in general purpose computing. And about one percent believed in accelerati…”
Huang: Someday all computing workloads will be accelerated
“We deeply believe that, that someday everything will be accelerated. And the reason for that is, is very clearly that, that the CPU will run its course. And there's a limit to how far you could scale general purpose computing and you'll always need it. You alw…”