Appenzeller: NVIDIA's moat lies in software ecosystem, not hardware specs
Guido Appenzeller · AI Hardware, Explained. · Aug 16, 2023 · at 8:42
Guido Appenzeller explains why NVIDIA maintains dominant AI market share even when competitor chips offer comparable raw hardware performance.
0:00 / 0:37exact quote · 37.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“NVIDIA's big advantage is that they have a very mature software ecosystem. So imagine you are an artificial intelligence developer or engineer or researcher. You're often using a model that's open source, you know, somebody else developed, and, you know, how fast that model runs in many cases depends on how well it's optimized for a particular chip. And so the big advantage NVIDIA has today is that their software ecosystem is just so much more mature, right? I can grab a model. It has all the necessary optimizations for NVIDIA to run out of the box, right? I don't have to do anything. But with some of these other chips, I may have to do a lot more of these optimizations myself, right? And that's what giving, what gives them the strategic advantage of them.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Guido Appenzeller
Appenzeller: Intel-Nvidia partnership means AMD is 'fucked'
“I think AMD is fucked, right? I mean, they're, you're just, If your two arch nemesis suddenly team up, that's the worst possible news you can have, right? They were already struggling, right? Their cards are good, their software stack is not, right? They were …”
Appenzeller: Capital moats in AI are shallow speed bumps
“If that assumption is true, I think this means that the moat that's created by these large capital investments is actually not particularly deep, right? It's more of a speed bump than Then, you know, something that prevents new entrants.”
Appenzeller: Intel lacks competitive AI chips and its Gaudi effort is done
“They can't, they don't have anything competitive, right? There was the Gaudi effort that's more or less done, right? There was the internal graphics chips, which never competed really at the high end, right?”
Appenzeller: Intel's customer concentration allowed hyperscalers to push down prices
“One of the biggest problems we had was that our customer base sucked, right? I mean, we were selling to, most of the chips went to the large hyperscalers, you know, which they're way too concentrated, and they build their own chips, and so you can push down yo…”
Appenzeller: High compute costs will force AI into usage-based pricing
“It'll push more and more to, I think, just usage based pricing, right? I think if you have a, if you have an underlying commodity that you're reselling to some degree that has, that is that large a part of your cost of goods, right? You need to go to usage bas…”
Appenzeller: Novel coding lacking AI training data is only 0.01% of development
“I think the good news is that is 0.01% of all software development, right, for the, I don't know, you know, 100,000 ERP system implementation or so, right, that we have tons of training data, and I think these tools can be very, very powerful.”