Madra: NVIDIA's internal AI productivity gains for chip design exceed 100%
Sunny Madra · Ep18. Jensen Recap - Competitive Moat, X.AI, Smart Assistant | BG2 w/ Bill Gurley & Brad Gerstner · Bg2 Pod · Oct 13, 2024 · at 50:03
Sunny Madra (Groq) evaluates NVIDIA CEO Jensen Huang's statements regarding NVIDIA's internal use of AI for chip architecture and verification.
0:00 / 0:21exact quote · 21.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I really, you know, been thinking a lot about Jensen's point in the pod about, you know, how much AI they're using internally for design, design verification for all those pieces. Right. And I think, you know, it's not 30%. I actually think sort of that's an underestimate. I think you're talking, you know, multiple hundreds of percent improvement in productivity gains.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sunny Madra
Madra: The three fastest AI inference companies are not NVIDIA
“The three fastest companies in inference right now are not Nvidia.”
Madra: NVIDIA's CUDA moat does not exist for inference workloads
“There is no
Tie into CUDA that's required to go faster.
That's required to get the models running, right?
Obviously none of the three companies run CUDA.
And so that moat doesn't exist around inference.”
Madra: Alibaba's 30-billion parameter Qwen model matches GPT-4o performance
“There was a release today of a Quen You know, thirty billion parameter model, which is performing as good as GPT-IV-O.”
Madra: Chinese open-source AI offers 90% of top quality at 90% discount
“One of the things that you see with the leading open source models now, which are the Chinese is 90% of the quality in terms of intelligence, but at a 90% price discount.”