The Ledger, every show
Every statement that passed quotation and attribution checks, across all 44 shows. Pick shows below, then mix any filter with any other.
shows 
every show 44 of 44
Ross: NVIDIA will produce ~5.5M GPUs this year despite 50M die capacity
“If Nvidia wanted to, they could build fifty million of those GPU die, Per year. But they're going to build about 5.5 million GPUs this year.”
Ross: NVIDIA used misleading benchmark curves to claim 30x GPU speedup
“Like, if you look at the last GTC, there was an announcement that the latest GPUs were 30 x faster than the previous generation. And when you look at how it was done, there was this curve that looked kind of like this, and then it Basically ended here, and the…”
Ross: Southeast Asian GPU deployments secretly serve Chinese firms
“One of the concerns right now is about Malaysia or Singapore, that region over there being a place where people are deploying GPUs with the wink, wink, like we're not going to rent it to China, right? But that's a belief that a lot of people are doing that. Ot…”
Ross: Tesla's Dojo custom AI chip project was recently canceled
“And when you look around the industry, you've got a bunch of people building chips, some of them are getting canceled, like Dojo recently got canceled.”
Ross: NVIDIA will keep selling chips despite AI labs building custom silicon
“NVIDIA still keeps selling chips.”
Ross: NVIDIA Will Sell Every Single GPU It Builds
“NVIDIA's gonna sell every single GPU that they build.”
Ross: DeepSeek's breakthrough was an algorithmic gain in data generation
“There was an algorithmic improvement on that. And the algorithmic improvement, as I explained, you know, is this seemingly silly thing where they just wrote the answer in a box and then they knew what to look for rather than having to have a human being check …”
Ross: Groq will not train proprietary AI models to avoid competing with clients
“We have decided that we're not going to train our own models. We'll do a little fine tuning for specific cases or whatnot, but we don't want to compete.”
Ross: DeepSeek scraped OpenAI data while developing unique RL techniques
“And all of that said, they did a lot of really innovative things. So that's what makes it so complicated because on the one hand, they kind of just scraped the OpenAI model. On the other hand, they came up with some unique reinforcement learning techniques,”
Ross: OpenAI does not need to distill DeepSeek because OpenAI remains superior
“They don't need to because they're actually better still. They're a little bit better. So they could, but why would they?”
Ross: DeepSeek was created by a hedge fund, not the state directly
“Remember deep seek is a real, I mean, it's a hedge fund. They're doing this themselves and they're just influenced by the CCP”
Ross: Porting AlphaGo to TPUs jumped its ELO by hundreds of points
“AlphaGo running on GPUs had an ELO score of about 3200. Lease it all was about 35, 35 50. And I might be getting the first digit wrong. It might be 2000 instead of 3000. But like, you know, it was more than 200. And then when put on on TPUs, it actually went t…”
Ross: Groq Will Never Create Its Own AI Models
“In our case we found an area where we will not compete with our customers, which is we will not create our own models. So we just won't do it.”
Groq deploys 600 to 3,000 chips per AI model instead of eight
“So rather than using eight chips, we'll use 600 or 3000 for a model.”
Ross: Edge computing is less energy efficient than data center compute
“They think that edge computing is lower energy. Actually, edge computing is less energy efficient than computing in the data center.”
Ross: Inference Accounts For Roughly 40% Of Nvidia's Market
“Right now, about 40% of their, you know, market is inference.”
Ross: Groq built its entire hardware and cloud stack with 300 people
“We have 300 people. We built our own chip. We built our own networking hardware and software. We built our own runtime. We built our own orchestration layer. We built our own compiler. We built our own cloud. We built all this with 300 people.”
Ross: AI token cost drops consistently spark significant demand growth
“And so what's happened is every time we've seen the cost of tokens for a particular level of quality of models come down, we've actually seen the demand grow significantly.”
Ross: The entire AI industry will shift to Mixture of Experts architecture
“What you're going to see is everyone else starting to use this MOE approach.”
Ross: AI companies will use massive GPU clusters to generate synthetic data
“What you're going to see now is now that everyone has seen this deep seek architecture, they're going to go great. I have hundreds of thousands of GPUs. I'm now going to use a lot of them to create a lot of synthetic data. And then I'm going to train the bejes…”
Ross: Every 100ms speed improvement increases conversion by roughly 8%
“Every 100 milliseconds of speed up results in about an eight percent conversion rate.”
Ross: Groq plans to upgrade its AI chips annually
“We're looking at upgrading chips about once a year.”
Ross: NVIDIA H100 GPUs remain highly profitable to operate despite age
“They're getting close to five years old. And they're still operating well, they're still earning more than their operating costs by quite a bit. You would never deploy an H 100 today, but they're still profitable to run, right?”
Ross: Japan built a two-nanometer fab and is producing wafers
“Japan decided to build a two nanometer fab. When I was there last, they were showing off these two nanometer wafers that they produced. Now, the yield's not where it needs to be. This is not production grade, but they built a two nanometer fab, and they are pr…”
Jonathan Ross: Groq scaled from 640 to over 40,000 chips in 2024
“We started 2024 with about 640 chips in production. We ended with over 40,000.”
Groq Completed Saudi AI Deployment in 51 Days
“Ah, the recent deployment we did in, in Saudi Arabia 51 days from contract to the first tokens being served in production in country.”
Groq Chips Function as Switches Without External Hardware
“We actually don't use switches to communicate between our chips. We just plug our chips into our chips. Our chips are the switch.”