Madra: Llama 3 became Groq's most popular model in 48 hours
Sundeep Madra · Ep8. AI Models, Data Scaling, Enterprise & Personal AI | BG2 with Bill Gurley & Brad Gerstner · Bg2 Pod · Apr 29, 2024 · at 4:31
Sunny Madra (Head of Groq Cloud) discusses initial developer demand on Groq's inference platform following the release of Meta's open-source Llama 3 model.
0:00 / 0:15exact quote · 15.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And for us, we saw within the first 48 hours, it become the most power, most popular model that we run on Grok. And so really replacing what? Replacing Mixtrel eight by seven for us, which was, you know, generally considered the best open source model at that point.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sundeep Madra
Madra: Developers replace OpenAI with Llama 3 with no performance loss
“And people are doing a direct replacement with open AI across the board. They come to us. So they come to, you know, all the different providers and they replace out open AI. And they don't really see any performance impact or any reasoning impact”
Madra: 82% of enterprises use or plan to use open-source AI
“82% of the respondents said they are either already on open source or will move to open source.”
Madra: Llama 3 70B is over 10x cheaper than GPT-4
“Price performance, right? You get probably on, from a GPT-IV, you're more than 10 times cheaper. Right. And you're. Yeah. Yeah. 10 times cheaper. And well, let me just tell you, GPT-IV is 10 dollars per million tokens input and 30 dollars per million token out…”