Biewald: Nvidia Chips Forced ML Researchers To Become Software Developers
Lukas Biewald · No Priors Ep. 26 | With Weights & Biases CEO Lukas Biewald · Aug 3, 2023 · at 32:55
Lukas Biewald discusses how the shift to GPU-based deep learning changed the technical requirements and profile of machine learning researchers.
0:00 / 0:25exact quote · 25.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“When NVIDIA came along and these chips worked for deep learning, it just, like, broke the entire stack. Like, it was, like, a first time in my career where I'm, like, running into, like, linker errors. I'm like, what the fuck is a linker error? Like, I vaguely, like, remember this, you know, from, you know, like, a CS class I took, you know, like, and so it's, like, I think that ML researchers really had to kind of become software developers”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Lukas Biewald
Biewald: 95% Of ML Developers Are Using OpenAI's GPT Models
“Like I see like 95% of the people out there, you know, using GPT for these ML tasks.”
Biewald: There Are More Funded LLM Tools Than Production LLM Apps
“Very, very few people have LLMs in production. Like there's probably more companies that have raised money as like LLM tools than companies that have LLMs in production, which is like insane. It's just like an insanely saturated tools market with very few peop…”
Biewald: Bayesian Networks Never Worked Well For Many Applications
“Daphne was actually really obsessed at the time with a thing called base nets, which you don't hear about too much anymore, because I don't think they ever really you know, worked for many applications. I hope I'm not offending anyone, but that's my understand…”
Biewald: Most Modern LLMs Were Built Using Weights And Biases
“And we actually helped most of the LLMs out there were built using weights and biases.”
Biewald: Top-Down Enterprise Software Startups Cannot Transition to Product-Led Growth
“The early companies had to sell to executives, which I totally understand. Like that's what crowdflower had to do. And the problem there is you kind of get stuck in these like multimillion dollar deals and like, you just can't get out of that. Like you can't s…”
Biewald: DevOps-Founded MLOps Startups Struggle to Connect with Ordinary Developers
“Every MLOps team then realizes they could raise like a shitload of funding, you know? And so like you got like every, every major company, their MLOps team like went off and like raised money to like make a new product in the market, which I think from an inve…”