Biewald: Research code inevitably bleeds into production at every company
Lukas Biewald · No Priors Ep. 26 | With Weights & Biases CEO Lukas Biewald · Aug 3, 2023 · at 16:13
Weights & Biases CEO Lukas Biewald discusses ML developer tooling philosophy and why traditional ops workflows fail when applied to machine learning research.
0:00 / 0:18exact quote · 18.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think companies have this idea that like the researchers are just going to like throw the thing over the fence and then it's going to be in production. But it doesn't really work actually. Like, I think that's a bad pattern that people sort of like imagine they're going to do, and they don't ever really do that. You end up like with researchers, always the research code bleeds into production in every company.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Lukas Biewald
Biewald: 95% Of ML Developers Are Using OpenAI's GPT Models
“Like I see like 95% of the people out there, you know, using GPT for these ML tasks.”
Biewald: There Are More Funded LLM Tools Than Production LLM Apps
“Very, very few people have LLMs in production. Like there's probably more companies that have raised money as like LLM tools than companies that have LLMs in production, which is like insane. It's just like an insanely saturated tools market with very few peop…”
Biewald: Bayesian Networks Never Worked Well For Many Applications
“Daphne was actually really obsessed at the time with a thing called base nets, which you don't hear about too much anymore, because I don't think they ever really you know, worked for many applications. I hope I'm not offending anyone, but that's my understand…”
Biewald: Most Modern LLMs Were Built Using Weights And Biases
“And we actually helped most of the LLMs out there were built using weights and biases.”
Biewald: Top-Down Enterprise Software Startups Cannot Transition to Product-Led Growth
“The early companies had to sell to executives, which I totally understand. Like that's what crowdflower had to do. And the problem there is you kind of get stuck in these like multimillion dollar deals and like, you just can't get out of that. Like you can't s…”
Biewald: DevOps-Founded MLOps Startups Struggle to Connect with Ordinary Developers
“Every MLOps team then realizes they could raise like a shitload of funding, you know? And so like you got like every, every major company, their MLOps team like went off and like raised money to like make a new product in the market, which I think from an inve…”