Biewald: Most enterprises have not deployed LLMs into production yet
Lukas Biewald · Startup to Industry Standard: Lukas Biewald Explains How W&B Scaled MLOps for OpenAI, NVIDIA & More · Aug 9, 2023 · at 18:09
Lukas Biewald is the co-founder and CEO of MLOps platform Weights & Biases. He discusses enterprise AI adoption trends during a podcast interview in August 2023.
0:00 / 0:23exact quote · 23.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think that LLMs in particular, we talk to a lot of the people and we don't see a ton of people getting them into production yet. And I think it's funny, like VCs are always surprised, like when we tell them that I think that I don't know. I'm bullish on LMS, but I think like we should just acknowledge most enterprises haven't gotten them into production because it's actually hard.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Lukas Biewald
Biewald estimates 99% of Global 2000 use ML for core operations
“I bet 99% of the global 2000 is using machine learning for something that they actually really care about.”
Biewald: PyTorch beat TensorFlow through developer empathy, not eager execution
“I don't think they really, I think people tell this, the story of sort of the silver bullet. Of like you know, the eager execution model. But I think the reality is they just built a product with so much more empathy.”
Biewald: Almost all major LLMs were trained using Weights & Biases
“I think all of the major LLMs out there, almost all were trained using weights and biases.”
Biewald: Simple operational errors cause more model failures than data drift
“People talk a lot about data drift in the industry. And that's this idea that like, you know, like language changes over time and you want to know that it's changing and sort of like have your model you know, notice that and update it. But I guess like what I …”