Zhou: Public training data for LLMs is running out
Sharon Zhou · The Where, When, and How of AI with Theory Ventures, Open AI, MotherDuck and Lamini · Dec 8, 2023 · at 4:38
Sharon Zhou (co-founder and CEO of Lamini) explains why AI development is shifting toward proprietary enterprise data.
0:00 / 0:10exact quote · 10.7s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Yeah, I think even just zooming back out at a technical level, I think actually public data is running out for all, all of what LLMs can take advantage of.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sharon Zhou
Zhou: Domain experts, not AI researchers, will drive top models
“However, I believe that, and this is based on my experience training these models, it's actually the domain experts will be driving the best models out there. It won't be people like me who can actually do all the model training, et cetera.”
Zhou: Best LLMs of the next wave will be enterprise models
“So actually the next frontier for LLMs is in enterprises, and I believe the best LLMs for this next, next wave essentially will be enterprise LLMs.”
Zhou: ML benchmark accuracy fails in production without low API latency
“In machine learning, you know, a lot of AI people are like, yeah, we push the performance of this model, and we define performance as accuracy or, you know, accuracy along these, like, general benchmarks. Maybe it's sixth grade science questions or something. …”
Zhou: Prompting Midjourney images matters more than writing blog posts
“And so we found that just spending some time on mid journey was worth more than spending time on the blog posts. In any single way, like hands down, just like spend a few extra minutes here, prompt engineering or really just like generating an image of your ch…”