Sharon Zhou

15 statements across 2 episodes · 11 bullish · 4 bearish · 1 people on the record · first statement Nov 8, 2023 by Sharon Zhou · across every show →

On the record as a speaker too: Sharon Zhou's record, appearances and statements → this page counts the times other people say the name.

Everything said about Sharon Zhou, oldest first

Nov 8, 2023 positive
Assertion Open · timeframe Nov 2026
Lamini switches across 1,000 fine-tuned models in three milliseconds
“With the technology that we've used with parameter efficient fine tuning and just like efficiency, different efficiency methods, that time to switch across a thousand models is three milliseconds”
Sharon Zhou Nov 8, 2023 ▶ 27:59 Custom LLMs at Scale: Lamini CEO Sharon Zhou’s Playbook for Enterprise AI
Nov 8, 2023 positive
Assertion Not checkable as stated
Zhou: Lamini cuts LLM fine-tuning time from months to milliseconds
“And by efficiency, I mean, you know, it's instead of something that might take weeks or even months that's bringing it down to even like the millisecond level.”
Sharon Zhou Nov 8, 2023 ▶ 9:56 Custom LLMs at Scale: Lamini CEO Sharon Zhou’s Playbook for Enterprise AI
Nov 8, 2023 positive
Insight
Zhou: Zero-shot LLMs can replace manual human labeling in RLHF workflows
“Which is that why can't it be another LLM or a pipeline of LLMs that can help with that feedback? I think manual labeling is very tedious, especially for our target user, which is a software engineer. And I don't think people should necessarily have to do all …”
Sharon Zhou Nov 8, 2023 ▶ 16:43 Custom LLMs at Scale: Lamini CEO Sharon Zhou’s Playbook for Enterprise AI
Nov 8, 2023 positive
Disclosure
Zhou: Lamini can train models up to 100 billion parameters
“We can train up to a hundred billion parameters.”
Sharon Zhou Nov 8, 2023 ▶ 24:34 Custom LLMs at Scale: Lamini CEO Sharon Zhou’s Playbook for Enterprise AI
Nov 8, 2023 negative
Assertion Not checkable as stated
Zhou: Outsourcing specialized medical AI data labeling to Scale AI failed
“We tried outsourcing actually to like scale AI, et cetera. None of that worked. It had to basically be me.”
Sharon Zhou Nov 8, 2023 ▶ 21:38 Custom LLMs at Scale: Lamini CEO Sharon Zhou’s Playbook for Enterprise AI
Jul 25, 2024 bullish
Assertion Not checkable as stated
Memory tuning eliminates hallucinations and enables near-perfect task performance
“Been able with memory tuning, which is what I've been working on to remove those hallucinations, to remove that and actually get these models from, you know, not necessarily being general for everything. And instead of being pretty good at everything, but perf…”
Sharon Zhou Jul 25, 2024 ▶ 10:02 Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini
Jul 25, 2024 bullish
Prediction Not checkable as stated
Combining MoE and LoRA will eliminate big versus small model trade-offs
“And I do think that's the future so we can get something that is incredibly smart, incredibly huge, but with the latency cost and speed of something, something tiny. So no more big model versus small model paradigm. It's potentially one in the same.”
Sharon Zhou Jul 25, 2024 ▶ 32:24 Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini
Jul 25, 2024 positive
Assertion Partly supported
Fine-tuning a GPT-3 class model with LoRA provides a 10,000x efficiency boost
“I think for something like a GPD three level model, it's a 10,000 X speed up in efficiency while losing nearly not much at all in accuracy.”
Sharon Zhou Jul 25, 2024 ▶ 30:19 Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini
Jul 25, 2024 bullish
Disclosure
Zhou: Lamini deploys enterprise LLMs on-premise in air-gapped environments
“We're an integrated inference and fine tuning platform for enterprises to be able to run factual LLMs. So essentially LLMs that don't hallucinate on their proprietary data within their secure walls. So we can deploy on premise air gapped, no internet sites. So…”
Sharon Zhou Jul 25, 2024 ▶ 10:58 Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini
Jul 25, 2024 negative
Opinion
Adding sequential LLM calls or filters to catch errors fails in production
“It's both of those things, and I think people are addressing error today by adding more calls to the model of filtering. Out the requests. And I think I don't think that'll work for serious production use cases.”
Sharon Zhou Jul 25, 2024 ▶ 38:49 Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini
Jul 25, 2024 negative
Insight
RAG and prompt engineering are just search techniques, not real AI
“Today when people are running RAG or prompt engineering those are search. That's not AI. It's like keeping the AI frozen and fixed.”
Sharon Zhou Jul 25, 2024 ▶ 41:05 Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini
Jul 25, 2024 positive
Insight
Memory tuning embeds enterprise data to enable near-deterministic factual recall
“To be able to embed facts of your data into the model, so memory tune the model so that it can recall those facts almost deterministically within its probabilistic context.”
Sharon Zhou Jul 25, 2024 ▶ 21:30 Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini
Jul 25, 2024 positive
Assertion Supported
The enterprise GPU shortage has eased at the company level
“Today, actually, I'm seeing the GPU shortage go away at the level, at the company level, meaning companies are able to procure enough compute enough is a strong word, but they're able to procure compute at some level to work with, to fine tune and run heavy in…”
Sharon Zhou Jul 25, 2024 ▶ 16:01 Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini
Jul 25, 2024 positive
Prediction Not checkable as stated
Future AI models will undergo continuous fine-tuning as easily as prompt engineering
“I believe in a future where we're continuously fine tuning these models where it's as easy as prompt engineering and you know, these models continually improve.”
Sharon Zhou Jul 25, 2024 ▶ 40:32 Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini
Jul 25, 2024 negative
Opinion
The AI inference market for startups is a race to the bottom
“My view of inference today, you know, from a market perspective and, you know, startup market perspective is that it's a race to the bottom today for cost. I don't think that's a controversial statement at all. I think people know that it's getting priced lowe…”
Sharon Zhou Jul 25, 2024 ▶ 12:24 Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.