Assertion Supported AI assessment confidence: 95% certainty 4/5 debate potential 2/5

Shah: Almost all FDA AI regulation to date targets diagnostic products

Munjal Shah · Hippocratic AI’s Munjal Shah: Building the First Safety-First LLM for Healthcare · Aug 23, 2023 · at 40:47

Munjal Shah is the co-founder and CEO of Hippocratic AI. He explains why Hippocratic AI chose not to focus on medical diagnostics.

0:00 / 0:04exact quote · 4.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Almost all your AI regulation to date from the FDA has been on diagnostic products.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Munjal Shah

Prediction Not checkable as stated
Shah: AI models attempting medical diagnoses will kill patients
“I mean, they just keep going there. I'm going to do diagnoses because it's grand or it's challenging, but I mean, they're going to kill somebody.”
Munjal Shah Aug 23, 2023 ▶ 4:53 Hippocratic AI’s Munjal Shah: Building the First Safety-First LLM for Healthcare
Assertion Not checkable as stated
Shah: Patient non-adherence is healthcare's biggest problem, not diagnosis
“Our biggest issue in the U.S. And most of the developed world is the people don't follow the directions after they're diagnosed. Like, it's not an issue of diagnoses. It's an issue of adherence.”
Munjal Shah Aug 23, 2023 ▶ 5:59 Hippocratic AI’s Munjal Shah: Building the First Safety-First LLM for Healthcare
Assertion Not checkable as stated
Shah: Foundational LLMs are instruction-tuned for queries, not multi-turn conversations
“They've all instruction tuned for what I call a query, not a conversation.”
Munjal Shah Aug 23, 2023 ▶ 18:52 Hippocratic AI’s Munjal Shah: Building the First Safety-First LLM for Healthcare
Assertion Supported
Shah: Operating a voice LLM costs roughly 18 cents per hour
“A large language model speaking at a hundred words per minute will cost somewhere around 18 cents an hour. Okay. So the LLM plus what's the ASR cost, the automatic speech recognition cost, the text-to-speech cost, the TTS cost. We kind of put it all in there. …”
Munjal Shah Aug 23, 2023 ▶ 10:49 Hippocratic AI’s Munjal Shah: Building the First Safety-First LLM for Healthcare
Disclosure
Shah: Hippocratic AI is building its healthcare LLM from scratch
“That's why we're building our own model and we're building it from scratch.”
Munjal Shah Aug 23, 2023 ▶ 19:59 Hippocratic AI’s Munjal Shah: Building the First Safety-First LLM for Healthcare
Assertion Supported
Shah: Hippocratic AI outperformed GPT-4 on 105 of 114 healthcare exams
“And then we took it, and then we had GPT-IV take it, and we had all the other language models take it, and we beat them all. And we beat them on a 105 of a 114 for GPT-IV, for example.”
Munjal Shah Aug 23, 2023 ▶ 21:10 Hippocratic AI’s Munjal Shah: Building the First Safety-First LLM for Healthcare
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.