DeepScribe discards LLM output if it lacks classical model validation
Akilesh Bapu · AI Medical Scribe Breakthrough: DeepScribe CEO Akilesh Bapu on Healing Doctor Burnout · Nov 17, 2023 · at 24:30
Akilesh Bapu, CEO of DeepScribe, describes the multi-model architecture his company uses to mitigate AI hallucinations in clinical note generation.
0:00 / 0:18exact quote · 18.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“So for a given task, we'll have a classical model typically produce that that same output. And then if the LLM puts in something that the classical model didn't have in its output we'll go ahead and only go with the classical model's output and disregard the LLM's output.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Akilesh Bapu
DeepScribe sees more impact fine-tuning in-house LLMs than GPT-4
“So with GPT-IV, to be honest, we haven't gotten the impact we'd like in terms of fine-tuning. Where we've seen the most impact is with our own in-house LLM.”
Bapu: Healthcare AI risks triggering another wave of clinician AI burnout
“It also runs the risk of that same burnout occurring again.”
Bapu: Healthcare AI lacks proven system-wide adoption despite strong sales
“People are definitely buying but what's not shown yet is whether these solutions can gain true system-wide adoption.”
DeepScribe CEO: AI achieved parity with human scribes, enabling full automation
“A couple months ago for the first time achieved parity with our AI and our expert human scribes, at which point we took them out of the loop. And so now DeepScribe is fully automated”
DeepScribe ended offshore reviewer contracts as clinicians stopped requesting human review
“Clinicians are barely sending the note to the human to review, yet we were keeping that option. We're keeping this like base level contract with our offshore suppliers. So we decided to officially make the move and that's when we started to see complete shift.”