MedQA benchmark
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement May 18, 2023 by Karan Singhal · across every show →
Everything said about MedQA benchmark, oldest first
May 18, 2023 negative
Singhal: Prior biomedical LLMs lacked systematic benchmarking and human evaluation
“There was a bit of a shortage of kind of a systematic way of doing evaluation of these models. And so it didn't feel like there was a systematic way to think about automated evaluation of the clinical knowledge of these models. So for example, via multiple cho…”