Peer Review
topic on 8 shows · 10 statements across 9 episodes
the Y Combinator Startup Podcast 
the Knowledge Project 
Lenny's Podcast 
My First Million 
the Official SaaStr Podcast 
the a16z Podcast 
All-In 
TBPN
10 statements about Peer Review, every show
Weinstein: Peer review is a modern concept retconned into science history
“Peer review is a fake story that was retconned into science. It is no, you can look it up on Google Ngrams, put quote, space peer review space, close quote. And you'll notice that there's really no mention of it before.”
Weinstein: Nature journal did not adopt peer review until the 1970s
“And by the way, not peer reviewed until the seventies.”
Arnovitz: Multi-model peer reviews mitigate individual AI coding weaknesses
“So I think that using all these models and basically playing to their strengths and mitigating their weaknesses by using other models is, is a game changer for me. So I'll do peer review a bunch of times and I'll have other models review other models code and …”
Best: Peer review is a mistake driving a crisis of fake science
“I think a lot of science is totally broken. I think that they're like, I think that a lot of the, and I think that the scientific project is incredibly important and one of the most valuable things in history, but that the practice of science and the Current s…”
Huberman: Using Close Peer Juries for Grant Evaluation Is Flawed
“The idea that a jury of close peers are going to decide the deletion test, and if you pass, that's flawed in my opinion, because the end culture, we don't have time for this, but the end culture of science is, you know, people aren't like helping each other ou…”
Stanley: Scientific peer review and grant evaluation are flawed by objective thinking
“I think peer review in scientific publication and also in like the assessment of proposals for getting grants, Is, is flawed also because of objective thinking, but it is a place where I think we can if we structure it right, which would be somewhat different …”
86% of software buyers rely on peer reviews for purchasing decisions
“What they do unanimously say, 86% of the people we surveyed look to peers and peer reviews to inform their decisions.”
Balaji: Science is defined by independent replication, not peer review
“Science is not about peer review, it's about independent replication. That's a fundamental difference, right? Peer review is at best a proxy for independent replication.”
De Grey: Peer-reviewed funding is a catastrophe for high-risk scientific research
“Peer review is an absolute catastrophe when it comes to doing anything high risk, high reward, and also for that matter doing anything cross-disciplinary.”
João Batalha: Academic peer review requires significant reform to match modern workflows
“The system nowadays, it's, does not seem to be perfect for the way things work nowadays, and we would love to see either via format or some other platform to try to tackle that, and try to do something to make the peer review a better system, or to change it s…”