why aren't all 6 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 0 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Insight
Rajpal: Fine-tuning open-source models on synthetic data closes proprietary capability gaps
“Not out of the box, but with a lot of that fine tuning and that the training, et cetera, you are able to kind of close the gap and even have better performance on metrics.”
Assertion Not checkable as stated
Rajpal: General-Purpose AI Simulators Now Replace Manually Crafted Simulation Systems
“And with Snowglobe, a big kind of idea is that for the first time in history, we can actually have, you know, a general purpose simulation system, right? Like simulation systems have existed, but, and, you know, we saw them like extensively in self-driving and…”
Opinion
Rajpal: Pure ChatGPT test conversations lack diversity and realism
“Compared to, let's say, you were asking, like, ChatGPT to generate, you know, these, like, conversations for you. They all kind of have that ChatGPT vibe, and this ends up looking, you know, very diverse and very grounded in, like, your use case and your data.”
Insight
Rajpal: Simulations reveal which failure modes actually require runtime guardrails
“And then, you know, in simulation, figure out, you know, what is actually robust, what isn't, and then the stuff that isn't robust is the stuff that you need guardrails for.”
Assertion Not checkable as stated
Rajpal: Simulation testing revealed an early partner's real failure was over-refusal
“Organizations that we're, we were, we had as our design partner, we you know, they were like, oh, we're very worried about toxicity, and we want toxicity guardrails, and we did all of this testing for them in production, and toxicity was actually not a real co…”
Disclosure
Rajpal: Reusable persona libraries are Snowglobe's top requested feature
“Today, all personas are net new, but this is our number one requested feature, which is I want to be able to, you know, like maybe this, maybe some product leader already has a set of like personas that they want to test again. So I want to bring those, be abl…”