CoScene
3 statements across 1 episodes · 2 bullish · 1 bearish · 1 people on the record · first statement Oct 4, 2024 by Alistair Pullen · said 2 times in 1 episodes since 2024 · across every show →
Mentions by year
tap a year for its mentions
2024 2 mentions in 1 episode
Everything said about CoScene, oldest first
Oct 4, 2024 positive
Pullen: CoScene's Genie outperforms OpenAI o1 out of the box on SWE-bench
“So it was obviously great to see, like, we still are better than O-one out of the box. You know, even with an older model, and I'm sure that that, that Delta will continue to grow once we're able to train O-one and once we've done more work on our dataset usin…”
Oct 4, 2024 negative
Pullen: SWE-bench is a poor proxy for real-world AI coding competence
“I know Sweebench is, like, the most commonly talked about thing, and honestly, it's a very, it's an amazing project, but one of the things we've learned the most from actually shipping this product to users is, it's a pretty bad proxy at telling us how compete…”
Oct 4, 2024 bullish
Pullen: Replacing Genie's reasoning traces with o1 traces improves performance
“Even now we've started Replacing some of the reasoning traces in our Genie model with reasoning traces generated by O-one, or at least in tandem with O-one, and we've already started seeing improvements in performance from that point.”