Ali Pullen
5 statements across 1 episodes · 3 bullish · 1 bearish · 1 people on the record · first statement Aug 22, 2024 by Alistair Pullen · said 4 times in 1 episodes since 2024 · across every show →
Mentions by year
brought up most by Shawn Wang (3)
tap a year for its mentions
2024 4 mentions in 1 episode
Everything said about Ali Pullen, oldest first
Aug 22, 2024 negative
Standard semantic embedding similarity fails on codebase retrieval tasks
“And once you've done that, I will write a query saying like, find me some authentication code or something, embed it, and then do the cosine similarity and get the top of K right. That doesn't work. And I wish it did work. Don't get me wrong. It doesn't work w…”
Aug 22, 2024 positive
Generating hypothetical code from queries significantly improves codebase retrieval accuracy
“So what we ended up, the first approach we took and that kind of did well enough for a long time was, okay, let's train a model to be able to take in English code queries and then produce a hypothetical Code snippet that might look like the answer, embed that,…”
Aug 22, 2024 positive
Cosine's Genie achieved roughly 66% codebase retrieval accuracy across benchmark tasks
“And I think in our technical report, I can't remember the exact number, but I think it was around 65 or 66% retrieval accuracy overall measured on. We know what lines we need for these tasks to find for the task to actually be able to be completed. And we foun…”
Aug 22, 2024 neutral