Alistair Pullen
Co-founder & CEO, Cosine. On 1 show, 2 appearances. The Shows tab opens the full record on each.
founderexecutiveengineer@AlistairPullen ↗LinkedIn ↗cosine.sh ↗
Alistair Pullen co-founded Cosine, an AI lab known for building the autonomous software engineering agent Genie. Prior to Cosine, he was an early engineer and the first technical hire at Fancy, which was acquired by Gopuff.
1shows
2appearances
34statements
6resolved
5supported
1contradicted
83%fully supported
Everything Alistair Pullen said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Pass-fail metrics like SWE-bench are too sparse for evaluating AI agents
“Sweet Bench is a pass or fail, right? Like you either have solved the problem or you haven't. That is quite sparse. Like it doesn't give you a huge amount of information because your model could have got a lot of it right. Like looking through when you do a ma…”
Cosine built code retrieval tooling before LLMs could support autonomous agents
“Well, there are going to be some things that you need to build this when the tech does catch up. So retrieval being one of the most important things, like the model is going to have to be able to like pull code out for code base somehow. So we were like, well,…”
Cosine's Genie uses the Perplexity API and URL reading tools
“The genie has both of those tools available to it as well. So yeah, yeah. So we have a tool where you can like put in URLs and it will just read the URLs and you can, it also uses perplexities API under the hood as well to be able to actually ask questions if …”
Cosine will fine-tune and run Genie on Gemini 1.5 once supported
“As soon as you can fine-tune Gemini 1.5, then you best be sure that Genie will have, will work, will run on Gemini 1.5, and, like, we'll probably get very good performance out of that.”
Cosine will make all Genie plans and generated code patches editable
“So we're going to make everything editable, including the code it writes. Like you can, if it makes a small error in a patch, you can just change it yourself and let it continue and it will be fine. So yeah, like those things are super important. We'll be doin…”
Cosine trains Genie to output diffs rather than full file rewrites
“We train Genie to write diffs and, you know, essentially patches, right? Because it's more token efficient”
Cosine receives larger OpenAI LoRA adapters than public tiers due to volume
“Actually we use models that are larger than what's publicly available, something publicly available yet, but when this goes out, it will be, but we have larger law adapters available to us, just because the amount of data that we're pumping through it”
Cosine's SWE-bench model patch outputs are publicly verifiable on GitHub
“The patches are still public. So like the, dare I say, traditional Sweebench submission, you can go to a GitHub repo and see it and run them for yourself and verify that the numbers come out correctly.”
Cosine built a version of Genie fine-tuned on its own codebase
“We have a version of Genie that is fine-tuned on our code base. So we basically, it's the base Genie, and then we run the same data pipeline that we run on, like, all the stuff that we did to generate the main data set on our repo.”
Cosine's early prototype generated entire apps from scratch using OpenAI Codex
“We eventually built the world's most flimsy system, which was back in the day, like 4000 token context windows, like chaining prompts, trying to keep as much context from one to the other, all these different things where essentially you'd put in an app idea i…”
One line per show, most statements first. The link opens Alistair's full record on that show: the calibration, argument clarity, speaking style and every statement made there.
| Show | Role there | Eps | Statements | Record | |
|---|---|---|---|---|---|
 LATENT SPACELEDGER | Co-founder & CEO, Cosine | 2 | 34 | 83% 5/6 | full record on Latent Space → |