Everything Varun Mohan said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Mohan: Bearish on outsourced eval startups because AI companies must own evaluations
“And I guess maybe one of the things I'm a little bearish on is If another company comes out and solves eval properly for a bunch of different verticals, what was the company that they were selling to really doing? What are they really doing at that point? If t…”
Mohan: CUDA is not Nvidia's real competitive moat
“Even a company like NVIDIA, I think everyone outside looking in is like, CUDA is the real moat. Or something like that. I think that's just inaccurate, right?”
Mohan: Big tech AI tools lag because employees lack existential threat
“If we had shipped the same quality product that some of these hyperscalers have shipped, we'd be out of the market a year ago, but they probably still have their jobs right now.”
Varun Mohan: Salesforce won't be dethroned by database-plus-agent competitors
“It's very unlikely to me that what's going to happen is Salesforce will get dethroned by a company that is just a database with an agent operating on top of it. It just, there's too much inertia for the company building out these complex workflows.”
Mohan: Niche vertical SaaS products will get competed down significantly
“These very, very verticalized niche products. I think are going to get, they're going to get competed down a ton.”
Mohan: Higher AI developer ROI will cause tech-focused companies to hire more engineers
“The right calculus that JP Morgan Chase or any of these companies will make is the ROI of building technology has actually gone up. So the opportunity costs of not investing more into technology has gone up, which means that you should just invest even more. A…”
Varun Mohan: Codeium would have failed if it used vLLM
“If we use VLLM, we would not be talking with you right now.”
Mohan: Off-the-shelf serving frameworks leave significant FLOP utilization on the table
“The open source serving. Offerings are just, I will say not great in that they aren't customized to transformers and these kinds of workloads where I have high latency and I want to like batch requests and I want to batch requests while keeping latency low. Bu…”
Mohan: Codeium quality matches Copilot and drives user churn
“The product is actually one of those products where even use Copilot and use us, it's hard to tell the difference actually. And a lot of our users have actually churned off of Copilot.”
Mohan: HumanEval benchmark scores are inflated due to GitHub training contamination
“One of the issues that ends up coming up with things like human eval is contamination, because a lot of these things that train models end up training on all of GitHub. GitHub itself has human eval. So they end up Training on that, and then the numbers are arb…”
Mohan: Windsurf's real value is large codebase work, not 0-to-1 apps
“We had the technology to go out and build these zero to one apps very quickly, and I think people are using Windsurf to actually do that, and it's like extremely impressive, but the real value, I think, is actually much deeper than that. It's actually that you…”
Mohan: Squeezing the last 10% from AI benchmarks is counterproductive
“Once it starts hitting the peak of these benchmarks, getting that last 10% actually probably is, like, counterintuitive to the actual goal of what the benchmark was. Like, you probably should find a new hill to climb, rather than sort of p-hacking or really op…”
Mohan: Explicit user prompting will soon become an anti-pattern in AI coding
“I actually think asking people to do things explicitly is probably going to be more of an anti-pattern if we can actually go and passively suggest the entire change for the user.”
Mohan: Codeium uses in-house models for autocomplete due to poor frontier FIM
“The things like autocomplete and supercomplete that run on every keystroke are entirely, like, our own models, and by the way, that is still because properties like FIM, fill in the middle capabilities are still quite bad with the current model.”
Mohan: Vector embeddings fail at granular code retrieval queries
“For a lot of the systems, we do believe embeddings work, but for complex questions, We don't believe embeddings can encapsulate all the granularity of a particular query. Like imagine, imagine I have a question on a code base of find me all quadratic time algo…”
Mohan: Monetizing individual developers in AI tooling is the wrong strategy
“I think that right now optimizing for making money off of individual developers is probably the wrong, actually, strategy. Largely because I think individual developers can switch off of products, like, very quickly, and unless we have, like, a very large lead…”
Varun Mohan: Startups fail from poor execution, not internal messiness
“Startups don't fail because they look like messes inside. Startups fail because they don't do the right thing well enough.”
Mohan: Non-developer AI coding tools and developer AI IDEs will converge
“I think with time, they're going to need to build out more and more tunables, more and more ways to configure the product with time. But I think for us, if we can deeply understand code, like large code bases, it'll naturally follow that with very little effor…”
Mohan: VS Code's UI limitations held back Windsurf's product experience
“Part of the reason why we, the product experience wasn't as good actually was because we were stuck in VS code. And VS code didn't give us the UI capability to make the product much better.”
Mohan: Speed is the only real moat for AI dev tools
“The only moat in our category is speed.”
Mohan: Fewer low-level software engineers will be needed in the future
“So I think you're going to have a spectrum of people, right? People that can operate purely on top of natural language, and they're building capabilities and technology and apps inside companies, but then people also that can go to the weeds, go down to the we…”
Mohan: Asynchronous AI coding agents require 99% accuracy to keep user trust
“It has to be at least 90% correct. People were like, it needs to be 99% correct. Because, and I think they might be right. Because if even 10% is wrong, people lose faith in the product because they waited hours to get the result, right? And they need to bring…”
Varun Mohan: AI agents aren't ready to autonomously write to databases at scale
“I don't think agents are good enough today. That you can kind of just let them operate on top of a database and write to the database, automatically write to the database without human supervision for some arbitrary workflow, right? Right now we're still in th…”
Mohan: AI agents will be trusted to write to internal databases within six months
“They're really good at reading systems at scale, but people don't trust them to make rights to systems, to internal databases at scale. That will probably change in six months, right?”