Kevin Weil

21 statements across 2 episodes · 11 bullish · 3 bearish · 1 people on the record · first statement Nov 6, 2024 by Kevin Weil · said 21 times in 12 episodes since 2024 · across every show →

On the record as a speaker too: Kevin Weil's record, appearances and statements → this page counts the times other people say the name.

Mentions by year

brought up most by Lenny Rachitsky (17), Sherwin Wu (4)

tap a year for its mentions
00851510202420252026episodesmentions
0510202420252026episodes it came up in
001.352.510202420252026episodesmentions per episode
2026 5 mentions in 2 episodes 3 per episode
2025 15 mentions in 9 episodes 2 per episode
2024 1 mention in 1 episode

every mention, scene by scene, with the transcript →

Everything said about Kevin Weil, oldest first

Nov 6, 2024 bullish
Assertion Supported
Weil: Frontier AI increasingly generates answers that evaluators prefer over humans
“The models are getting to the point where they can often beat humans at certain tasks. Like, people prefer the model's answers to a human's answers, and so if you're humans writing your evals, like, you know, so what does that mean?”
Kevin Weil Nov 6, 2024 ▶ 18:35 A conversation with OpenAI's CPO Kevin Weil, Anthropic's CPO Mike Krieger, and Sarah Guo
Nov 6, 2024 bullish
Prediction Not checkable as stated
Weil predicts today's cutting-edge AI will feel like garbage within 12 months
“And, you know, the stuff that's happening today that we're working on, that you guys are working on, it all feels like magic. 12 months from now, we're going to be like, can you believe we use that garbage? Because it's going to, I mean, that's how fast this t…”
Kevin Weil Nov 6, 2024 ▶ 24:17 A conversation with OpenAI's CPO Kevin Weil, Anthropic's CPO Mike Krieger, and Sarah Guo
Nov 6, 2024
Insight
Weil: AI product design fundamentally differs based on model reliability tiers
“You don't know whether it's going to be like, 60% good, or 90% good, or 99% good, and the product that you would build that would make The sense with something that works 60% of the time is super different than 90 or 99% of the time, right?”
Kevin Weil Nov 6, 2024 ▶ 6:55 A conversation with OpenAI's CPO Kevin Weil, Anthropic's CPO Mike Krieger, and Sarah Guo
Nov 6, 2024 positive
Insight
Weil: Current AI models are eval-limited rather than intelligence-limited
“I think there's a very real sense in which models today are not intelligence limited. They're eval limited. They can actually do much more and be much more correct on a wider range of things than they are today, and it's really about sort of teaching them.”
Kevin Weil Nov 6, 2024 ▶ 13:12 A conversation with OpenAI's CPO Kevin Weil, Anthropic's CPO Mike Krieger, and Sarah Guo
Nov 6, 2024 positive
Insight
Weil: AI product development fundamentally differs because capabilities shift every two months
“Normally when you're building product, you're building off of kind of a fixed technology base, right? You know what you have to work with, and you're trying to build the best product you can. Here it's like every two months computers can do something computers…”
Kevin Weil Nov 6, 2024 ▶ 1:46 A conversation with OpenAI's CPO Kevin Weil, Anthropic's CPO Mike Krieger, and Sarah Guo
Nov 6, 2024
Prediction Not checkable as stated
Weil: Writing evals will become a core skill for PMs
“Yeah, writing evals, I mean, it's, I actually think it's going to become a core skill for PMs.”
Kevin Weil Nov 6, 2024 ▶ 14:37 A conversation with OpenAI's CPO Kevin Weil, Anthropic's CPO Mike Krieger, and Sarah Guo
Apr 10, 2025 bearish
Insight
Weil: Prompt engineering will become obsolete as AI matures
“I want to kill the idea that you have to be a good prompt engineer. I think if we do our jobs, that stops being true. You know, it's just one of those, like, sharp edges of models that experts can learn, but then you just, over time, you shouldn't need to know…”
Kevin Weil Apr 10, 2025 ▶ 1:27:00 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025 positive
Assertion Partly supported
Weil: OpenAI image model understands complex multi-image spatial instructions
“The model is, is really capable at emulating style or understanding what, you know, it's very good at instruction following. That's actually something that I think people, I'm starting to see people discover with it, but you can do very complex things. You can…”
Kevin Weil Apr 10, 2025 ▶ 7:30 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025 positive
Prediction Not checkable as stated
Weil predicts ML engineers will soon embed in every product team
“And so I think you're going to want sort of quasi researcher machine learning engineer types as part of pretty much every team because fine tuning a model is just going to be part of the core workflow for building most products.”
Kevin Weil Apr 10, 2025 ▶ 58:37 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025 negative
Insight
Weil: Organizations should stay PM-light to prevent micromanagement
“Too many PMs causes problems. You know, we'll like fill the world with decks and ideas versus execution. So I think that the, I think it's a good thing when you have a PM that has that is working with maybe slightly too many engineers, because it means that th…”
Kevin Weil Apr 10, 2025 ▶ 48:25 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025 positive
Prediction Not checkable as stated
Weil: Future AI will pair broad foundation models with custom evals
“I think the future is really gonna be incredibly smart, broad based models. That are fine tuned and tailored with company specific or use case specific data so that they perform really well on company specific or use case specific things. And you're going to m…”
Kevin Weil Apr 10, 2025 ▶ 24:02 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025 bullish
Insight
Weil: Developers Building on the Edge of Model Limits Should Persist
“If you're building And the product that you're building is kind of right on the edge of the capabilities of the models. Keep going, because you're doing something right. Because you give it another couple months, and the models are going to be great. And sudde…”
Kevin Weil Apr 10, 2025 ▶ 31:52 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025
Insight
Weil: Multi-month product roadmaps in AI are pointless
“So that's, I think, just expecting that you're going to be super agile and that there's no sense writing a three month roadmap, let alone a year long roadmap, because the technology is changing underneath you so quickly.”
Kevin Weil Apr 10, 2025 ▶ 28:13 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025 neutral
Insight
Weil: Model accuracy levels dictate fundamentally different product designs
“If the model gets it right, 60% of the time, you build a very different product than if the model gets it right, 95% of the time, versus if the model gets it right, 99.5% of the time. And so there's also something that you have to get really into the weeds on …”
Kevin Weil Apr 10, 2025 ▶ 18:17 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025 negative
Opinion
Weil calls Facebook's Libra the biggest disappointment of his career
“Honestly, Libra is probably the biggest disappointment of my career.”
Kevin Weil Apr 10, 2025 ▶ 1:18:37 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025 positive
Opinion
Weil: OpenAI should never become a pure product company
“OpenAI should never be a pure product company. We need to be both a world-class research company and a world-class product company. And the two need to really work together.”
Kevin Weil Apr 10, 2025 ▶ 46:44 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025
Insight
Weil: Teams should question social products that fail internal dogfooding
“Especially social things because you have a very tight network as a company socially. So you know each other and your experts in your product, hopefully. And so there's some sense in which if you're doing something social and it's not taking off internally, yo…”
Kevin Weil Apr 10, 2025 ▶ 7:06 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025
Assertion Not checkable as stated
Weil: OpenAI operates with only about 25 product managers
“Not that many, actually. I don't know. 25. Maybe it's a little more than that”
Kevin Weil Apr 10, 2025 ▶ 48:11 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025 bullish
Insight
Weil: AI gives computers novel capabilities every two months
“Every two months, computers can do something they've never been able to do before, and you need to completely think differently about what you're doing.”
Kevin Weil Apr 10, 2025 ▶ 17:03 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025
Assertion Not checkable as stated
Weil: OpenAI manages 400 million weekly users with 30-40 support staff
“With 400 plus weekly 400 plus million weekly active users, we get, you know, a lot of inbound tickets, right? I don't know how many customer support folks we have, but it's not very many. 3040, I'm not sure. Way, way smaller than you would have at any comparab…”
Kevin Weil Apr 10, 2025 ▶ 1:01:32 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Apr 10, 2025 bullish
Insight
Weil: OpenAI minimizes scaffolding because rapid advances erase model limits
“We don't spend that much time building scaffolding around the parts that don't match that because our general mindset is in two months, there's going to be a better model and it's going to blow away whatever, you know, the current set of limitations are.”
Kevin Weil Apr 10, 2025 ▶ 31:38 OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 300 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.