Sherman Wu: AI development has shifted from prompt to context engineering
Sherman Wu · How OpenAI Builds for 800 Million Weekly Users: Model Specialization and Fine-Tuning · Nov 28, 2025 · at 25:40
Sherwin Wu, Head of Engineering for OpenAI's Developer Platform, discusses how developer focus has evolved as model capabilities move toward agentic workflows and tool usage.
0:00 / 0:10exact quote · 10.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“But I think the name of the game now is, is less on like, Prompt engineering as we had thought about it two years ago. It's more of like, it's like the context engineering side where it's like, what are the tools you give it? What is like the data that it pulls in?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sherman Wu
Sherman Wu: AI industry will shift toward specialized models
“It's, like, becoming increasingly clear that there will be room for a bunch of specialized models. There will likely be a proliferation of other types of models.”
Sherman Wu: ChatGPT has reached 800 million weekly active users
“The first party app is a really great way to get, you know it was like eight hundred million wows or whatever now.”
Sherman Wu: OpenAI previously believed a single model would replace fine-tuning
“I remember like, even with an open AI, the thinking was that there would be like one model that rules them all. And it's like, why would you, I mean, like this kind of goes to the fine tuning API product. It's like, why would you even have a fine tuning produc…”
Sherman Wu: OpenAI prices its API services using a cost-plus model
“Internally, one thing we do is, is we always make sure that we actually price our usage-based pricing from a, like, cost-plus perspective. Like, we're actually just, like, trying to make sure that we're being responsible from a margin perspective.”
Sherman Wu: Usage-based pricing naturally approximates outcome-based pricing in AI
“On outcome-based pricing it sounds very appealing, like, if it can work, but one thing that we've started realizing is it actually ends up correlating quite a bit with usage-based pricing, especially with test time compute. Like, if the thing is just, like, th…”