Frontier AI Product Development Requires Knowing When to Stop Fighting Model Limits
Sarah Sachs · Notion’s Sarah Sachs & Simon Last on Custom Agents, Evals, and the Future of Work · Apr 15, 2026 · at 7:15
Sarah Sachs, Head of AI at Notion, explains Notion's framework for navigating rapid advancements in frontier AI capabilities while developing products.
0:00 / 0:33exact quote · 33.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Is really what will set notion apart for every new capability is we have like two skills that are crucial when it comes to frontier capabilities. One is not letting yourself swim upstream. So like quickly realizing if you're just pressing against model capabilities versus not exposing the model to the right information, not having the right infrastructure set up, that in of itself is a skill of intuition. And the second is to see, okay, you're not swimming upstream, which direction is the river flowing? And what is like, how do we think ahead about the product and start building it, even if it's not great yet, so that when it is there, we're ready for it, right?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Sarah Sachs
Sachs: AI Model Quality Varies Between First-Party APIs and Cloud Providers
“Companies that say they're selling the same model through different vendors, whether it be through first party or Bedrock, Azure, et cetera, we do see different qualities sometimes, and that's not necessarily what's advertised.”
Notion Will Beat Frontier Labs in Collaboration Like Datadog Beat AWS
“Datadog could not exist without cloud storage, right? That it's kind of fundamental that that works. And AWS has like a cloud watch product, but Datadog is an expert on understanding how people want observability on the products they launch. And we're experts …”
Notion Engineers Faced an Identity Crisis Shifting From Coding to AI Delegation
“Every software engineer in Notion this summer went through like this sheer one of our engineering leads at the company called it like, every software engineer is going through the identity crisis that every manager goes through, where all of a sudden they real…”
Over-Simplifying AI Agent Interfaces Abstracts Interpretability and Nerfs Agent Capabilities
“I'd actually say we don't try and make it as easy as possible to use because the more we do that, the more we abstract away that interpretability that Simon's talking about that basically nerfs the model or nerfs the agent from being super capable.”
Frontier AI Labs Altered Final Model Snapshots Based on Notion's Enterprise Feedback
“Like they have shipped models that were not the snapshots that we wanted, and they have changed the snapshots that they shipped based on the feedback that we give, because our feedback tends to be more enterprise work focused and not coding agent focused.”
Notion Partnered With Anthropic and OpenAI to Build 30% Pass Rate Evals
“And then what we have, what we call Frontier Headroom evals, where we actively want to be at 30% pass rate. And that's actually been a effort that we took in partnership with Anthropic and OpenAI in the past maybe two or three months, because we actually hit a…”