Agent Environments Must Favor Model Preferences Over Internal System Architecture
Simon Last · Notion’s Sarah Sachs & Simon Last on Custom Agents, Evals, and the Future of Work · Apr 15, 2026 · at 51:22
Simon Last, co-founder of Notion, discusses the engineering lessons learned from evolving Notion's agent architecture from proprietary XML formats to standard Markdown and SQLite interfaces.
0:00 / 0:18exact quote · 18.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I mean, that was, I would say that was a big learning is just, you know, really be savvy and really careful thinking about what the model wants in terms of, you know, its environment and cater around that and really try so hard not to expose it to any complexity about your system that that's unnecessary.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Simon Last
Simon Last Argues That Coding Agents Are the Kernel of AGI
“I think one thing that's becoming more clear is I think like coding agents are the kernel VGI, sort of everything is a coding agent.”
Supervising AI Agents Is a Deeply Technical Systems Problem, Unlike Managing Humans
“There's a critical difference
To being a manager, which is that like, it is actually very deeply technical.
The problem of, you know, humans are very like fuzzy and you can't like treat a team of humans like a rigorous system where like, you know, PRs like fle…”
Simon Last: 99% of Agent Failures Are Tool Bugs, Not Model Flaws
“And actually, 99% of the time, it's a bug in one of the tools. Right. And so, just fix the bug.”
Claude Sonnet Was the Breakthrough That Unlocked Notion's Custom Agents
“The big unlock was Probably like Sonic 3.6 or seven early last year. And that's when we started working on our agent, which we shipped last year.”
Notion Custom Agents Use Standard Pages and Databases as Their Memory
“Another example of this is we have no built-in memory concept. Memory is, is just pages and databases. And so if you want to give it memory, just give it a page and give it access to that page.”
CLI Environments Let AI Agents Autonomously Debug and Fix Broken Tools
“And then I think the most important thing that's super cool is that there it's also inherently a bootstrapped. So if there's an issue of the agent can debug and fix itself within the same environment that it uses the tool, right?”