Colvin: Gen AI observability will merge into general-purpose observability platforms
Samuel Colvin · Agent Engineering with Pydantic + Graphs — with Samuel Colvin, CEO of Pydantic Logfire · Feb 6, 2025 · at 49:00
Samuel Colvin, founder and CEO of Pydantic, discusses the market landscape for Logfire and AI observability compared to general monitoring giants like Datadog.
0:00 / 0:15exact quote · 15.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Web observability stopped being a thing, not because the web stopped being a thing, but because all observability had to do web. If you were talking to people in 2010 or 2012, they would have talked about cloud observability. Now that's not a term because all observability is cloud first. The same is going to happen to Gen AI.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Samuel Colvin
Colvin: Agent framework engineering quality lags far behind Python ecosystem
“Looking in general at the ecosystem of agent frameworks, the engineering quality is far below that of the rest of the Python ecosystem.”
Colvin: LLMs are 100x faster under four specific engineering conditions
“My take is that there are four, four things where if you can cover all four of these things, LLMs are not like three X faster or five X faster. They're like a hundred X faster.”
Pydantic built a VIP issue scorer after closing an OpenAI founder's ticket
“Basically this started off because one of the OpenAI co-founders created an issue on Pydantic. And we just closed it and said it was wrong. And so we have this that, like, injects itself and tries to summarize someone and it gives them a, like, brutal score of…”
Colvin: Agent Frameworks Exist Because AI Models Are Not Clever Enough
“Agents, agent frameworks, graphs, all of this stuff is basically making up for the fact that right now the models are not that clever.”
Colvin: Logfire migrated from ClickHouse to Timescale before choosing DataFusion
“We don't use ClickHouse. We started building our database with ClickHouse, moved off ClickHouse onto Timescale, which is a Postgres extension to do analytical databases. And then moved off Timescale onto Data Fusion, and we're basically now building, it's Data…”
Colvin: Jupyter Notebooks Are Worse Than or Similarly Bad to Excel
“I have very strong opinions about, you know, proper, like Jupyter notebooks, this idea that like you have to run the cells in the right order. I mean, a whole bunch of things. It's basically like worse than Excel or similarly bad to Excel.”