“In the end, we'll enter an era where we'll talk to software, and software will do work for us, and everything in the middle is a means to an end.”
quote is from the automated transcript, cleaned for reading:
filler sounds and stutters are removed, nothing is rephrased. names can be misheard
(the analysis reads context, assessments check outside sources). how →
More from Atin Sanyal
Opinion
Sanyal: LLM-as-a-judge approaches choke and fail to scale in production
“LLMs as judges, which was the traditional way that people were using to evaluate, and that has a whole history of it. They don't scale. They don't scale in production. They don't allow you to do full scale observability, which means intercepting every single i…”
Atin SanyalJul 9, 2026▶ 27:34The Hidden Layer Every Al Product Needs Today | Atin Sanyal Founder, Galileo
Insight
Sanyal: LLM evaluation does not require general-purpose reasoning models
“We feel like if you really focus on the fundamental problem that, hey, evaluations for language models is a very task-specific, constrained problem, and it does not require you to use you know, general purpose reasoning for that, and then there's fine-tuning y…”
Atin SanyalJul 9, 2026▶ 39:49The Hidden Layer Every Al Product Needs Today | Atin Sanyal Founder, Galileo
Insight
Sanyal: Software and code are commoditized into tokens by fast AI generation
“In an era where you can build an, you know, a website and a web application with a Postgres database behind in 30 seconds, Software is just commoditized. Software is just tokens. Code is tokens.”
Atin SanyalJul 9, 2026▶ 1:00:42The Hidden Layer Every Al Product Needs Today | Atin Sanyal Founder, Galileo
AssertionSupported
Uber built the world's first machine learning feature store
“We had worked on the feature store at Uber, and we had built the world's first feature store, and we literally coined the term.”
Atin SanyalJul 9, 2026▶ 9:28The Hidden Layer Every Al Product Needs Today | Atin Sanyal Founder, Galileo
PredictionNot checkable as stated
Sanyal: SLMs will always maintain an inference cost advantage over LLMs
“It is so
cheap to run a single inference on an SLM versus an LLM. So that gap will always be there.”
Atin SanyalJul 9, 2026▶ 38:34The Hidden Layer Every Al Product Needs Today | Atin Sanyal Founder, Galileo
Opinion
Sanyal: MCP addresses only a drop in the ocean of agent interactions
“Well, MCP is one stab at solving a very specific problem of agent interactions, which is to selecting the right tools and sort of automating that process. There's a lot more to be solved. It's a drop in the ocean of the overall set of interactions.”
Atin SanyalJul 9, 2026▶ 1:06:04The Hidden Layer Every Al Product Needs Today | Atin Sanyal Founder, Galileo
Made with StarZero
Turn any episode into a week of clips.
This entire site, over 300 episodes transcribed, diarized, checked and made playable,
runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the
moments worth sharing, cuts them, captions them, and reframes them for every feed.
We use essential cookies to make the site work. With your permission we
also use analytics cookies (Google Analytics and Mixpanel) to understand
usage and improve StarZero. See our Cookie Policy.