Galileo
other on 4 shows · 0 statements across 0 episodes
the Neon Show 24 
20VC 13 
Latent Space 6 
Big Technology
Mentions by year, every show
tap a year for its mentions
the Neon Show 2420VC 13Latent Space 6
2026 24 mentions in 1 episode
2025 6 mentions in 1 episode
every mention on every show, scene by scene, with the transcript →
16 statements about Galileo, every show
Sanyal: VP of data science is a diminishing role in enterprises
“In our case, our ICPs were the VPs of engineering or rather VPs of data science back in the day. It was a role that apparently is a diminishing breed.”
Sanyal: MCP addresses only a drop in the ocean of agent interactions
“Well, MCP is one stab at solving a very specific problem of agent interactions, which is to selecting the right tools and sort of automating that process. There's a lot more to be solved. It's a drop in the ocean of the overall set of interactions.”
Pollan: Historical compromise left modern science ill-equipped to study subjectivity
“And now we'll take everything measurable and quantifiable. And the church, you can have everything subjective and qualitative. That was Galileo's deal and Descartes to some extent. And it was a very pragmatic deal, but it's left us with a science that's ill-eq…”
Google Gemini Flash-Lite ranks in top five on Galileo Agent Leaderboard
“In the, on the original leaderboard, we also have flashlight, which is, nobody talks about, I think, even now, but I think it's got a very decent score, which is, like, in the top five models. It's extremely cheap model, like, it's so dirt cheap that it makes …”
OpenAI o-series reasoning models fail at multi-tool calling benchmarks
“Then another surprise for me was that the reasoning models were not performing well enough. They had certain kind of limitation when we probed into it, like, why are they scoring less overall? They were like the O-one, the O-four, O-three, they, When not perfo…”
Meta Llama 3.3 and Llama 4 perform poorly on agent benchmarks
“Another, of course, the other surprise was that all the Lama models were not performing well on our benchmark. 3.3 and even the Lama four all were really performing extremely poor.”
Claude 3.7 remains unbeaten on Galileo Agent Leaderboard
“When we released the leaderboard and just in a week that launched 3.7, And that went straight up, and nobody has beaten it so far.”
LLM-as-a-judge methodology is now reliable enough for production evaluation
“Two years back where we were using our own similar LLMS judge methodology, and we had certain issues and there were some correlation issues at the time, but last year it got pretty strong and this year I feel it's so strong. LLMS judges is so strong that you c…”
Changing LLM judge models can heavily alter benchmark leaderboards
“The leaderboard, if you are using different judges with different models, it can, there can be heavy shakeup of the leaderboard also.”
Galileo Agent Leaderboard top scores have saturated at 0.95
“Then we saw with V-one that the scores are saturating. We see that the best score has already reached .95.”
Wilkes intentionally bootstrapped Galileo from inception to retain control
“When we founded the company, we knew we wanted to be bootstrapped. We wanted to go it alone. We weren't intending on taking money or significant amounts of money, which meant we were going to go slow by definition.”
Wilkes: Fintech leaders will rebundle services around friction-free consumer experiences
“This trend will continue, and what I believe will happen is that will drive change, and that change will be focused on an obsession with Consumer experience. So to the extent that they can bring in additional services, we're going to see a rebundling or reimag…”
Wilkes reveals approximately 70% of the top 100 fintechs are Galileo clients
“Something like 70% of the top 100 fintechs are clients of ours.”
Wilkes claims Galileo powers 95% of North American digital banking transactions
“By a recent study, 95% of digital banking was occurring in the United States and North America was occurring on our platform.”
Wilkes: Galileo raised venture capital primarily to get press and analyst coverage
“When we did make a decision to raise, you know, we were profitable and had been profitable for quite some time. We had a large and scaling business, but it was hard to get analysts and press to pay attention to you or to consider you as an alternative. It's an…”