Yi Tay

19 statements across 2 episodes · 9 bullish · 2 bearish · 1 people on the record · first statement Jul 5, 2024 by Yi Tay · said 6 times in 4 episodes since 2024 · across every show →

On the record as a speaker too: Yi Tay's record, appearances and statements → this page counts the times other people say the name.

Mentions by year

brought up most by Shawn Wang (3), Swix (Shawn) (2)

tap a year for its mentions
002132202420252026episodesmentions
012202420252026episodes it came up in
000.811.52202420252026episodesmentions per episode
2026 3 mentions in 2 episodes 2 per episode
2024 3 mentions in 2 episodes 2 per episode

every mention, scene by scene, with the transcript →

Everything said about Yi Tay, oldest first

Jul 5, 2024
Disclosure
Tay discloses he does not know how to write CUDA kernels
“Should I know CUDA kernels? I don't know CUDA kernels.”
Yi Tay Jul 5, 2024 ▶ 39:56 The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
Jul 5, 2024 positive
Assertion Contradicted
Tay: Most first-author papers by Jason Wei reach 1,000 annual citations
“Like, every single, so every single first author paper that, that, like, Jason writes in the last, has like, 1000 citations in one year. Like, no, I mean, not every, but like, most of it that he leads.”
Yi Tay Jul 5, 2024 ▶ 30:34 The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
Jul 5, 2024 negative
Opinion
Tay: Academic best paper awards at AI conferences are completely meaningless
“Does best paper awards, like, mean anything? Actually, it doesn't mean anything, right, like, but like, I think that was more of, like, my, Like, where my angst was coming from, right?”
Yi Tay Jul 5, 2024 ▶ 22:03 The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
Jul 5, 2024 neutral
Insight
Yi Tay: Governments cannot artificially manufacture top AI talent ecosystems
“I don't think there's actually much, like, the government can do to, like, influence, like, this kind of thing is, like, a natural, like, organic, natural thing, right? The worst thing to do is probably, like, to create, like, create a lot of artificial things…”
Yi Tay Jul 5, 2024 ▶ 2:15:35 The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
Jul 5, 2024 positive
Insight
Yi Tay: AI researchers should draft papers and titles before running experiments
“I usually start writing the thing while working on that thing itself. Like, so, even, like, let's say, like, if you want to launch something, like, then the end goal is, like, a blog post, or shipping something, everything, right? I like, or not really a launc…”
Yi Tay Jul 5, 2024 ▶ 2:06:22 The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
Jul 5, 2024 negative
Opinion
Tay: Singapore AI research prioritizes paper counts over real-world impact
“I think, to be honest, the research here is, like, in Singapore is just basically, like, they just care about publishing papers and stuff like that and then it's not, like, impact-driven. I think, at U.S., it's mostly focused on impact-driven, and the thing ne…”
Yi Tay Jul 5, 2024 ▶ 2:11:38 The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
Jul 5, 2024 neutral
Assertion Not checkable as stated
Yi Tay: Jason Wei originated the Emergent Abilities paper thesis
“That was mostly Jason's thesis, and I have to really say that, like Jason has really good ideas, and I was more of, like, a support role for that paper, yeah.”
Yi Tay Jul 5, 2024 ▶ 20:05 The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
Jan 23, 2026 positive
Insight
Yi Tay: The 'Bitter Lesson' Is Overapplied; Architectural Ideas Fundamentally Matter
“The bitter lesson gets used too much in, like, too conveniently used around, but actually there's also a little bit of a, not a bit, there's also a sweet lesson where it's like, ideas matter.”
Yi Tay Jan 23, 2026 ▶ 52:19 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Jan 23, 2026 bullish
Opinion
Yi Tay: AI Research Has Not Entered Diminishing Returns on Ideas
“The number of ideas that actually work is not decreasing compared to the last, like, we're not in the era of diminishing returns yet.”
Yi Tay Jan 23, 2026 ▶ 52:53 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Jan 23, 2026 bullish
What-if
Tay: Present AI Milestones Would Have Been Viewed as AGI Five Years Ago
“If you just look at the AI progress now and five years ago, I think people would think that we already reached like AGI.”
Yi Tay Jan 23, 2026 ▶ 24:53 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Jan 23, 2026 neutral
Disclosure
DeepMind Singapore Explicitly Adds AGI to Job Postings
“I think that, like, one reason why we work on these models is that we want to get to AGI, and, like, this was a right thing that we added AGI to the job posting, yeah. There is no, like, formal name of the team yet, but it's basically the Gemini theme Singapor…”
Yi Tay Jan 23, 2026 ▶ 1:10 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Jan 23, 2026 bullish
Prediction Not checkable as stated
Tay: Most specialized tools will be subsumed directly into model parameters
“Then the most I can see in the future is there'll be a model then that, that is, there's something that really cannot be subsumed by a model. Then you just use a tool or something, right? But my prediction is that I think most things can be subsumed by the mod…”
Yi Tay Jan 23, 2026 ▶ 19:31 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Jan 23, 2026 neutral
Opinion
Yi Tay: The AI Industry Is Stuck in a Transformer Local Minimum
“So now we are like in this local minima of like transformers, everything, everything, right? Maybe it's not easy to like get totally out Of this, because also a lot of people's investment optimization have been done. So the things that play well needs to play …”
Yi Tay Jan 23, 2026 ▶ 50:43 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Jan 23, 2026 neutral
Disclosure
Yi Tay: Four captains across three locations trained DeepMind's IMO model
“So I think there were four captains for the IMO, two from London. Jonathan was from Mountain View. I was from Singapore. So I think four of us basically trained this model together.”
Yi Tay Jan 23, 2026 ▶ 22:08 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Jan 23, 2026
Insight
Yi Tay: Gradient descent learning paradigm is AI's bottleneck, not architecture
“It's not architecture itself. That's, that there's a problem that we, that is more of like the learning paradigm itself rather than the architecture itself. I think the architecture is just basically like the interface between the learning algorithm and the to…”
Yi Tay Jan 23, 2026 ▶ 49:07 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Jan 23, 2026 positive
Disclosure
Yi Tay Fixes ML Bugs Automatically Using AI Without Reading Error Traces
“I think AI coding has started to become the point where I run a job, I get a bug. I almost don't look at the bug. I paste it into, like, anti-gravity, and, like, I throw it, that will fix the bug for me. And then I relaunched the job. And, like, beyond, like, …”
Yi Tay Jan 23, 2026 ▶ 37:29 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Jan 23, 2026 bullish
Opinion
Yi Tay: Gap Between Closed AI Labs and Open-Source Is Increasing
“I think the gap is definitely increasing.”
Yi Tay Jan 23, 2026 ▶ 53:49 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Jan 23, 2026
Disclosure
Yi Tay: I had almost no RL background before returning to DeepMind
“I spent a lot of my past life, I call it the past art, working on like architectures and pre-training, but I think now I more, I have like transitioned more into RL. I'm not like old school RL, but the games RL and the old school RL, and to be honest, I had al…”
Yi Tay Jan 23, 2026 ▶ 3:30 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Jan 23, 2026 positive
Opinion
Yi Tay: Top Southeast Asian AI talent requires prominent leadership to unlock
“I feel like the talent we can get from the region is really, really good, but it's only It's only because it's us, we can unlock this talent. Otherwise, might join some other place.”
Yi Tay Jan 23, 2026 ▶ 1:23:10 Captaining IMO Gold, Deep Think, On-Policy RL, Feeling the AGI in Singapore — Yi Tay
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.