Fourier Neural Operators

2 statements across 1 episodes · 2 bullish · 0 bearish · 1 people on the record · first statement Aug 26, 2026 by Anima Anandkumar · across every show →

Everything said about Fourier Neural Operators, oldest first

Aug 26, 2026 positive
Insight
Fourier neural operators scale quasi-linearly, avoiding transformers' quadratic complexity
“If we were to use transformers and we require a very high resolution, it would become untenable because of the quadratic complexity and all to all connections. On the other hand, if you did that with Fourier transforms, we have like quasi linear complexity and…”
Anima Anandkumar Aug 26, 2026 ▶ 21:51 🔬 Why Transformers Hit a Wall the Moment Physics Shows Up — Anima Anandkumar, Caltech
Aug 26, 2026 positive
Insight
Non-linearities enable neural operators to expressively capture limited frequency modes
“So that's one way of thinking because, you know, first of all, we are lifting the signal to more dimensions, even if the signal is two or three dimensions we are now lifting it to much higher dimension. So in that space, the idea is it's easier to learn and we…”
Anima Anandkumar Aug 26, 2026 ▶ 26:08 🔬 Why Transformers Hit a Wall the Moment Physics Shows Up — Anima Anandkumar, Caltech
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.