Fourier Neural Operators
topic on 1 show · 2 statements across 1 episodes
2 statements about Fourier Neural Operators, every show
Non-linearities enable neural operators to expressively capture limited frequency modes
“So that's one way of thinking because, you know, first of all, we are lifting the signal to more dimensions, even if the signal is two or three dimensions we are now lifting it to much higher dimension. So in that space, the idea is it's easier to learn and we…”
Fourier neural operators scale quasi-linearly, avoiding transformers' quadratic complexity
“If we were to use transformers and we require a very high resolution, it would become untenable because of the quadratic complexity and all to all connections. On the other hand, if you did that with Fourier transforms, we have like quasi linear complexity and…”