GANs

“I think the scariest was when I went to visit CERN at some point, and they said they were using it, PyTorch, and they were using GANs at the same time for, like, particle physics research, and I was scared more about the fact that they were using GANs than the…”

“The reason why people don't use them is because they're hard to train and they're, they have, they're very, they have mode seeking behavior, meaning it's hard to get any diversity and hard to control them. But for these benchmarks, they do the best.”

“I'm pretty optimistic about a future where diffusion models Can become the dominant solution. I've seen it happen before with GANs a few years ago, so I wouldn't be surprised if that's the case also here.”