academia

“Places like Google and Meta, OpenAI, we will be working on things, like, Three years ahead of everybody else, and then suddenly, like, then Academia would be, like, still working on, like, these task-specific things.”

“And I think in general, what people do in academia that I think is not good is they choose a very simple task, like Alford, and then they apply overly complex methods and to show the improved two percent I think like you should probably match, you know, the le…”

“I mean, I do think that like the best source of evals going forward is probably going to be academia.”

“There was like kind of two years where everyone in academia was working on like smaller models and none of it really mattered.”

“Like five or 10 years ago, you really could train state-of-the-art models in the lab even with just a couple of GPUs. But, you know, because that technology was so successful and scaled up so much, then you can't train state-of-the-art models with a couple of …”

“One of the pitfalls of academia is that it doesn't really reward, like, simple ideas that work, and instead kind of tends to reward, like, kind of mathier ideas. Those mathier ideas also give you these, like, kind of implicit knobs to tune that allow you to, l…”

“AI over science is just, I think, A, difficult to do in academia, and B, so exciting, but I think you can take bigger bets, and I think having a tenured position and writing research grants is maybe not the biggest bet you can take on, on a field.”

“Academia has a lot going for it. Access to scaled compute is not one of the things that it has going for it, or scaled resources.”

“I still deeply believe that academic is the main source of innovation for the whole field, and particularly when it comes to biotech.”

“These innovations take so long and the discovery process can be so accidental, right, that It's perhaps not ideal for pure industry to take on, but once they show early promise, scaling them, and robustifying them, and generating data that's not only massive, …”