William Falcon, Founder and CEO of Lightning AI, discusses notable open-source AI projects built using the PyTorch Lightning framework.
Prediction Not checkable as stated
Falcon: Open-source AI will quickly catch up to proprietary models
“So I think all, all roads lead to open source at the end of the day. No matter what you do or how much money you have, you cannot compete with the world's resources put together to do something. So some companies will have an edge for a bit, yes, but open sour…”
Insight
Falcon: Scaling massive AI models compensates for gaps in scientific understanding
“I kind of think that the whole large scale model thing, It's really a gap in our scientific understanding of these models. Instead of looking at the math and coming up with a better loss function, we figured out that we could throw a compute at it, and get us …”
Prediction Not checkable as stated
Falcon: Mathematical advances will eventually make future AI models small
“I think the math field will catch up, and we'll have some fancy regularizer that will make all this go away, and now we're back to, like, a small model. So I guess, I think that the future is small, large language models, I guess, that are specialized”
Prediction Not checkable as stated
Falcon: There will not be a god-like AGI
“I don't think there's gonna be like a god AI roaming around.”
Disclosure
Falcon: Lightning AI will not offer hosted model APIs
“But no, we're not gonna be offering like services and APIs and all of that. And really that's so that we can have the same incentives as the open source community.”
Prediction Not checkable as stated
Falcon: Solving AI hallucination will take roughly five years
“So I think it's still going to be, I don't know, like five years, probably like, I don't think it's going to be like one day suddenly it's solved. I think it's going to unlock industries sequentially. So like, year one, maybe we can do this industry, and then …”