The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 15 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Falcon: Open-source AI will quickly catch up to proprietary models
“So I think all, all roads lead to open source at the end of the day. No matter what you do or how much money you have, you cannot compete with the world's resources put together to do something. So some companies will have an edge for a bit, yes, but open sour…”
Falcon: Scaling massive AI models compensates for gaps in scientific understanding
“I kind of think that the whole large scale model thing, It's really a gap in our scientific understanding of these models. Instead of looking at the math and coming up with a better loss function, we figured out that we could throw a compute at it, and get us …”
Falcon: Mathematical advances will eventually make future AI models small
“I think the math field will catch up, and we'll have some fancy regularizer that will make all this go away, and now we're back to, like, a small model. So I guess, I think that the future is small, large language models, I guess, that are specialized”
Falcon: There will not be a god-like AGI
“I don't think there's gonna be like a god AI roaming around.”
Falcon: Lightning AI will not offer hosted model APIs
“But no, we're not gonna be offering like services and APIs and all of that. And really that's so that we can have the same incentives as the open source community.”
Falcon: Solving AI hallucination will take roughly five years
“So I think it's still going to be, I don't know, like five years, probably like, I don't think it's going to be like one day suddenly it's solved. I think it's going to unlock industries sequentially. So like, year one, maybe we can do this industry, and then …”
Falcon: Lightning AI rebuilt Meta's LLaMA from scratch under Apache 2.0
“So we took the Lama, like, paper and implemented from scratch completely in Apache two, and we open sourced it. So it's fully, fully usable for enterprises, but we also gave you the training code, not just inference, and we also gave you fine tuning methods as…”
Falcon: Probably only 1% of emerging generative AI tools will endure
“I think it's a lot of research. Like, what's gonna last from there? I'm not sure. Like, probably one percent of the things.”
Falcon: Stability AI trained Stable Diffusion using PyTorch Lightning
“Who's heard of stability, AI, and stable diffusion? That was trained using Lightning, right?”
Falcon: Nvidia NeMo services are powered by PyTorch Lightning
“NVIDIA just announced all these Nemo services. Those are all powered by Lightning.”
Falcon: Avoid full enterprise LLM deployment without human-in-the-loop
“So I wouldn't go all in on this unless you can have like a human in the loop who's like helping.”
Falcon: Modern generative AI would not exist without open-source research
“None of this wouldn't exist if Google hadn't put published transformers and put the paper out there, right? None of this would have existed if Ah, the attention stuff would have been out there if the Anno hadn't been created, if TensorFlow hadn't been created.”
Falcon: PyTorch Lightning's original tooling was insufficient for post-GPT-3 architectures
“The tool that we had was good for 2016 through 20 19 deep learning, but as of GPT three deep learning, it wasn't good enough, and so we had to upgrade to this kind of new paradigm that we introduced.”