The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 8 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Bosworth: Meta emptied its AI research pipeline to build Llama 3
“When we were pulling Llama three together, we had really pulled in all the research, all the every, we pulled out every single stop we had and unwittingly kind of killed the pipeline. So researchers, you know, the way that it works is you build a base And you'…”
Ahmad Al-Dahle: AI models degrade user experience by over-moralizing refusals
“Some of these models, for example tend to do a lot of moralization or like really take a perspective or a point of view. And we worked on and I'm continuing to work on and innovate on how, how the model responds and how it refuses, which I think is also part o…”
Meta releases 8-billion and 70-billion parameter Llama 3 models
“We are releasing an updated eight billion parameter model plus a seventy billion parameter model. And these are state of the art.”
Meta trained Llama 3 8B and 70B models on 15 trillion tokens
“So if you look at something like the eight billion and seventy billion,
They were trained on almost 15 trillion tokens and tokens roughly you can imagine as a word.
So roughly like 15 trillion words, which is an incredible outcome.”
Meta used 100x more compute to train Llama 3 than Llama 2
“So actually, I think it's I believe it's a hundred times more compute.”
Ahmad Al-Dahle: Llama 3's performance exactly matched Meta's scaling law predictions
“I don't think anything about the model has really personally surprised me in terms of its performance. I think we kind of expected to be here. You know, we do a lot of like rigorous scaling laws and rigorous prediction of what we think the metrics will look li…”