The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 5 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Small, funded teams are more effective than broad open-source AI consortiums
“Maybe it sounds wrong, but I feel like banding together is not necessarily good by default. There's a lot of different incentives. There's so much noise that no one knows where to focus. I prefer, if anything, I would prefer siloed focused teams who have fundi…”
Mohan: Codeium scraped public code because The Pile was too small
“We ended up basically using a lot of open, I guess, permissively licensed code in the public internet, mainly because I think also the pile is, is fairly a small subset. I think maybe after we started, there was the stock that was also came to be, but for us, …”
Bo Peng Created RWKV on EleutherAI Forum to Parallelize RNNs
“Blink, or Bopeng is the actual name decided basically as an individual, literally at the illiterate AI forum, decided that, hey I think we can modify recurrent neural networks, no, neural networks, based on the Apple paper, the light attention that I showed pr…”
EleutherAI and Stability AI Donated A100 Compute to Train RWKV
“So, so that's why AI and the rest stability, I believe also is involved, stepped up. And donated the A-One-Hundreds needed to train the basic models that RWKB had.”
GPT-NeoX Documentation Became Reference Notes for Subsequent Open-Source LLMs
“GPT Neo X was that it was one of the major models that had everything fully documented and they like, why they make this change in the architecture and so on and so forth. And that became like Basically reference notes for all other subsequent open source mode…”