The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 9 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Sean Gourley: Wikipedia has a massive recall problem despite high precision
“And this is actually not just endemic to Andre, there's nothing particularly about him, but it's actually, Wikipedia has a massive recall problem. We think a lot about its precision, and we measure its precision, but its recall is actually pretty bad when it l…”
Mason: Wikipedia data secretly underpins almost every open machine learning API
“If you go back far enough in pretty much any sort of open API in machine learning, you can find Wikipedia in there somewhere.”
Bordes: Direct machine reading on Wikipedia currently lags IBM Watson
“So of course, in the end, right now, a system just based on Wikipedia is much worse than what can be done by Watson, using all the databases.”
Bordes: FAIR expects single reasoning method to solve all QA cases
“We expect basically the same method to be able to solve all the cases, because we are looking for method that can do reasoning, whether it's a very simple situation on Wikipedia.”
Primer generated 40,000 new scientist profiles using RNNs and scientific papers
“So we took 30,000 scientists on Wikipedia and took their profiles as of January 18. And then input into this, we put 650,000 scientific papers and around 1.2 million news articles that talked about the scientists. And then we used an RNN-based generative model…”
FAIR shifted from children's book benchmarks to Wikipedia question answering
“And at the end of last year, we also released something that is the same kind of ideas using, like, ah, some short stories, but, ah, that we use from, like, children books, real children books, and now we are moved to a train to answer question, ah, directly f…”
AI cannot yet perform database-style reading and QA on unstructured Wikipedia text
“Nobody can answer on Wikipedia the way that you would answer with a database or anything like this, doing reading.”
Gourley: Google includes Wikipedia on page one for 85% of common searches
“Google actually returns Wikipedia 85% of the time with the most common searches on the first page.”
Gourley: Wikipedia had no page for Andrej Karpathy when Primer built his bio
“Well, we could actually compare that to what was on Wikipedia at the time when it was generated, and the answer was nothing. Right? Now, if you go there now, he's taking care of this. We brought it up with Tesla, and their PR department got onto this, but ther…”