The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 13 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
LLM hallucination is a core generative feature, not a bug
“And so finding the way of harnessing that as a feature rather than a bug, I think is going to be challenging, especially when one of the perceived shortcomings of your product is actually going to be, is like the core of what makes it function. I don't know th…”
LLM logic problems are best solved by having models implicitly execute code
“The way that you start solving math and some logic-oriented problems is under the hood implicitly ask the model to write and execute code.”
Google Bard aims to eliminate unintended hallucinations, not all hallucinations
“And our approach to it is, we're not, quote unquote, solving hallucination. We're solving Unintended hallucination, which would be something like, what's the distance between point A and point B? Or what's one plus one? Like, that should always be two.”
LLMs are creative idea expanders, not Q&A engines
“And as we were experimenting with the technology, it became clear this isn't a simple question and answer oriented technology. It really is a way to help ideas come to life, to really help exploratory ideas manifest. It takes your imagination and expands it in…”
Embedding LLMs in existing products constrains open-ended user behavior
“The challenge when you put a language model into an existing product is there's going to be a natural constraint of that. If all of a sudden I'm in Google Docs, and I want to ask for vacation ideas that I want to explore, or I'm trying to figure out what are s…”
Asking 'why not today' forces prioritization without creating interpersonal conflict
“And early on, we started saying things like, why tomorrow, why not today? Because what that ends up forcing isn't this, like, uncomfortable clash of, like, how dare you make it make something I'm asking for not a priority. It's, hey, share your priorities. Lik…”
Polishing AI products internally lets the fast-moving market pass you by
“If you spend all your time trying to build the world's greatest product, the world's gonna move past you.”
Evaluation suites have replaced traditional PRDs in AI product development
“You're, in language models, your eval is your prior product requirements document. It's a probabilistic based system, and so the way you construct what you will evaluate it against effectively dictates what the product is that's going to be built.”
A lack of clear value, not awareness, limits global LLM adoption
“Three quarters of the world still does not use this technology. It's not an awareness problem. It's a finding the right value to get them to use the technology.”
Many users prefer delayed, complete AI responses because it signals thoughtfulness
“A not insignificant amount of people will tell you, I actually just like that it gives me the whole answer when it's ready. Like, it makes me think that it, that it's thinking. That it's being thoughtful about the response that it provides.”
Candidates who suffered through slow shipping processes make the best AI hires
“And like, the people that have experienced Pain, in various regards, are the ones that have been by far the most successful.”