The Exchanges

Every argument clarity score on this site is built from rows on this page. Each question and answer was assessed with names hidden, the host's own answers included, on four things from 1 to 5: directness (does it answer the question asked), coherence (do the ideas follow), precision (concrete details and clear references), compression (says a lot per word). The weighted mix (30/30/25/15) is the exchange score. A person's published score averages their exchange scores on raw tape only, at least 8 of them, shrunk toward the cohort mean. Full method →

Michael Karasick no published score: only 2 usable exchanges on raw tape, and a fair score needs 8+ record → ← everyone

Every exchange below was scored with names hidden, four dimensions each from 1 to 5. An exchange's score is 0.30·directness + 0.30·coherence + 0.25·precision + 0.15·compression. The published score averages the raw tape exchange scores and shrinks small samples toward the cohort mean, so five great answers can't beat twenty good ones. Produced feed rows count only toward coarse estimates, never toward a full score.

clear all ✕
2exchanges match
2on raw tape
0redirected or not addressed
Answered raw tape D 5 · C 4 · P 4 · Cm 4 4.30

Q tell it, but, ah, it was, it was, you know, kind of, kind of striking, but at the time it felt like Watson was this, ah, you know, very powerful, but super early stage, ah, ah, you know, capability with a very large hardware component, I think, that took the whole room and all the things, and so what was it then, and what has, what has it become now?

A Alright, so, ah, Uh, so there's, uh, you know, 40 or 50 years of research and development behind it, obviously. And what was interesting about Watson is it was, uh, uh, both a really impressive piece of engineering leveraging a bunch of, uh, uh, NLP and machine learning techniques. Um, so some amazing engineering in terms of, uh, uh, reasoning capability, scoring, and, uh, and kind of manic devotion by a team that was, you know, shut in a room. For about their choice, not ours, for about four years. Basically, they had a graph where they looked at the, the horizontal axis was a percentage of questions answered. Sorry, that's the horizontal axis. The vertical axis was a percent got right. And really the, the higher the ratio, the better you were. We knew where the experts were. So it was a question of when would we get there. We knew we would get there eventually. We didn't quite know whether we would get there soon enough to win on, when we paid, played back in 2011. Um, and you know, there was a couple of oopsies during the, uh, the match, which is normal. Um, so we knew we would win eventually. Um, so it began as a very specific piece of technology to do open domain question and answering. And it's evolved in a, in a number of ways. So we've generalized the linguistic pipelines in Watson to deal with other kinds of question and answer. So the original one was a, you know, a h…

AI assessment note: “It began as a very specific piece of technology... And it's evolved in a number of ways.”

Answered raw tape D 4 · C 3 · P 4 · Cm 3 3.55

Q And it's, so it's a Q&A metaphor, right?

A One of them. So, the one we call, um, um, one of the advi- so there's a class of things we call, ah, advisors. Ah, engagement advisor is a question and answer metaphor. Ah, discovery is a, ah, cognitive Uh, knowledge-based, uh, graph search. So the idea being to help, uh, subject matter experts, uh, discover new relationships amongst, you know, several million documents, that kind of thing. Um, the Chef Watson, as we call it, is also discovery-based. Uh, we have, uh, one that does decision support. The first people to call us after the Watson game, we expected the standard, I should say, really, really interesting IBM Customers, financial houses, uh, didn't call us. In fact, uh, oncologists, cancer doctors did. They were interested in how Watson could help them, uh, diagnose patients, keep, uh, doctors information about, uh, therapies current, so, you know, we start up with the easy stuff, oncology. We got the recipes later. Um, so it's been an interesting journey.

AI assessment note: “engagement advisor is a question and answer metaphor”

page 1
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.