Assertion Not checkable as stated
Probabilistic inference can reduce data pipeline engineering effort by orders of magnitude
“In contrast, we can build a pipeline first, which may not be very high quality, and then use probabilistic inference as a way to say, where should we spend our effort next? And the reduction in effort can sometimes be orders of magnitude, as we've seen in some…”
Opinion
Classical models of sequential evaluation can be completely thrown away
“That is, why it's a new trade-off space and classical trade-off space don't sort of suffice, and to do that, I'm going to show you one result which just illustrates the classical models of sequential evaluation you can completely throw away.”
Assertion Supported
Relaxing hardware memory consistency yields up to 1000x speedups over competitors
“We've basically done a couple of parlor tricks, and those parlor tricks have allowed us to get, you know, 10, a hundred, a thousand times faster than competitor systems, because we're actually taking advantage of what the hardware is giving us.”
Assertion Not checkable as stated
Automated dark data pipelines can outperform human data extraction quality
“There are a number of systems that have shown that it's actually possible to build these ETL pipelines, these pipelines that extract, transform, and load information with higher quality than humans in some very simple settings.”
Insight
Traditional data pipelines over-extract and over-clean due to unmeasurable impact
“So in contrast, if you think about the way that people build these extraction and integration and cleaning systems, they tend to over-extract, over-integrate, and over-clean Because they have no idea if their cleaning or extraction is actually gonna prove the …”
Insight
Modern scientific literature is universally accessible but impossible for humans to read
“For even the narrowest of scientific questions, They couldn't possibly read all the information that was relevant to them, or even a significant fraction of it. So this is why I say that scientific knowledge is accessible in a way like never before, but it's n…”
Assertion Supported
Human volunteers achieved 84% accuracy on PaleoDB data extraction tasks
“When we assess this, we found that the PaleoDB volunteers were accurate about 84% of the time.”
Assertion Supported
PaleoDeepDive matches or exceeds human data extraction accuracy across all tasks
“In some predicates, it's basically a wash. There's information that humans and machines are equally good at. But we're never any worse, and in some cases, we're substantially better.”
Prediction Not checkable as stated
DeepDive human trafficking detection pilots are expanding to law enforcement agencies
“So, I'll skip over the details of the application, but I will say that it's actually in active use and we can actually get high precision values and we're in Extending, ah, pilots to more law enforcement agencies over the next couple months.”
Assertion Not checkable as stated
Hardware parallelism enables orders of magnitude speedups over competing systems
“SIMD parallelism, multicore parallelism, NUMA, those are all things we need to take advantage of to go, in some cases, orders of magnitude faster than competitor systems on these tasks.”
Assertion Not checkable as stated
DeepDive factor graphs can reach hundreds of terabytes in size
“In some of our applications right now, these factor graphs become hundreds of terabytes in size.”
Assertion Supported
Microsoft adopted Chris Ré's Hogwild algorithm for its Project Atom
“A while ago, last year, Microsoft released their Project Atom, and they had a great demo where they were showing they were releasing, you know, recognizing Shih Tzus with Windows phones. Using deep learning. And the reason I will love Microsoft forever is the …”
