Bloomberg can automatically generate news articles without humans in two minutes
Amanda Stent · Text Analytics for Finance // Amanda Stent, Bloomberg (FirstMark's Data Driven) · Mar 2, 2018 · at 8:29
Amanda Stent, NLP researcher at Bloomberg, details Bloomberg's automated news generation pipeline at a Data Driven NYC event.
0:00 / 0:08exact quote · 8.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And this kind of article we can now automatically generate. So you can get this with no human intervention within two minutes, and then within five minutes a human journalist can come along in art color.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Amanda Stent
Stent: No generic text analytics platform can handle financial language
“There is no on the market generic text analytics platform that can handle this type of language. No way.”
Generic NLP mistakenly linked Bill O'Reilly news to O'Reilly Auto Parts
“Okay, so Bill O'Reilly said something, and there's a small and innocent company called O'Reilly Auto Parts somewhere in the Midwest, and a bunch of generic text analytics engines linked Bill O'Reilly to O'Reilly Auto Parts, and the O'Reilly Auto Parts stock dr…”
Bloomberg filters social media manipulation using account metadata and supply chain data
“We do a lot of historical monitoring, so we can know how old a social media account is. We also have a very, very large collection of pieces of information about entities in the world, so we can know how closely associated a particular handle is. With a decisi…”
Stent: Bloomberg shifted data labeling to deep learning and decision trees
“And that's something that historically has been done mostly with rule-based systems, but today we do it with deep learning and a lot of decision trees.”