Lotan: Network graph analysis effectively isolates spam and off-topic data
Gilad Lotan · Gilad Lotan, Betaworks // Data Driven NYC 20 // Nov 2013 · Dec 5, 2013 · at 12:23
Gilad Lotan, Chief Data Scientist at Betaworks, explains how network visualization helps distinguish non-relevant user communities like snake breeders from software developers.
0:00 / 0:14exact quote · 14.5s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And it's actually also a great way to get rid of spam, things that aren't related not that I think that Python snakes are spammy, because they're pretty awesome, but it's a way to sort of, to identify them as separate from the context that we're trying to understand.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Gilad Lotan
Lotan: Betaworks was an early investor in Tumblr and Kickstarter
“So we were one of the earliest investors in Tumblr and Kickstarter, and a whole bunch of, ah, companies across, ah, the tech scene in New York City.”
Lotan: TweetDeck was built at Betaworks and sold to Twitter
“TweetDeck was actually built at Betaworks and then sold to Twitter.”
Lotan: Gephi is ideal for quick exploratory graph analysis
“It's a great tool to pull in graphs and do some exploratory data analysis, so the section where you're sort of trying to explore a data set, you don't want to put too much effort into it and build something for it, you can just easily use this open source tool…”
Early Giphy tags were manually labeled by humans for cleaner data
“They're manually labeled, so we're getting these labels from, ah, actual humans, ah, so they're really, really clean and great data.”
Giphy's top tag clusters in 2013 were funny content, art, and movies
“We get three dominant sort of clusters in this data, and it's, I don't think it's surprising There's the lol, right, lots of just funny, funny stuff. There's, like, kind of pretty, beautiful content, like photography, just artistic stuff, and then lots of movi…”
Lotan: Giphy GIFs tagged 'funny' feature laughing people, while 'LOL' features animals
“Content that has the tag funny usually consists of sort of people laughing here, like funny in terms of funny, they're, you know, you see their face and you see them laughing. LOL tended to have, for some weird reason, have animals doing weird stuff. Or young …”