Everything Jack Hanlon said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Data startups push horizontal platforms, but enterprise buyers want single features
“The companies I see, it feels like a number of the startups I see in the space get pressure to expand to be more horizontal solutions. And then frankly, like we want them for one thing, but not for the three other things that they want to do.”
Google, Facebook, Microsoft, and OpenAI used Reddit data for AI models
“Google, Facebook, Microsoft, and OpenAI all used Reddit's data to train their conversational AI models.”
Hanlon: AWS Redshift's core architecture has fallen behind competitors
“Redshift feels way behind, whereas a number of years ago, it was fantastic. The core architecture there has not kept up.”
Hanlon: Reddit ingested 55-60B daily events managed by one person in 2019
“I came in, we were doing probably about 55 or sixty billion events a day into a data warehouse that one person was managing.”
Reddit's 2021 home feed will include recommendations beyond user subscriptions
“You'll see this year that the home feed and people's home feed will be breaking the subscription wall and having recommendations in there for people.”
Hanlon: Reddit grew from around 600 to 800 employees in 14 months
“When I got to Reddit overall, I'd say Reddit was maybe 600 people 14 months ago. Right now, oh, maybe 800.”
Hanlon: Reddit's data team will probably reach ~120 people by end of 2021
“By the end of the year, the data organization I just described will be probably the third largest organization at Reddit with a 120 or so people.”
Reddit runs production on AWS and analytics/ML on GCP
“From the top view, I'd say we're AWS prod with originally a lot of Postgres For a variety of prod systems, we actually transit almost all that stuff over to GCP, and we use TensorFlow and BigQuery for our analytics and our model concerns”
Reddit isolates malformed data events in an automated penalty box
“You can do stuff for event validation to say, ah, events that don't match certain things get dropped and sort of get put in the penalty box, which we've done and said, okay, developers, you can't actually join these to anything. You can't actually use them if …”
Reddit is leaning heavily into becoming a Kafka shop for streaming
“So, you know, I think we're ending up leaning heavily into being a Kafka shop, building more of the stuff into base plate, into more of these core services”
Jack Hanlon: 2020 was the first year every Reddit surface implemented personalization
“Last year was the first year that every Reddit surface saw personalization.”
Hanlon: Reddit uses a hub-and-spoke model for data science
“Data science is hub and spoke. So so effectively that is all of those folks report into the director of data science, who's, who's one of my team members and, but they actually, when we're in a, when we're in an office setting, they sit with the downstream tea…”
the MAD Podcast 1