Mars: Compute-intensive ML algorithms drive 92% of Sirius execution workload
Jason Mars · Jason Mars · Jul 28, 2017 · at 11:23
Jason Mars, computer science professor and creator of Sirius, presents profiling research on computational bottlenecks in intelligent personal assistant infrastructure.
0:00 / 0:07exact quote · 7.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And so across the entire workload, 92% of the execution of series could be described by these compute-intensive algorithms.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Jason Mars
Mars: AI assistant infrastructures are monopolized by major tech companies
“These kinds of infrastructures are monopolized essentially by companies like Apple, Google, Microsoft, and so forth.”
Mars: Converting search to AI assistants requires 100x data center scaling
“If you moved all of the queries that were search queries and turn them into intelligent personal assistant queries, we would have to grow our data centers by two orders of magnitude.”
Mars: Apple requested Sirius AI project rename, resulting in Lucida
“After Sirius gained a good bit of traction, Apple reached out to us and said, you probably should change the name. And so we're now calling it Lucida.”
Mars: Porting Sirius to GPUs and FPGAs yields 10x speedup
“We can get significant speedups when we port these algorithms To GPU, when we leverage GPUs and FPGAs to build future servers, and what that means is we can bring that scalability gap down, and so we can get about 10 X back if we move by taking these, ah, by t…”
Mars: Tech giants are building future data centers around deep learning
“Deep learning is absolutely the bet that companies are making, right? So Google has put a lot of resources into deep learning you know, Facebook. We're designing future data centers and future infrastructures around this one technique, and it's primarily becau…”