Spark SQL, every mention
3 scenes (2021) · ← back to Spark SQL
tap a year for its mentions
every year 2021 anyone Dave Burgess 3M.C. Srivas 1Justin Borgman 1Julien Le Dem 1Haoyuan Li 1
Verbatim, from the transcripts: the passages where Spark SQL comes up
Fireside Chat: Dave Burgess (Head of Data Engineering, Pinterest) w/ Matt Turck (Partner, FirstMark)
- ▶ 8:16 Dave Burgess Uh, we have a query platform, which is Presto and Spark SQL. 2 times in the scene
- ▶ 31:08 Dave Burgess They usually either Spark or Hive or Presto jobs or Spark SQL and, uh, just process the data in every step and, and persist the data back to S three along the way.
Data Observability and Pipelines: OpenLineage and Marquez
- ▶ 25:28 Julien Le Dem Spark, uh, built Spark SQL on top of Parquet, uh, Drill, uh, same thing used Parquet initially, um, you had Hive, Impala,