Hot on the heels of last week's Spark & AI Summit announcement, Simon is digging into the new features of Spark 3.0. In this episode, we're looking at Dynamic Partition Pruning, which should dramatically speed up queries over partitioned data!
Not sure about partitioning? Don't know why you should care? Watch now!
Don't forget to like & subscribe for more sparky goodness, and check out the Advancing Analytics blog for more content! https://www.advancinganalytics.co.uk/blog