GET THE FULL COURSE at
https://www.sundog-education.com/get-spark-python
Sundog Education's Frank Kane gives an overview of what's new in Apache Spark 4.0, including the late-breaking features in Spark 3.5. We'll talk about:
Spark Connect
Expanded SQL functionality
The English SDK for Apache Spark
New debugging features
DeepSpeed Distributor
ANSI SQL mode
VARIANT data types
Collation support
Data source Python API's
... and more!