In this video we see how to compare and validate schemas using PySpark. We also see how to perform schema evolution and merge schemas in PySpark.
You can find the Databricks Notebooks here:
https://github.com/apostolos1927/Schema-Comparison-Validation
Follow me on social media:
LinkedIn: www.linkedin.com/in/apostolos-athanasiou-9a0baa119
GitHub: https://github.com/apostolos1927/
00:00 - Intro
01:05 - Schema Comparison & Validation & Evolution