MENU

Fun & Interesting

Building a Lakehouse Architecture with Azure Databricks with Christopher Chalcraft

Iteration Insights 16,474 lượt xem 4 years ago
Video Not Working? Fix It Now

Join Christopher Chalcraft as he discusses building a lakehouse in Azure Databricks.

Today's companies are dealing with data of many different types, in many different sizes, and coming in at varying frequencies.  These companies are looking beyond the limitations of traditional data architectures to enable cloud-scale analytics, data science, and machine learning on all of this data.  One architecture pattern that addresses many of the challenges of traditional data architectures is the lakehouse architecture.
 
Lakehouse combines the low cost and flexibility of data lakes with the reliability and performance of data warehouses.  The lakehouse architecture provides several key features including:

- Reliable, scalable, and low-cost storage in an open format
- ETL and stream processing with ACID transactions
- Metadata, versioning, caching, and indexing to ensure manageability and performance when querying
- SQL APIs for BI and reporting along with declarative DataFrame APIs for data science and machine learning

This video was recorded during the Calgary Azure Analytics User Group on Feb 23, 2021.

Join the Calgary Azure Analytics User Group LinkedIn Group and never miss a meeting!
http://bit.ly/CalgaryAzureUG

Christopher Chalcraft Social Profiles
LinkedIn: https://ca.linkedin.com/in/cchalc
Twitter: https://twitter.com/cchalc
----------------------------------------------------

Follow Iteration Insights!
LinkedIn: https://www.linkedin.com/company/iter...
Twitter: https://twitter.com/iterinsights
Facebook: https://www.facebook.com/iterationins...
Instagram: https://www.instagram.com/iterationin...
https://www.iterationinsights.com

Music: https://www.bensound.com

Comment