The headless data architecture. Is it a fad? Some marketecture? Or something real? In this video, Adam Bellemare takes you through the basics of the headless data architecture and why it’s beginning to emerge as its own respective pattern.
Driven by the decoupling of data computation from storage, the headless data architecture provides the basis for a modular data ecosystem. Stream your data for near real-time low latency use cases, or convert it to an Iceberg table for analytical use cases.
The headless data architecture lets you plug your choice of processor into the stream/table data layer, using whichever format that works best for you. Compose your applications, services, data warehouses/lakes using the modular data layer—no more copying data, building pipelines, or dealing with chronic break-fix work.
RELATED RESOURCES
► Apache Iceberg - https://iceberg.apache.org/
► Tableflow - https://cnfl.io/3VKq7hr
► Data quality restrictions and checks for enforcing data contracts - https://cnfl.io/3xnXk9i
► Connecting data into your headless data architecture with Kafka Connect - https://cnfl.io/4cqPvOK
CHAPTERS
00:00 - Intro
00:42 - Kafka for Streams
01:13 - Iceberg for Tables
03:26 - Plugging in Heads
04:55 - Benefits of HDA
06:45 - Difference between HDA and Data Lake
08:34 - Tableflow for Streams-to-Tables
09:52 - Summary
--
ABOUT CONFLUENT
Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.
#streamprocessing #apachekafka #kafka #confluent