What is Kafka?

Apache Kafka is a popular open source platform for streaming, storing, and processing high volumes of data. In this video, we break down how Kafka works and how it’s able to provide you with a reliable, scalable, and highly performant service for managing events. We also touch on some key resources for effectively monitoring your Kafka deployments via Datadog.

Chapters:
00:00- Introduction
00:37- Kafka Architecture
01:23- Kafka Reliability
04:08- Kafka Scalability
05:10- Kafka Performance
05:35- Monitoring Kafka in Production

Introducing Kafka-Kit: Tools for Scaling Kafka:
https://www.datadoghq.com/blog/engineering/introducing-kafka-kit-tools-for-scaling-kafka/
Lessons learned from running Kafka at Datadog:
https://www.datadoghq.com/blog/kafka-at-datadog/
Monitoring Kafka performance metrics:
https://www.datadoghq.com/blog/monitoring-kafka-performance-metrics/