More Info: https://cnfl.io/4lwZQOG | In this video, Tim Berglund jumps behind the white board to explain Freight Clusters—a feature in Confluent Cloud designed to handle high-throughput, relaxed latency workloads (ex: logging data, telemetry data, and feeding data lakes).
If you’ve been struggling with the complexities and costs of managing your own Apache Kafka® clusters for these workloads, Freight Clusters might just be the answer you’ve been looking for.
Freight Clusters are designed to be cost-effective, offering significant savings over self-managed Kafka clusters while maintaining the performance and scalability you need for high-volume data movement. Tim walks you through how these clusters work, why they’re optimized for cloud environments, and how Kora (Confluent’s Kafka engine) powers the underlying infrastructure that makes them possible.
By the end of the video, you’ll understand:
- What Freight Clusters are and how they differ from traditional Kafka deployments.
- Why they’re a great fit for relaxed latency, high-throughput workloads.
- How you can save on costs while still getting the benefits of a fully managed Kafka solution.
- If you’re looking to simplify your Kafka infrastructure, reduce costs, and scale your high-volume workloads without all the overhead of managing clusters yourself, this one’s for you.
RELATED RESOURCES:
► Introducing Freight Clusters Blog Post: https://cnfl.io/3RO8hY5
► Freight Clusters GA Blog Post: https://cnfl.io/3Y16PoR
► Virtual Consensus in Delos Paper: https://www.usenix.org/conference/osdi20/presentation/balakrishnan
► Log-Structured Protocols in Delos Paper: https://maheshba.bitbucket.io/papers/delos-sosp2021.pdf
► Freight Clusters Documentation: https://cnfl.io/42AljxD
► Try Confluent Cloud for Free: https://cnfl.io/3Ea6ucW Discount code: CONFLUENTDEV1
CHAPTERS
00:00 - Introduction to Freight Clusters
00:57 - The Birth of Kafka
03:08 - Blob Storage as a Repository
03:47 - The Continuum of Storage Options
05:47 - How Kora Simplifies Freight Cluster Management
10:24 - The Inner Workings Behind the Innovation
12:40 - Storage, Compute, Metadata, Background: The Layers of Kora
13:10 - Benefits of a Truly Cloud-Native Architecture
13:30 - Next Steps: Create Your Own Freight Clusters in Confluent Cloud
–
CONNECT
Subscribe, if you dare: https://www.youtube.com/@ConfluentDeveloper?sub_confirmation=1
Community Slack: https://confluentcommunity.slack.com
X: https://x.com/confluentinc
Linkedin: https://www.linkedin.com/company/confluent
GitHub: https://github.com/confluentinc
Site: https://developer.confluent.io
ABOUT CONFLUENT DEVELOPER
Confluent Developer provides comprehensive resources for developers looking to learn about Apache Kafka®, Apache Flink®, Confluent Cloud, Confluent Platform, and any other technology related to the broader Data Streaming Platform. Content on Confluent Developer includes courses, getting started guides, topical deep-dives, patterns, tutorials, and listings of community events. Learn more at https://developer.confluent.io.
#freightclusters #Kora #apachekafka #kafka #confluent