Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon events in Hong Kong, China (June 10-11); Tokyo, Japan (June 16-17); Hyderabad, India (August 6-7); Atlanta, US (November 10-13). Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at https://kubecon.io
From Chaos To Clarity: Scaling Observability at Dropbox With Centralized Logging Solution - Alok Ranjan, Dropbox Inc
At Dropbox, managing observability for systems producing terabytes of logs daily posed a unique challenge. Initially, developers accessed logs by logging into individual servers, a process further complicated when we moved to containers. Containers are short-lived, which caused logs to disappear on termination. This highlighted the need for a scalable, persisted, centralized solution using open-source tools.
In this session, I’ll discuss our journey to build a robust observability framework centered on Loki as our logging solution. Scaling Loki to Dropbox’s data volume required extensive optimizations for reliable, efficient query performance. I’ll cover our deployment, challenges, and strategies for achieving high-performance logging.
We also integrated Grafana to unify logs and metrics in a single view, enhancing troubleshooting and security. Join us to learn how Dropbox scaled its observability with open-source solutions and key lessons from our experience.