Hey data engineers!
Did you know that time management is crucial in streaming solutions? Have you ever faced the challenge of dealing with events that arrive out of order or with significant latency?
And how can you be sure your solution is performing optimally? It’s better to address these issues proactively before they impact your users.
Join me in the 51st episode of my free DP-203 course, where I dive into these important topics.
Enjoy!
▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬
My LinkedIn profile: https://www.linkedin.com/in/piotr-tybulewicz-81a8793/
GitHub with my drawings: https://github.com/TybulOnAzure/DP-203
Event ordering overview: https://learn.microsoft.com/en-us/azure/stream-analytics/event-ordering
Time management overview: https://learn.microsoft.com/en-us/stream-analytics-query/time-management-azure-stream-analytics
▬▬▬▬▬▬ MEMBERSHIP ▬▬▬▬▬▬
Join this channel to get access to perks:
https://www.youtube.com/channel/UCLnXq-Fr-6rAsCitq9nYiGg/join
▬▬▬▬▬▬ CHAPTERS ▬▬▬▬▬▬
00:00 Introduction
00:44 Time in streaming
03:44 Issues with time
17:35 Late arrival policy
26:45 Out-of-order policy
29:31 Performance
33:24 Embarassingly parallel jobs
47:06 Visual editor
48:45 Summary