Apache Airflow has become a popular open-source platform for managing and orchestrating data pipelines. However, as with any technology, there are good and bad ways to use it. This talk will explore the bad and best practices when deploying Apache Airflow in a production environment. From common pitfalls, such as misconfigured tasks and lack of scalability, to best practices, such as robust monitoring and proper security measures, this talk will provide practical advice for anyone looking to implement Apache Airflow in their production environment.
Speaker: Bhavani Ravi
More: https://2023.berlinbuzzwords.de/sessions/?id=TDWCGF
Web: https://2023.berlinbuzzwords.de/
Fediverse: https://floss.social/@berlinbuzzwords
Linkedin: https://www.linkedin.com/showcase/13978964/
Twitter: https://twitter.com/berlinbuzzwords