MENU

Fun & Interesting

What's new in Apache Airflow 2.7?

Data with Marc 4,873 2 years ago
Video Not Working? Fix It Now

What's new in Apache Airflow 2.7? 🏆 BECOME A PRO WITH AIRFLOW: https://www.udemy.com/course/the-complete-hands-on-course-to-master-apache-airflow/?couponCode=4677CF7EF58D6AAD9A0C Here are the big changes: ➡️ Initialize and delete resources tasks need at ease! 💻 With the setup and teardown tasks (clusters, compute resources, etc) ➡️ Monitor Airflow with the new Cluster Activity page! 💻 Track the most important metrics of your Airflow instance in one click ➡️ New Gantt view! 💻 To better spot task bottlenecks in your DAGs ➡️ New Code view! 💻 Easier to read code changes and verify they've been applied ➡️ New Running and Failed filters! 💻 Click on a button to only see DAG in running or failed states ➡️ New BranchExternalPythonOperator 💻 Choose between tasks while avoiding dependency conflicts ➡️ New cache when calling Variables and Connections 💻 Better optimize resources by reducing the number of calls to the DB ➡️ Limit the concurrency of deferred tasks with Pools 💻 Set include_deferred=True to a pool ➡️ New Graph View! 💻 Navigating your DAGs has never been easier ➡️ db init and db upgrade are deprecated 💻 Use db migrate to create or upgrade the database ➡️ The button for testing connections is disabled 💻 For security reasons. Enable it with AIRFLOW__CORE__TEST_CONNECTION="Enabled" And more! 🏆 BECOME A PRO: https://www.udemy.com/course/the-complete-hands-on-course-to-master-apache-airflow/?couponCode=BIGPROMO1 👍 Smash the like button to become an Airflow Super Hero! ❤️ Subscribe to my channel to become a master of Airflow 🚨 My Patreon: https://www.patreon.com/marclamberti Ready? Let's go!

Comment