How to Build and schedule Machine Learning Pipeline using Airflow | #mlops #airflow #ashutosh_mlops

How to Build and schedule Machine Learning Pipeline using Airflow. In this video you will learn all the steps needed to create an ml pipeline using apache airflow and how to schedule the same. Topics covered: 1. Define Functions starting from data cleaning till model training. 2. Initialize Airflow DAG 3. Bind python functions as task to the DAG 4. Define task sequence in which they need to execute. 5. Modify docker-compose.yaml file to install ML specific libraries. 6. Create Docker File 7. Create Requirements.txt file with ML dependencies 8. Initialize airflow and visualize the pipeline and output #airflow #mlops #mlpipeline #ml