How to create kubeflow pipeline from scratch | Live Demo | Machine Learning | Ashutosh Tripathi
End to End Jupyter Notebook Explanation for Kubeflow pipeline building and executing
Topics Covered:
1. Python function needed to train and predict
2. Creating components from python functions
3. Initialise kubeflow pipeline
4. define the pipeline function and put together all the components
5. Mounting volume for component's output storage
6. Compiling pipeline and generating yaml - it can be directly uploaded to kubeflow and create experiments and runs using UI
7. Create run from pipeline function using the code
8. How to disable cache to see the each steps output on second and successive runs
Notebook link:
https://github.dev/TripathiAshutosh/shared-documents/blob/main/kf-pipeline.ipynb
Part 2: CSV file passing between kubeflow components: https://www.youtube.com/watch?v=xjcJPqZWIic
If you find this video helpful, don't forget to like share and subscribe. This is how you can support me.
Connect me:
LinkedIn: https://www.linkedin.com/in/ashutoshtripathiai/
Instagram: https://www.instagram.com/ashutoshtripathi_ai/
Twitter: https://twitter.com/ashutosh_ai
Website: https://ashutoshtripathi.com
If you want to message me directly, then connect me on LinkedIn and send a DM.
#machinelearning #kubeflow #mlops