New course announcement ✨
We're teaching an in-person LLM bootcamp in the SF Bay Area on November 14, 2023. Come join us if you want to see the most up-to-date materials building LLM-powered products and learn in a hands-on environment.
https://www.scale.bythebay.io/llm-workshop
Hope to see some of you there!
--------------------------------------------------------------------------------------------- In this video, we cover what you need to develop deep learning models, from software engineering to distributed training to experiment management.
00:00 Development Infrastructure & Tooling
01:39 Software Engineering
09:02 Deep Learning Frameworks
14:47 Meta-frameworks and model zoos
16:52 Distributed Training
28:32 GPUs
39:09 Compute Resource Management
46:35 Experiment Management
Subscribe to our channel and sign up at https://fullstackdeeplearning.com/course/2022/ to follow along with the 2022 course!
Lecture Notes: https://fullstackdeeplearning.com/course/2022/lecture-2-development-infrastructure-and-tooling
Slides: https://fsdl.me/2022-lecture-02-slides