A full visual explanation of LoRA, with PyTorch code form scratch!
Full code and slides are available on my GitHub: https://github.com/hkproj/pytorch-lora
Chapters
00:00 - Introduction
00:47 - How neural networks work
01:48 - How fine tuning works
03:50 - LoRA
08:58 - Math intuition
10:25 - Math explanation
14:05 - PyTorch implementation from scratch