How do Vision Transformers work? – Paper explained | multi-head self-attention & convolutions

It turns out that multi-head self-attention and convolutions are complementary. So, what makes multi-head self-attention different from convolutions? How and why do Vision Transformers work? In this video, we will find out by explaining the paper “How Do Vision Transformers Work?” by Namuk & Kim, 2021. SPONSOR: Weights & Biases 👉 https://wandb.me/ai-coffee-break ⏩ Vision Transformers explained playlist: https://youtube.com/playlist?list=PLpZBeKTZRGPMddKHcsJAOIghV8MwzwQV6 📺 ViT: An image is worth 16x16 pixels: https://youtu.be/DVoHvmww2lQ 📺 Swin Transformer: https://youtu.be/SndHALawoag 📺 ConvNext: https://youtu.be/QqejV0LNDHA 📺 DeiT: https://youtu.be/-FbV2KgRM8A 📺 Adversarial attacks: https://youtu.be/YyTyWGUUhmo ❓Check out our daily #MachineLearning Quiz Questions: ► https://www.youtube.com/c/AICoffeeBreak/community ➡️ AI Coffee Break Merch! 🛍️ https://aicoffeebreak.creator-spring.com/ Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏 Don Rosenthal, Dres. Trost GbR, banana.dev -- Kyle Morris, Joel Ang Paper 📜: Park, Namuk, and Songkuk Kim. "How Do Vision Transformers Work?." In International Conference on Learning Representations. 2021. https://openreview.net/forum?id=D78Go4hVcxO 🔗 Official implementation: https://github.com/xxxnell/how-do-vits-work Outline: 00:00 Transformers vs ConvNets 01:04 Sponsor: Weights & Biases 02:21 Convolutions explained in a nutshell 03:35 Multi-Head Self-Attention explained 06:46 Why we thought that MSA is cool 09:56 Paper insights 15:26 MSA vs. Convs (more insight) 16:07 Low-pass filters (MSA) and high-pass filters (Convs) ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕ Patreon: https://www.patreon.com/AICoffeeBreak Ko-fi: https://ko-fi.com/aicoffeebreak ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔗 Links: AICoffeeBreakQuiz: https://www.youtube.com/c/AICoffeeBreak/community Twitter: https://twitter.com/AICoffeeBreak Reddit: https://www.reddit.com/r/AICoffeeBreak/ YouTube: https://www.youtube.com/AICoffeeBreak #AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research​ Music 🎵 : Bella Bella Beat by Nana Kwabena