MENU

Fun & Interesting

Mathing the Variational AutoEncoder: Deriving the ELBO Loss

Priyam Mazumdar 155 3 weeks ago
Video Not Working? Fix It Now

Today we will be deriving the loss function for the Variational AutoEncoder! In the next video we will be using this loss function, but I wanted to make sure we knew where this came from to begin with! If you also want to learn more about Jensens Inequality, there is a great video here! https://www.youtube.com/watch?v=10xgmpG_uTs Timestamps 00:00:00 Introduction 00:03:10 Review: Gaussian Distributions 00:05:50 AutoEncoder to Variational AutoEncoder 00:11:00 Review: KL Divergence 00:21:50 What is Variational Inference? 00:29:00 Deriving the ELBO Loss 00:47:20 KL Divergence for Standard Normal 01:11:15 Little Intuition for MSE 01:15:00 Recap Socials! X https://twitter.com/data_adventurer Instagram https://www.instagram.com/nixielights/ Linkedin https://www.linkedin.com/in/priyammaz/ 🚀 Github: https://github.com/priyammaz 🌐 Website: https://www.priyammazumdar.com/

Comment