Unadjusted Langevin Algorithm | Generative AI Animated

To try everything Brilliant has to offer—free—for a full 30 days, visit https://brilliant.org/Deepia .
You’ll also get 20% off an annual premium subscription.

In this video you'll learn about the Unadjusted Langevin Algorithm, and how it can be used to sample new data. This method was a precursor to what we now call "Diffusion models", which are just an annealed version of this algorithm.

Here is all the code used to produce the video, including the code of the "Implementation" chapter:
https://github.com/ytdeepia/Unadjuste...

Shout out to the viewers who contributed to the subtitles:
Chinese: Sakura ([email protected]), MouRen Sun

If you want to dive deeper you should read these papers:
"A Connection Between Score Matching and Denoising Autoencoders" by Pascal Vincent https://www.iro.umontreal.ca/~vincent...
"Generative Modeling by Estimating Gradients of the Data Distribution" by Yang Song Generative Modeling by Estimating Gradients of the Data Distribution
"Estimation of Non-Normalized Statistical Models byScore Matching" by AapoHyv arinen https://jmlr.org/papers/volume6/hyvar...
"Solving Linear Inverse Problems Using the Prior Implicit in a Denoiser" by Zahra Kadkhodaie https://arxiv.org/abs/2007.13640



00:00 Intro
00:35 Sponsor
01:34 The Denoiser approximates the Posterior Mean
05:43 Tweedie's formula
10:23 Score Matching
12:39 Langevin Algorithm
14:47 Implementation and Examples
17:50 Limitations
19:18 Outro

This video features animations created with Manim, inspired by Grant Sanderson's work at @3blue1brown. This video was sponsored by Brilliant.
If you enjoyed the content, please like, comment, and subscribe to support the channel!