Vector-Quantized Variational Autoencoders (VQ-VAEs)
Автор: DeepBean
Загружено: 2024-08-14
Просмотров: 22883
The Vector-Quantized Variational Autoencoder (VQ-VAE) forms discrete latent representations, by mapping encoding vectors to a limited size codebook. But, how does it do this, and why would we want to do it anyway?
Link to my video on VAEs: • Understanding Variational Autoencoders (VAEs)
Timestamps
-------------------
00:00 Introduction
01:09 VAE refresher
02:42 Quantization
04:46 Posterior
06:09 Prior
07:06 Learned prior for sampling
09:55 Reconstruction loss
10:32 Straight-through estimation
11:50 Codebook loss
12:53 Commitment loss
14:33 Benefits of quantization
16:58 Application examples
Links
---------
VQ-VAE paper: https://arxiv.org/abs/1711.00937
Straight-through estimation paper: https://arxiv.org/abs/1308.3432
PixelCNN paper: https://arxiv.org/abs/1606.05328
WaveNet paper: https://arxiv.org/abs/1609.03499
Text-to-Image paper: https://arxiv.org/abs/2111.14822
Jukebox paper: https://arxiv.org/abs/2005.00341
PyTorch implementation: https://github.com/airalcorn2/vqvae-p...
Keras implementation: https://keras.io/examples/generative/...
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке:
![Why Deep Learning Works Unreasonably Well [How Models Learn Part 3]](https://ricktube.ru/thumbnail/qx7hirqgfuU/mqdefault.jpg)
