Rasa Algorithm Whiteboard - Transformers & Attention 3: Multi Head Attention
Автор: Rasa
Загружено: 2020-05-04
Просмотров: 59947
This is the third video on attention mechanisms. In the previous video we introduced keys, queries and values and in this video we're introducing the concept of multiple heads.
The colab notebook that contains the interactive visualisation can be found here:
https://colab.research.google.com/git...
We're going at it step by step, but if you're interested in immediately reading all about it in full detail then we might recommend these online documents:
http://www.peterbloem.nl/blog/transfo...
http://jalammar.github.io/illustrated...
http://d2l.ai/chapter_attention-mecha...
The general github repo for this playlist can be found here: https://github.com/RasaHQ/algorithm-w....
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке: