Wednesday, October 28, 2020

OPEN TALK (API): Attention Please! A Friendly Introduction to Attention in Deep Learning
Join on Hopin
Cristian Garcia
Cristian Garcia
Toptal, Machine Learning Developer

Attention is a technique that recently got a lot of success in Deep Learning, initially because of its state of the art performance in NLP but since then it has expanded to other areas such as Vision, Graphs, Point Cloud Data, Sets, and its been even used as part of the architecture of RL algorithms such as AlphaStar. This talk is a friendly introduction to Attention in Deep Learning, it will guide you to understanding the basics of the MultiHead Attention module that is the basis of many of the Transformer architectures.