Deep Learning mindmap

Attention mechanismConvolutional neural ne…RNNs & LSTMsTransformer architectureActivation functionsBackpropagationBatch and layer normali…Dropout and regularizat…Forward passOptimizers: SGD, moment…EmbeddingsTransfer learning and f…Functions are machinesDerivatives: change rig…Dot product, norms, and…Matrices transform space