There are times when you need to look back to something and reassure yourself that you really really understand it. This is a dynamic work-in-progress list of resources that has, potentially in a distant past, helped me do that.

Linear Algebra

  1. Change of basis

  2. Eigenvectors and Eigenvalues

  3. Matrix Ranks, Invertibility, SVD, Pseudoinverse

Statistical ML

Probability, MLE, EM

  1. Multiple random variables probability review

  2. Generative modeling, Latent variables, GMMs, MLE, EM

Naive Bayes, Logistic - Sigmoid, Softmax

  1. MLE, Naive Bayes, Logistic

  2. Logistic, Softmax, Cross-entropy, Logistic connection to a single neuron via sigmoid

Neural Network Foundational

Space Transformation

  1. Neural Networks, Manifolds, and Topology

Backpropagation

  1. What is backpropagation really doing?

  2. Backpropagation calculus

  3. Backprop with practical considerations

Natural Language Processing

Non Contextual Word Embeddings

  1. Word2Vec CBOW and Skip-Gram

  2. GloVe training objective

Attention

  1. Seq2Seq problems - need for Attention, Attention, NMT, BPE, WordPieces