Math Primer and Neural Network Basics, LMU 2019-
I give this guest lecture as part of “Deep Learning and AI” since winter semester 2019, at LMU Munich for master students in computer science and similar majors.
The topics include
- Recapping a few topics in probability theory that are most relevant for DL: MLE and MAE.
- Recapping optimization methods, gradien-free, first- and second-gradient methods.
- An introduction to automatic differentiation.
- An over-simplified intro to the challenges and solutions in the course of NN’s history.