Sep 27, 2019 Learning Parameters Part 5: AdaGrad, RMSProp, and Adam Sep 27, 2019 Learning Parameters Part 4: Tips For Adjusting Learning Rate, Line Search May 16, 2019 Learning Parameters, Part 3: Stochastic & Mini-Batch Gradient Descent May 15, 2019 Learning Parameters, Part 2: Momentum-Based And Nesterov Accelerated Gradient Descent May 14, 2019 Learning Parameters, Part 1: Gradient Descent May 14, 2019 Learning Parameters, Part 0: Basic Stuff