Optimization Techniques in Neural Networks - Part 1 : Efficient Gradient Descent AlgorithmsSuji Daniel-PaulMay 18, 20240 min readUpdated: Sep 13, 2024
Optimization Techniques in Neural Networks - Part 2 : Second-Order Optimization Methods for Large-Scale ANNs