Learning Rate
The learning rate is a hyperparameter that scales an update made by an iterative optimization algorithm. In machine learning, it is commonly written as η or α. For ordinary gradient descent, the update at iteration t is
Read the overview