Search results

* '''[[Optimization techniques]]:''' Certain optimization algorithms, such as gradient descent, can produce NaN values when encountering local minima or saddle po * '''[[Gradient clipping]]:''' Gradient clipping is a technique used to limit the magnitude of the gradients in the optimiza

| '''[[AdA]]''' || || [[Adaptive Agent]] | '''[[Adam]]''' || || [[Adaptive Moment Estimation]]