Lion (optimizer)
Lion (EvoLved Sign Momentum) is a stochastic optimizer for training deep neural networks, introduced by researchers at Google in the February 2023 paper "Symbolic Discovery of Optimization Algorithms" by…
Explore Algorithms through related topics and the articles other pages reference most.
Articles that also belong to these categories. Counts cover all of Algorithms.
Showing 1-1 of 1 article
Lion (EvoLved Sign Momentum) is a stochastic optimizer for training deep neural networks, introduced by researchers at Google in the February 2023 paper "Symbolic Discovery of Optimization Algorithms" by…