Lion (optimizer)
Lion (EvoLved Sign Momentum) is a stochastic optimizer for training deep neural networks, introduced by researchers at Google in the February 2023 paper "Symbolic Discovery of Optimization Algorithms" by…
Algorithms
Explore Algorithms through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Training & Optimization
Articles that also belong to these categories. Counts cover all of Algorithms.
All articles (37)Machine Learning (18)Reinforcement Learning (8)Statistics (7)Deep Learning (4)Robotics (4)AI Hardware (3)AI Inference (3)Computer Science (3)Information Retrieval (3)Mathematics (3)Natural Language Processing (3)Open Source AI (3)Artificial Intelligence (2)Large Language Models (2)Training & Optimization (2)AI for Science (1)AI in Gaming (1)Computer Vision (1)Data & Datasets (1)Google (1)Google DeepMind (1)Interpretability (1)Transformer Models (1)
Showing 1-2 of 2 articles
Simulated annealing
Simulated annealing is a probabilistic method for finding a good approximate solution to a global optimization problem, especially one with many local optima that trap ordinary hill-climbing methods.