Alternating least squares
Alternating least squares (ALS) is an iterative method for fitting a product of two or more factor matrices to data by holding all but one factor fixed, solving the resulting linear least squares problem for…
Explore Training & Optimization through related topics and the articles other pages reference most.
Articles that also belong to these categories. Counts cover all of Training & Optimization.
Showing 1-5 of 5 articles
Alternating least squares (ALS) is an iterative method for fitting a product of two or more factor matrices to data by holding all but one factor fixed, solving the resulting linear least squares problem for…
A genetic algorithm (GA) is a search and optimization method that imitates natural selection: it keeps a population of candidate solutions encoded as strings, scores each one with a fitness function, and…
Lion (EvoLved Sign Momentum) is a stochastic optimizer for training deep neural networks, introduced by researchers at Google in the February 2023 paper "Symbolic Discovery of Optimization Algorithms" by…
Simulated annealing is a probabilistic method for finding a good approximate solution to a global optimization problem, especially one with many local optima that trap ordinary hill-climbing methods.
Trust Region Policy Optimization (TRPO) is a policy gradient algorithm for reinforcement learning that improves a stochastic policy by maximizing a surrogate objective while keeping the average KL divergence…