AI Wiki
Category

Optimization

42 articles

AdaGrad

Training

Adam optimizer

Training

Bayesian Optimization

Machine Learning

Clipping

Deep Learning, Machine Learning

Convergence

Machine Learning, Mathematics

Convex Function

Machine Learning, Mathematics

Convex Optimization

Machine Learning, Mathematics

Convex Set

Machine Learning, Mathematics

Cost

Loss Functions

Empirical Risk Minimization

Learning Theory, Machine Learning, Statistical Learning

Gradient

Machine Learning, Mathematics

Gradient Descent

Deep Learning, Machine Learning

Gradient clipping

Training

Hinge Loss

Classification, Machine Learning

Hyperparameter

Deep Learning, Machine Learning

L0 Regularization

Machine Learning, Regularization

L1 Loss

Loss Functions, Machine Learning, Statistics

L1 Regularization

Machine Learning, Regularization

L2 Loss

Loss Functions, Machine Learning, Statistics

L2 Regularization

Machine Learning, Regularization

Learning Rate

Deep Learning, Machine Learning

Loss

Machine Learning

Loss Function

Deep Learning, Machine Learning

Loss Surface

Deep Learning, Machine Learning

Mini-batch stochastic gradient descent

Training Algorithms

Model Predictive Control

Control, Robotics

Momentum

Training

Objective

Machine Learning

Objective function

Loss Functions

Optimizer

Deep Learning, Machine Learning

Parameter update

Training

Policy gradient methods

Machine Learning, Reinforcement Learning

Proximal Policy Optimization (PPO)

Machine Learning, Reinforcement Learning

RMSProp

Deep Learning

Regularization

Deep Learning, Machine Learning

Step

Training

Step size

Hyperparameters

Stochastic Gradient Descent (SGD)

Deep Learning, Machine Learning

Swarm intelligence

Artificial Intelligence, Multi-Agent Systems

Termination condition

Machine Learning

Weight Decay

Machine Learning, Regularization

Whole-body control

Humanoid Robotics, Robot Control, Robotics