Training & Optimization

Explore Training & Optimization through related topics and the articles other pages reference most.

Explore articles

Reset filters
Browse subtopics: Statistics

Articles that also belong to these categories. Counts cover all of Training & Optimization.

Showing 1-9 of 9 articles

Fisher information

Fisher information is a measure, defined by the statistician Ronald A. Fisher, of how much information an observable random variable carries about an unknown parameter of the probability distribution that…

Machine LearningMathematics

Huber loss

Huber loss is a loss function for regression that is quadratic for small errors and linear for large ones, so it behaves like squared loss near zero and like absolute loss (L1 loss) in the tails.

Deep LearningMachine Learning

Ridge Regularization

Ridge regularization, also known as L2 regularization or Tikhonov regularization, is a technique in statistics and machine learning that adds a squared L2-norm penalty to a model's loss function.

Machine LearningStatistics

Simulated annealing

Simulated annealing is a probabilistic method for finding a good approximate solution to a global optimization problem, especially one with many local optima that trap ordinary hill-climbing methods.

AlgorithmsMachine Learning

Squared Loss

Squared loss, also called quadratic loss, L2 loss, or squared error loss, is a loss function that penalizes a prediction by the square of its error: for a true value $y$ and a prediction $\hat{y}$

Machine LearningStatistics