Distributionally Robust Optimization
Distributionally robust optimization (DRO) is a framework for making decisions when the probability distribution of uncertain inputs is not known exactly.
Statistics
Explore Statistics through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Training & Optimization
Articles that also belong to these categories. Counts cover all of Statistics.
All articles (103)Machine Learning (90)Model Evaluation (15)Mathematics (14)Data & Datasets (10)Algorithms (7)Data Science (6)Training & Optimization (6)AI Ethics (5)Computer Science (3)Natural Language Processing (3)AI Benchmarks (2)Artificial Intelligence (2)Deep Learning (2)Reinforcement Learning (2)Robotics (2)AI Alignment (1)AI History (1)AI Inference (1)Computer Vision (1)Diffusion Models (1)Education AI (1)MLOps (1)Neural Networks (1)People (1)Programming Languages (1)
Showing 1-6 of 6 articles
L1 Loss
L1 loss is a regression loss function equal to the average of the absolute differences between predicted values and target values, written as $$\frac{1}{n} \sum \lvert y_i - \hat{y}_i \rvert$$.
L2 Loss
L2 loss is the squared-error loss function: for a true value $$y$$ and a predicted value $$\hat{y}$$, it is the squared difference $$(y - \hat{y})^2$$, and averaging it across a dataset gives the mean squared…
Ridge Regularization
Ridge regularization, also known as L2 regularization or Tikhonov regularization, is a technique in statistics and machine learning that adds a squared L2-norm penalty to a model's loss function.
Simulated annealing
Simulated annealing is a probabilistic method for finding a good approximate solution to a global optimization problem, especially one with many local optima that trap ordinary hill-climbing methods.
Squared Loss
Squared loss, also called quadratic loss, L2 loss, or squared error loss, is a loss function that penalizes a prediction by the square of its error: for a true value $y$ and a prediction $\hat{y}$