Candidate Sampling
Candidate sampling is a family of training-time optimization techniques used in machine learning to reduce the computational cost of models that must choose among a very large number of output classes.
Explore Training & Optimization through related topics and the articles other pages reference most.
Articles that also belong to these categories. Counts cover all of Training & Optimization.
Showing 1-5 of 5 articles
Candidate sampling is a family of training-time optimization techniques used in machine learning to reduce the computational cost of models that must choose among a very large number of output classes.
Group normalization (GN, also written GroupNorm) is a normalization layer for deep neural networks that splits the channels of a feature map into groups and normalizes the features in each group, for each…
The lottery ticket hypothesis is a conjecture about neural network training, proposed by Jonathan Frankle and Michael Carbin of MIT CSAIL, which holds that a dense
Weight initialization is the choice of starting values for the trainable parameters of a neural network before training begins.
Weight-Space Programming is an approach in which a general-purpose large language model reads, interprets, edits or constructs another neural network's numerical weights in response to a natural-language goal