Temperature sampling
Temperature sampling is the most common decoding control in large language models: a single hyperparameter, written T, that divides the model's output logits before the softmax function so that the formula…
Explore AI Inference through related topics and the articles other pages reference most.
Articles that also belong to these categories. Counts cover all of AI Inference.
Showing 1-1 of 1 article
Temperature sampling is the most common decoding control in large language models: a single hyperparameter, written T, that divides the model's output logits before the softmax function so that the formula…