223
edits
GPT API: Difference between revisions
→top_p
(→top_p) |
|||
| Line 84: | Line 84: | ||
===top_p=== | ===top_p=== | ||
[[top-p]] is a value between 0 and 1. It also adds randomness into the model's predictions. Instead of choosing the most likely next word prediction, the model creates a subset (the "nucleus") of the next-word predictions that have a cumulative probability greater than the chosen 'p' value. The next word is then randomly selected from this subset. For instance, if 'p' is set to 0.9, the model will pick the smallest set of words whose cumulative probability exceeds 0.9, and the next word will be randomly selected from this set. | |||
*0 = least random, 1 = most random | |||
*default value is 1 | |||
==Response Fields== | ==Response Fields== | ||