AIF-C01 · Question #246
Which large language model (LLM) parameter controls the number of possible next words or tokens considered at each step of the text generation process?
The correct answer is B. Top K. The Top K parameter limits token sampling at each generation step to the K most probable next tokens. By choosing how many of the highest‑probability candidates to consider, Top K directly controls the breadth of options the model evaluates when generating each token.
Question
Which large language model (LLM) parameter controls the number of possible next words or tokens considered at each step of the text generation process?
Options
- AMaximum tokens
- BTop K
- CTemperature
- DBatch size
How the community answered
(34 responses)- B94% (32)
- C3% (1)
- D3% (1)
Explanation
The Top K parameter limits token sampling at each generation step to the K most probable next tokens. By choosing how many of the highest‑probability candidates to consider, Top K directly controls the breadth of options the model evaluates when generating each token.
Topics
Community Discussion
No community discussion yet for this question.