AIF-C01 · Question #236
A company wants to add generative AI functionality to its application by integrating a large language model (LLM). The responses from the LLM must be as deterministic and as stable as possible…
The correct answer is A. Configure the application to automatically set the temperature parameter to 0 when submitting the. The temperature hyperparameter directly controls the randomness of the LLM’s token sampling: setting it to 0 forces greedy decoding, yielding the most likely next token every time and thus fully deterministic, stable outputs.
Question
A company wants to add generative AI functionality to its application by integrating a large language model (LLM). The responses from the LLM must be as deterministic and as stable as possible. Which solution meets these requirements?
Options
- AConfigure the application to automatically set the temperature parameter to 0 when submitting the
- BConfigure the application to automatically add "make your response deterministic" at the end of
- CConfigure the application to automatically add "make your response deterministic" at the
- DConfigure the application to automatically set the temperature parameter to 1 when submitting the
How the community answered
(38 responses)- A82% (31)
- B3% (1)
- C11% (4)
- D5% (2)
Explanation
The temperature hyperparameter directly controls the randomness of the LLM’s token sampling: setting it to 0 forces greedy decoding, yielding the most likely next token every time and thus fully deterministic, stable outputs.
Topics
Community Discussion
No community discussion yet for this question.