A company will integrate a large language model (LLM) into its application and needs the model's responses to be as deterministic and consistent as possible. Which approach satisfies this requirement?
Choose an answer
Tap an option to check your answer.
Correct answer: Configure the application to automatically set the temperature parameter to 0 when submitting the prompt to the LLM..
Why this is the answer
Setting the temperature parameter to 0 makes LLM responses highly deterministic and consistent. Temperature controls the randomness of the output; a value of 0 means the model will always choose the token with the highest probability, leading to the same output for the same input. Adding "make your response deterministic" to the prompt is an instruction that the LLM might interpret, but it's not a reliable or guaranteed method to enforce determinism compared to directly controlling the generation parameters. Setting the temperature to 1 increases the randomness of the output, making responses less consistent and more creative, which is the opposite of the requirement.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed