An AI practitioner wants the outputs from a large language model (LLM) to be more diverse and creative. Which inference parameter should they adjust?
Choose an answer
Tap an option to check your answer.
Correct answer: Increase the temperature value..
Why this is the answer
Increasing the temperature value makes the LLM's outputs more diverse and creative. Temperature controls the randomness of the output by adjusting the probability distribution of the next token. A higher temperature (e.g., 0.7-1.0) flattens the distribution, allowing the model to select less probable tokens, leading to more varied and imaginative responses. A lower temperature (e.g., 0.1-0.3) makes the model more deterministic and focused, often producing more predictable and conservative text. Decreasing the Top K value would reduce the number of highest probability tokens considered, potentially making the output less diverse, not more. Increasing the response length simply allows for a longer output, not necessarily a more creative one. Decreasing the prompt length is unlikely to directly impact the creativity or diversity of the model's generation; it primarily affects the context provided.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed