A company must pick an Amazon Bedrock model to use internally and wants a model that produces responses in the style employees prefer. What is the best approach to evaluate which model matches that preferred style?
Choose an answer
Tap an option to check your answer.
Correct answer: Use human evaluators with custom prompt datasets to assess the models..
Why this is the answer
To evaluate which Amazon Bedrock model best matches a company's preferred style, using human evaluators with custom prompt datasets is the most effective approach. "Style" is subjective and nuanced, requiring human judgment to determine if the model's tone, phrasing, and overall output align with company preferences. Custom prompt datasets ensure the evaluation is relevant to the company's specific use cases and internal communication standards. Using built-in prompt datasets is insufficient because they are generic and won't capture the company's unique stylistic requirements. Relying on public model leaderboards is problematic as these often rank models based on generalized benchmarks (e.g., accuracy, common sense reasoning) rather than specific stylistic preferences. Checking InvocationLatency runtime metrics in Amazon CloudWatch measures performance (speed), not the qualitative aspect of response style.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed