AIF-C01 · Question #31
A company needs to choose a model from Amazon Bedrock to use internally. The company must identify a model that generates responses in a style that the company's employees prefer. What should the…
The correct answer is B. Evaluate the models by using a human workforce and custom prompt datasets. To determine which model generates responses in a style that the company's employees prefer, the best approach is to use a human workforce to evaluate the models with custom prompt datasets. This method allows for subjective evaluation based on the specific stylistic…
Question
A company needs to choose a model from Amazon Bedrock to use internally. The company must identify a model that generates responses in a style that the company's employees prefer. What should the company do to meet these requirements?
Options
- AEvaluate the models by using built-in prompt datasets.
- BEvaluate the models by using a human workforce and custom prompt datasets.
- CUse public model leaderboards to identify the model.
- DUse the model InvocationLatency runtime metrics in Amazon CloudWatch when trying models.
How the community answered
(47 responses)- A11% (5)
- B66% (31)
- C19% (9)
- D4% (2)
Explanation
To determine which model generates responses in a style that the company's employees prefer, the best approach is to use a human workforce to evaluate the models with custom prompt datasets. This method allows for subjective evaluation based on the specific stylistic preferences of the company's employees, which cannot be effectively assessed through automated methods or pre-built datasets.
Topics
Community Discussion
No community discussion yet for this question.