AIF-C01 · Question #50
A company has built a solution by using generative AI. The solution uses large language models (LLMs) to translate training manuals from English into other languages. The company wants to evaluate…
The correct answer is A. Bilingual Evaluation Understudy (BLEU). BLEU (Bilingual Evaluation Understudy) is a metric used to evaluate the accuracy of machine- generated translations by comparing them against reference translations. It is commonly used for translation tasks to measure how close the generated output is to professional human
Question
A company has built a solution by using generative AI. The solution uses large language models (LLMs) to translate training manuals from English into other languages. The company wants to evaluate the accuracy of the solution by examining the text generated for the manuals. Which model evaluation strategy meets these requirements?
Options
- ABilingual Evaluation Understudy (BLEU)
- BRoot mean squared error (RMSE)
- CRecall-Oriented Understudy for Gisting Evaluation (ROUGE)
- DF1 score
How the community answered
(46 responses)- A74% (34)
- B7% (3)
- C15% (7)
- D4% (2)
Explanation
BLEU (Bilingual Evaluation Understudy) is a metric used to evaluate the accuracy of machine- generated translations by comparing them against reference translations. It is commonly used for translation tasks to measure how close the generated output is to professional human
Topics
Community Discussion
No community discussion yet for this question.