AIF-C01 · Question #255
A company has set up a translation tool to help its customer service team handle issues from customers around the world. The company wants to evaluate the performance of the translation tool. The…
The correct answer is B. Use the Bilingual Evaluation Understudy (BLEU) score to estimate the relative translation quality. BLEU measures n-gram overlap between a candidate translation and one or more reference translations. When you apply it to both the tool’s outputs and the human outputs on the same source documents, you get comparable scores that let you directly assess which approach yields…
Question
A company has set up a translation tool to help its customer service team handle issues from customers around the world. The company wants to evaluate the performance of the translation tool. The company sets up a parallel data process that compares the responses from the tool to responses from actual humans. Both sets of responses are generated on the same set of documents. Which strategy should the company use to evaluate the translation tool?
Options
- AUse the Bilingual Evaluation Understudy (BLEU) score to estimate the absolute translation quality
- BUse the Bilingual Evaluation Understudy (BLEU) score to estimate the relative translation quality
- CUse the BERTScore to estimate the absolute translation quality of the two methods.
- DUse the BERTScore to estimate the relative translation quality of the two methods.
How the community answered
(24 responses)- A4% (1)
- B63% (15)
- C25% (6)
- D8% (2)
Explanation
BLEU measures n-gram overlap between a candidate translation and one or more reference translations. When you apply it to both the tool’s outputs and the human outputs on the same source documents, you get comparable scores that let you directly assess which approach yields better translations.
Topics
Community Discussion
No community discussion yet for this question.