Which metric is used to evaluate the performance of foundation models (FMs) for text summarization tasks?

The correct answer is A. F1 score. Text summarization quality is most commonly assessed using ROUGE metrics, which report recall, precision, and an F1‑score that balances the two. The ROUGE‑F1 (often simply called the F1 score in this context) measures how well the model’s summary overlaps with reference…

Submitted by hans_de· Mar 30, 2026Evaluate and improve ML models

Question

Options

AF1 score
BBilingual Evaluation Understudy (BLEU) score
CAccuracy
DMean squared error (MSE)

How the community answered

(39 responses)

A
87% (34)
B
3% (1)
C
8% (3)
D
3% (1)

Explanation

Text summarization quality is most commonly assessed using ROUGE metrics, which report recall, precision, and an F1‑score that balances the two. The ROUGE‑F1 (often simply called the F1 score in this context) measures how well the model’s summary overlaps with reference summaries, making it the standard choice for evaluating foundation models on summarization

Topics

#Foundation Models#Text Summarization#Evaluation Metrics#F1 Score

Community Discussion

No community discussion yet for this question.

Full AIF-C01 Practice