NCA-AIIO · Question #60
Which metric is LEAST appropriate for evaluating recommendation ranking quality?
The correct answer is D. Accuracy. Recommendation systems are fundamentally ranking problems: the goal is to surface the most relevant items at the top of a list. NDCG (Normalized Discounted Cumulative Gain), MAP (Mean Average Precision), and Precision@K all explicitly reward models for placing relevant items high
Question
Which metric is LEAST appropriate for evaluating recommendation ranking quality?
Options
- ANDCG
- BMAP
- CPrecision@K
- DAccuracy
How the community answered
(28 responses)- A4% (1)
- B4% (1)
- C7% (2)
- D86% (24)
Explanation
Recommendation systems are fundamentally ranking problems: the goal is to surface the most relevant items at the top of a list. NDCG (Normalized Discounted Cumulative Gain), MAP (Mean Average Precision), and Precision@K all explicitly reward models for placing relevant items higher in the ranked list. Accuracy, by contrast, treats every position equally (correct or incorrect, rank 1 or rank 100 is the same) and is designed for flat classification tasks. In a recommendation context, accuracy ignores ranking order entirely, making it a poor proxy for whether the system actually surfaces the best items first.
Topics
Community Discussion
No community discussion yet for this question.