GENERATIVE-AI-LEADER · Question #56
A company trains a generative AI model designed to classify customer feedback as positive, negative, or neutral. However, the training dataset disproportionately includes feedback from a specific…
The correct answer is A. Data dependency. The core reason for the model's failure is that the training data itself was flawed (disproportionate demographic representation and outdated language). This flaw directly leads to the observed bias and poor performance on underrepresented groups and modern communication…
Question
A company trains a generative AI model designed to classify customer feedback as positive, negative, or neutral. However, the training dataset disproportionately includes feedback from a specific demographic and uses outdated language norms that don't reflect current customer communication styles. When the model is deployed, it shows a strong bias in its sentiment analysis for new customer feedback, misclassifying reviews from underrepresented demographics and struggling to understand current slang or phrasing. What type of model limitation is this?
Options
- AData dependency
- BEdge case
- CHallucination
- DOverfitting
How the community answered
(50 responses)- A94% (47)
- C2% (1)
- D4% (2)
Explanation
The core reason for the model's failure is that the training data itself was flawed (disproportionate demographic representation and outdated language). This flaw directly leads to the observed bias and poor performance on underrepresented groups and modern communication styles. This is a classic example of Data Dependency, a fundamental limitation of all machine learning models, including generative AI. Data dependency refers to the absolute reliance of an AI model on the quality, completeness, and fairness of the data on which it was trained. Since the model essentially only mimics the patterns it learned from its dataset, if the dataset contains societal, demographic, or linguistic biases, the model will faithfully reproduce and amplify those biases in its output, leading to unfair classification for certain groups.
Topics
Community Discussion
No community discussion yet for this question.