CT-AI · Question #19
A bank wants to use an algorithm to determine which applicants should be given a loan. The bank hires a data scientist to construct a logistic regression model to predict whether the applicant will…
The correct answer is A. Experienced-based testing should be used to confirm that the training data set is operationally. The syllabus mentions that experience-based testing and EDA are effective for detecting biases: "Experience-based testing can be used to verify that the training dataset is operationally relevant and identify potential sources of bias. EDA is also useful for exploring the data…
Question
A bank wants to use an algorithm to determine which applicants should be given a loan. The bank hires a data scientist to construct a logistic regression model to predict whether the applicant will repay the loan or not. The bank has enough data on past customers to randomly split the data into a training data set and a test/validation data set. A logistic regression model is constructed on the training data set using the following independent variables:
Gender Marital status Number of dependents Education Income Loan amount Loan term Credit score The model reveals that those with higher credit scores and larger total incomes are more likely to repay their loans. The data scientist has suggested that there might be bias present in the model based on previous models created for other banks. Given this information, what is the best test approach to check for potential bias in the model?
Options
- AExperienced-based testing should be used to confirm that the training data set is operationally
- BBack-to-back testing should be used to compare the model created using the training data set to
- CAcceptance testing should be used to make sure the algorithm is suitable for the customer. The
- DA/B testing should be used to verify that the test data set does not detect any bias that might have
How the community answered
(27 responses)- A78% (21)
- B4% (1)
- C7% (2)
- D11% (3)
Explanation
The syllabus mentions that experience-based testing and EDA are effective for detecting biases: "Experience-based testing can be used to verify that the training dataset is operationally relevant and identify potential sources of bias. EDA is also useful for exploring the data and understanding any relationships that might lead to bias in the model."
Topics
Community Discussion
No community discussion yet for this question.