MLS-C01 · Question #15
A Machine Learning Specialist is building a prediction model for a large number of features using linear models, such as linear regression and logistic regression. During exploratory data analysis…
The correct answer is C. Create a new feature space using principal component analysis (PCA). A linear model is being built with many highly correlated features, which can lead to model instability.
Question
A Machine Learning Specialist is building a prediction model for a large number of features using linear models, such as linear regression and logistic regression. During exploratory data analysis, the Specialist observes that many features are highly correlated with each other. This may make the model unstable. What should be done to reduce the impact of having such a large number of features?
Options
- APerform one-hot encoding on highly correlated features.
- BUse matrix multiplication on highly correlated features.
- CCreate a new feature space using principal component analysis (PCA)
- DApply the Pearson correlation coefficient.
How the community answered
(20 responses)- A5% (1)
- B5% (1)
- C75% (15)
- D15% (3)
Why each option
A linear model is being built with many highly correlated features, which can lead to model instability.
One-hot encoding is used for categorical features, not for reducing correlation or dimensionality in continuous, highly correlated features.
Matrix multiplication is a mathematical operation, not a technique for reducing correlation or dimensionality in features to improve model stability.
Principal Component Analysis (PCA) is a dimensionality reduction technique that transforms a set of correlated features into a smaller set of uncorrelated features called principal components. By creating a new feature space with these uncorrelated components, PCA effectively addresses multicollinearity and reduces the impact of a large number of correlated features on model stability.
Applying the Pearson correlation coefficient is a method to measure correlation, not to reduce its impact or the number of features.
Concept tested: Dimensionality reduction for multicollinearity using PCA
Source: https://scikit-learn.org/stable/modules/generated/sklearn.decomposition.PCA.html
Topics
Community Discussion
No community discussion yet for this question.