AI-900 · Question #19
When training a model, why should you randomly split the rows into separate subsets?
The correct answer is C. to test the model by using data that was not used to train the model. Randomly splitting data into distinct training and testing subsets is essential to evaluate a model's performance on unseen data. This process ensures the model can generalize well and helps prevent overfitting.
Question
Options
- Ato train the model twice to attain better accuracy
- Bto train multiple models simultaneously to attain better performance
- Cto test the model by using data that was not used to train the model
How the community answered
(55 responses)- A7% (4)
- B4% (2)
- C89% (49)
Why each option
Randomly splitting data into distinct training and testing subsets is essential to evaluate a model's performance on unseen data. This process ensures the model can generalize well and helps prevent overfitting.
Training a model twice on the same data or different subsets without a proper test set does not inherently lead to better accuracy and can still result in an overfit model if not evaluated on unseen data.
While multiple models can be trained, the primary reason for splitting data is not to train them simultaneously for better performance, but rather to properly evaluate a single model's generalization capability.
Randomly splitting data into distinct training and testing sets allows the model to be evaluated on data it has not previously encountered during its training phase. This evaluation helps assess the model's ability to generalize to new, real-world data and detect overfitting.
Concept tested: Data splitting for machine learning evaluation
Source: https://learn.microsoft.com/en-us/azure/machine-learning/concept-train-test-validate-split?view=azureml-api-2
Topics
Community Discussion
No community discussion yet for this question.