PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #84
You work for a global footwear retailer and need to predict when an item will be out of stock based on historical inventory data Customer behavior is highly dynamic since footwear demand is influenced
The correct answer is C. Use the last relevant week of data as a validation set to ensure that your model is performing. For time-series inventory prediction with dynamic behavior, using the most recent relevant data as a validation set is the most streamlined and reliable way to ensure a model's current performance before deployment.
Question
Options
- AUse then TFX ModelValidator tools to specify performance metrics for production readiness.
- BUse k-fold cross-validation as a validation strategy to ensure that your model is ready for
- CUse the last relevant week of data as a validation set to ensure that your model is performing
- DUse the entire dataset and treat the area under the receiver operating characteristics curve (AUC
How the community answered
(35 responses)- A23% (8)
- B6% (2)
- C60% (21)
- D11% (4)
Why each option
For time-series inventory prediction with dynamic behavior, using the most recent relevant data as a validation set is the most streamlined and reliable way to ensure a model's current performance before deployment.
TFX ModelValidator tools are excellent for defining and enforcing performance metrics, but the choice of *which* validation data to use (the strategy) is a more fundamental consideration for dynamic time-series data.
K-fold cross-validation is inappropriate for time-series data as it breaks temporal dependencies and can lead to data leakage by training on future data to predict past data.
For time-series data with dynamic customer behavior, using the most recent relevant period (e.g., the last week) as a validation set is crucial. This approach simulates how the model will perform on new, unseen data that reflects current trends, ensuring its relevance for immediate production use.
Using the entire dataset as a validation set would lead to data leakage and an overoptimistic evaluation, as the model would be tested on data it was trained on.
Concept tested: Time-series model validation strategies
Source: https://cloud.google.com/blog/products/ai-machine-learning/building-a-machine-learning-model-for-time-series-forecasting
Topics
Community Discussion
No community discussion yet for this question.