nerdexam
Google

PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #19

You started working on a classification problem with time series data and achieved an area under the receiver operating characteristic curve (AUC ROC) value of 99% for training data after just a few…

The correct answer is B. Address data leakage by applying nested cross-validation during model training. Achieving 99% AUC ROC on training data after only a few experiments - especially with time series data - is a strong signal of data leakage, not simply overfitting. With time series, leakage commonly occurs when future timestamps are included in the training window, allowing…

Submitted by noor.lb· Apr 18, 2026ML model development

Question

You started working on a classification problem with time series data and achieved an area under the receiver operating characteristic curve (AUC ROC) value of 99% for training data after just a few experiments. You haven't explored using any sophisticated algorithms or spent any time on hyperparameter tuning. What should your next step be to identify and fix the problem?

Options

  • AAddress the model overfitting by using a less complex algorithm.
  • BAddress data leakage by applying nested cross-validation during model training.
  • CAddress data leakage by removing features highly correlated with the target value.
  • DAddress the model overfitting by tuning the hyperparameters to reduce the AUC ROC value.

How the community answered

(26 responses)
  • A
    8% (2)
  • B
    62% (16)
  • C
    12% (3)
  • D
    19% (5)

Explanation

Achieving 99% AUC ROC on training data after only a few experiments - especially with time series data - is a strong signal of data leakage, not simply overfitting. With time series, leakage commonly occurs when future timestamps are included in the training window, allowing the model to 'see the future.' Nested cross-validation with proper temporal ordering (walk-forward validation) prevents future data from leaking into training folds, exposing the true model performance. Option A (less complex algorithm) addresses overfitting but doesn't fix the root cause. Option C (removing correlated features) can help with leakage in some scenarios but is too narrow - removing one correlated feature doesn't prevent temporal leakage. Option D (tuning hyperparameters to reduce AUC) makes no sense; you don't tune a model to perform worse.

Topics

#Data Leakage#Cross-validation#Model Evaluation#Time Series

Community Discussion

No community discussion yet for this question.

Full PROFESSIONAL-MACHINE-LEARNING-ENGINEER Practice