nerdexam
Amazon

MLS-C01 · Question #352

A company wants to detect credit card fraud. The company has observed that an average of 2% of credit card transactions are fraudulent. A data scientist trains a classifier on a year's worth of credit

The correct answer is D. F1 score E. True positive rate. To optimize a classifier for an imbalanced fraud detection dataset, prioritizing the accurate capture of as many fraudulent transactions as possible, the True Positive Rate (Recall) and F1 score are the most relevant metrics.

Modeling

Question

A company wants to detect credit card fraud. The company has observed that an average of 2% of credit card transactions are fraudulent. A data scientist trains a classifier on a year's worth of credit card transaction data. The classifier needs to identify the fraudulent transactions. The company wants to accurately capture as many fraudulent transactions as possible. Which metrics should the data scientist use to optimize the classifier? (Choose two.)

Options

  • ASpecificity
  • BFalse positive rate
  • CAccuracy
  • DF1 score
  • ETrue positive rate

How the community answered

(49 responses)
  • A
    4% (2)
  • B
    16% (8)
  • C
    6% (3)
  • D
    73% (36)

Why each option

To optimize a classifier for an imbalanced fraud detection dataset, prioritizing the accurate capture of as many fraudulent transactions as possible, the True Positive Rate (Recall) and F1 score are the most relevant metrics.

ASpecificity

Specificity measures the proportion of actual negative cases (non-fraudulent transactions) that are correctly identified, which is not the primary objective of capturing fraudulent transactions.

BFalse positive rate

False positive rate measures the proportion of non-fraudulent transactions that are incorrectly classified as fraudulent, and while minimizing it is important, it does not directly address the goal of capturing as many fraudulent transactions as possible.

CAccuracy

Accuracy can be misleading in imbalanced datasets because a model that always predicts the majority class will still show high accuracy, failing to correctly identify the critical minority class (fraud).

DF1 scoreCorrect

The F1 score is a harmonic mean of precision and recall, which is particularly useful for imbalanced datasets like credit card fraud where both minimizing false positives and false negatives are important, balancing the need to identify fraud without excessive false alarms.

ETrue positive rateCorrect

True Positive Rate (Recall) measures the proportion of actual fraudulent transactions that are correctly identified by the model, directly addressing the requirement to "accurately capture as many fraudulent transactions as possible."

Concept tested: Classification metrics for imbalanced datasets

Source: https://scikit-learn.org/stable/modules/model_evaluation.html#f1-score

Topics

#Machine Learning Metrics#Classification#Imbalanced Data#Fraud Detection

Community Discussion

No community discussion yet for this question.

Full MLS-C01 Practice