PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #280
You are developing a model to help your company create more targeted online advertising campaigns. You need to create a dataset that you will use to train the model. You want to avoid creating or rein
The correct answer is D. Collect a stratified sample of production traffic to build the training dataset. To create a dataset for targeted online advertising that avoids or reduces unfair bias, collect a stratified sample of production traffic.
Question
Options
- AInclude a comprehensive set of demographic features
- BInclude only the demographic groups that most frequently interact with advertisements
- CCollect a random sample of production traffic to build the training dataset
- DCollect a stratified sample of production traffic to build the training dataset
- EConduct fairness tests across sensitive categories and demographics on the trained model
How the community answered
(35 responses)- A9% (3)
- B3% (1)
- C14% (5)
- D71% (25)
- E3% (1)
Why each option
To create a dataset for targeted online advertising that avoids or reduces unfair bias, collect a stratified sample of production traffic.
Including a comprehensive set of demographic features is important for bias detection and mitigation later, but simply including them doesn't by itself prevent bias during dataset creation if the overall sampling is skewed or features are used improperly.
Including only the demographic groups that most frequently interact with advertisements would actively reinforce bias by excluding and underrepresenting other groups, leading to a model that performs poorly or unfairly for those excluded populations.
Collecting a simple random sample might inadvertently perpetuate existing biases present in the production traffic, as it does not guarantee adequate representation of minority or sensitive subgroups, potentially leading to a biased model.
Collecting a stratified sample of production traffic helps ensure that all relevant demographic groups or sensitive categories are adequately represented in the training dataset. This proportional representation is crucial for mitigating potential biases that might arise from underrepresented groups in a simple random sample, thereby preventing the model from creating or reinforcing unfair biases.
Conducting fairness tests on the trained model is a critical step for detecting and mitigating bias after training, but it is not an action taken during the dataset creation phase to directly prevent bias in the dataset itself.
Concept tested: Bias mitigation in dataset creation (stratified sampling)
Source: https://cloud.google.com/responsible-ai/guidance/ml-development-process/data-collection-and-preparation
Topics
Community Discussion
No community discussion yet for this question.