AAIA · Question #46
An organization deploys an AI recruitment platform to screen job applicants. The IS auditor identifies that the platform's decisions may be influenced by model bias. Which of the following risk…
The correct answer is A. Implement a process to periodically test the AI system for biases and adjust parameters as. The best mitigation for identified model bias in a production AI recruitment system is a continuous testing and adjustment process, which addresses bias as an ongoing operational risk rather than a one-time fix. This balances operational continuity with risk control.
Question
An organization deploys an AI recruitment platform to screen job applicants. The IS auditor identifies that the platform's decisions may be influenced by model bias. Which of the following risk mitigation strategies is BEST for the auditor to recommend?
Options
- AImplement a process to periodically test the AI system for biases and adjust parameters as
- BSuspend the use of the AI system until the training data can be verified for fairness and
- CRetrain the AI model using an external data set certified for inclusivity and fairness.
- DRequire manual reviews of all AI-generated recruitment decisions before hiring is finalized.
How the community answered
(42 responses)- A81% (34)
- B2% (1)
- C7% (3)
- D10% (4)
Why each option
The best mitigation for identified model bias in a production AI recruitment system is a continuous testing and adjustment process, which addresses bias as an ongoing operational risk rather than a one-time fix. This balances operational continuity with risk control.
Implementing a periodic bias testing process with parameter adjustments addresses model bias as a continuous risk management activity, which is appropriate for a production system where bias may evolve as data changes. This approach follows a risk-based control framework by establishing monitoring and correction mechanisms without unnecessarily halting operations. It is proportionate, sustainable, and aligns with responsible AI governance practices.
Suspending the system is a disproportionate response that disrupts operations and does not constitute a mitigation strategy; it is a temporary halt, not a control.
Retraining on a single externally certified dataset does not address ongoing bias risk and provides no mechanism for detecting or correcting future drift or emerging bias.
Requiring manual review of all AI decisions eliminates the efficiency benefit of the AI system and is not a scalable or practical long-term mitigation strategy.
Concept tested: AI bias risk mitigation through continuous monitoring
Source: https://www.nist.gov/system/files/documents/2022/03/17/AI-RMF-1st-draft.pdf
Topics
Community Discussion
No community discussion yet for this question.