AAIA · Question #45
An IS auditor is evaluating an organization's incident management program to ensure it is sufficiently prepared to manage AI-related incidents. Which of the following is MOST important for the…
The correct answer is C. The program includes processes to respond to AI model drift and data integrity attacks. An AI-specific incident management program must address AI-unique failure modes such as model drift and data integrity attacks, which are not covered by generic IT incident processes. Validating these AI-specific response capabilities is the most important audit step.
Question
An IS auditor is evaluating an organization's incident management program to ensure it is sufficiently prepared to manage AI-related incidents. Which of the following is MOST important for the auditor to validate?
Options
- AThe program mandates retraining AI systems after incidents are investigated.
- BThe program uses past AI-related incidents and resolutions to categorize current incidents.
- CThe program includes processes to respond to AI model drift and data integrity attacks.
- DThe program prioritizes incidents based on alignment with industry leading practices.
How the community answered
(60 responses)- A12% (7)
- B7% (4)
- C78% (47)
- D3% (2)
Why each option
An AI-specific incident management program must address AI-unique failure modes such as model drift and data integrity attacks, which are not covered by generic IT incident processes. Validating these AI-specific response capabilities is the most important audit step.
Mandating retraining after every incident is overly prescriptive and may not always be appropriate; the program should assess whether retraining is needed rather than require it universally.
Using past incidents to categorize current ones is a useful practice but reflects reactive categorization rather than proactive readiness for AI-specific incident types.
AI systems are subject to unique threats including model drift (where model performance degrades over time as real-world data changes) and data integrity attacks (where adversarial actors manipulate training or input data). An incident management program must include specific detection and response procedures for these AI-specific scenarios to be considered adequately prepared. Without these, the program cannot effectively address the most distinctive and consequential AI incident types.
Prioritizing incidents by alignment with industry leading practices is a general approach that does not address the specific technical risks unique to AI systems.
Concept tested: AI incident management - model drift and data integrity response
Source: https://www.nist.gov/artificial-intelligence/ai-risk-management-framework
Topics
Community Discussion
No community discussion yet for this question.