CRISC · Question #528
Which of the following is the GREATEST risk of relying on artificial intelligence (Al) within heuristic security systems?
The correct answer is B. Malicious activity may inadvertently be classified as normal during baselining. The greatest risk of relying on AI in heuristic security systems is that malicious activity may inadvertently be classified as normal during the baselining process.
Question
Which of the following is the GREATEST risk of relying on artificial intelligence (Al) within heuristic security systems?
Options
- AAl may result in less reliance on human intervention.
- BMalicious activity may inadvertently be classified as normal during baselining.
- CRisk assessments of heuristic security systems are more difficult.
- DPredefined patterns of malicious activity may quickly become outdated.
How the community answered
(22 responses)- A5% (1)
- B50% (11)
- C32% (7)
- D14% (3)
Why each option
The greatest risk of relying on AI in heuristic security systems is that malicious activity may inadvertently be classified as normal during the baselining process.
Less reliance on human intervention can be a benefit of AI, improving efficiency, rather than a primary risk.
Heuristic security systems often use AI to learn 'normal' behavior patterns and flag deviations. If initial training data or ongoing learning includes malicious activities that go undetected, the AI may baseline these activities as normal, allowing future similar attacks to pass without detection and creating a critical vulnerability.
While risk assessments of complex AI systems can be challenging, this is a procedural difficulty rather than a direct security failure inherent in the AI's operation.
Predefined patterns becoming outdated is a limitation of signature-based systems, whereas heuristic/AI systems are designed to detect novel threats based on behavior, making this less of a direct risk for them.
Concept tested: AI/ML security system risks
Topics
Community Discussion
No community discussion yet for this question.