An organization is planning to commission a third-party AI system to make decisions using sensitive data. Which of the following metrics is MOST important for the organization to consider?

The correct answer is D. Accuracy thresholds. When AI systems make consequential decisions over sensitive data, AAISM requires explicit performance thresholds tied to decision quality--i.e., accuracy (and related error/false-rate limits) aligned to business risk appetite and regulatory expectations. Availability and latency

AI Security Risk Management

Question

Options

AModel response time
BService availability
CAccessibility rating
DAccuracy thresholds

How the community answered

(50 responses)

A
22% (11)
B
6% (3)
C
14% (7)
D
58% (29)

Explanation

When AI systems make consequential decisions over sensitive data, AAISM requires explicit performance thresholds tied to decision quality--i.e., accuracy (and related error/false-rate limits) aligned to business risk appetite and regulatory expectations. Availability and latency are important service metrics, but decision integrity and error bounds are primary risk drivers in sensitive contexts. Establishing, monitoring, and enforcing minimum accuracy thresholds (with subgroup performance checks) is essential to reduce harm, ensure fairness/compliance, and support auditability.

Topics

#AI performance metrics#Data sensitivity#AI decision-making#AI risk management

Community Discussion

No community discussion yet for this question.

Full AAISM Practice