A CISO has been tasked with providing key performance indicators (KPIs) on the organization's newly launched AI chatbot. Which of the following are the BEST metrics for the CISO to recommend?

The correct answer is D. Error rate and bias detection. A CISO's mandate is security, risk, and governance - not business performance. Error rate measures how frequently the chatbot produces incorrect, harmful, or unexpected outputs, which is a security and reliability concern. Bias detection identifies whether the AI is making…

AI Security Risk Management

Question

Options

AExplainability and F1 score
BCustomer effort score and user retention rate
CResponse time and throughput
DError rate and bias detection

How the community answered

(36 responses)

A
11% (4)
B
3% (1)
C
6% (2)
D
81% (29)

Explanation

A CISO's mandate is security, risk, and governance - not business performance. Error rate measures how frequently the chatbot produces incorrect, harmful, or unexpected outputs, which is a security and reliability concern. Bias detection identifies whether the AI is making discriminatory or skewed decisions, a key governance obligation. The other options address different concerns: explainability and F1 score (A) are more ML-engineering metrics; customer effort score and retention (B) are product/UX metrics; response time and throughput (C) are operational performance metrics - all outside the CISO's primary KPI scope.

Topics

#AI Security KPIs#AI Risk Management#AI Bias Detection#AI System Integrity

Community Discussion

No community discussion yet for this question.

Full AAISM Practice