A CISO must provide KPIs for the organization's newly deployed AI chatbot. Which metrics are BEST?

The correct answer is B. Error rate and bias detection. A CISO's KPIs must reflect security and governance concerns. Error rate and bias detection (B) are directly relevant: error rate signals when the chatbot is producing incorrect or harmful outputs (a security and liability concern), and bias detection tracks whether the AI is…

AI Security Strategy and Governance

Question

Options

AResponse time and throughput
BError rate and bias detection
CCustomer effort score and user retention
DExplainability and F1 score

How the community answered

(30 responses)

A
10% (3)
B
70% (21)
C
17% (5)
D
3% (1)

Explanation

A CISO's KPIs must reflect security and governance concerns. Error rate and bias detection (B) are directly relevant: error rate signals when the chatbot is producing incorrect or harmful outputs (a security and liability concern), and bias detection tracks whether the AI is treating users equitably - a key AI governance requirement. Response time and throughput (A) are infrastructure/performance metrics. Customer effort score and retention (C) are business/UX metrics. Explainability and F1 score (D) are model-level metrics more relevant to data science teams than executive security KPIs.

Topics

#AI Chatbot KPIs#Bias detection#AI error rate#Responsible AI metrics

Community Discussion

No community discussion yet for this question.

Full AAISM Practice