Coral Cloud Resorts is about to start testing its concierge agent with guests. Which metrics should be captured to monitor the performance, correctness, and user experience?

Question

Options

• AAgent performance, token usage, and conversation duration
• BResponse performance, tone, and CSATs
• CResponse times, accuracy and relevance of answers, and resolution success

• A
  5% (1)
• B
  14% (3)
• C
  82% (18)

Explanation

Option C directly maps to the three dimensions stated in the question: 'response times' covers performance, 'accuracy and relevance of answers' covers correctness, and 'resolution success' covers user experience. Option A focuses on infrastructure-level metrics (token usage) that don't reflect guest experience quality. Option B includes tone and CSATs but omits accuracy/relevance, which is critical for a concierge agent providing factual information. C is the most complete and balanced set of metrics aligned to the stated monitoring goals.

No community discussion yet for this question.