Customer feedback for an AI chatbot has a high-rate of non-answers, which is causing higher central processing unit (CPU) utilization. Which of the following should be implemented?

The correct answer is B. Response confidence level. Implementing a response confidence level ensures the chatbot only provides answers when the model is sufficiently confident. This reduces irrelevant or empty responses, improving user experience and lowering unnecessary CPU utilization.

Security Architecture and Tool Sets

Question

Options

AGuardrails
BResponse confidence level
CPrompt logging
DCost monitoring

How the community answered

(32 responses)

A
9% (3)
B
84% (27)
C
3% (1)
D
3% (1)

Explanation

Implementing a response confidence level ensures the chatbot only provides answers when the model is sufficiently confident. This reduces irrelevant or empty responses, improving user experience and lowering unnecessary CPU utilization.

Topics

#AI chatbot#response confidence#LLM performance#hallucination mitigation

Community Discussion

No community discussion yet for this question.

Full CY0-001 Practice