CT-AI · Question #72
Which ONE of the following requirements for an AI-based system is MOST likely to cause a challenge for testing?
The correct answer is A. The system should be able to accept natural language input on a variety of topics and respond. Testing an AI-based system that accepts natural language input on a variety of topics and responds correctly is particularly challenging because natural language processing (NLP) involves handling vast variability in language, context, and possible interpretations. This makes…
Question
Which ONE of the following requirements for an AI-based system is MOST likely to cause a challenge for testing?
Options
- AThe system should be able to accept natural language input on a variety of topics and respond
- BThe system should respond more quickly than the system it is replacing
- CThe system should be 100% accurate with no tolerance for failure
- DThe system should not require human intervention until a specific failure scenario is encountered
How the community answered
(43 responses)- A70% (30)
- B19% (8)
- C9% (4)
- D2% (1)
Explanation
Testing an AI-based system that accepts natural language input on a variety of topics and responds correctly is particularly challenging because natural language processing (NLP) involves handling vast variability in language, context, and possible interpretations. This makes it difficult to define precise expected outcomes and test all possible inputs and responses.
Topics
Community Discussion
No community discussion yet for this question.