CT-AI Exam Questions
159 real CT-AI exam questions with expert-verified answers and explanations. Page 3 of 4.
- Question #101Testing of AI-based Systems
A team of software testers is attempting to create an AI algorithm to assist in software testing. This particular team has gone through over 40 iterations of testing and cannot aff...
test optimizationAI-assisted testingregression test reductiontest selection - Question #102Machine Learning (ML)
Which of the following is one of the reasons for data mislabelling?
data mislabellingtraining data qualitydomain knowledgedata labelling - Question #103Specific Approaches to Testing AI-based Systems
A company is using a spam filter to attempt to identify which emails should be marked as spam. Detection rules are created by the filter that causes a message to be classified as s...
exploratory data analysisadversarial attacksoutlier detectionspam filter - Question #104Testing of AI-based Systems
An airline has created a ML model to project fuel requirements for future flights. The model imports weather data such as wind speeds and temperatures, calculates flight routes bas...
model driftdata driftseasonal variationmodel monitoring - Question #105Quality Characteristics for AI-based Systems
Which of the following is an example of an input change where it would be expected that the AI system should be able to adapt?
adaptabilityinput variationrobustnessAI characteristics - Question #106Machine Learning (ML)
You are using a neural network to train a robot vacuum to navigate without bumping into objects. You set up a reward scheme that encourages speed but discourages hitting the bumper...
reward hackingreinforcement learningreward functionunintended behavior - Question #107Testing of AI-based Systems
There is a growing backlog of unresolved defects for your project. You know the developers have an ML model that they have created which has learned which developers work on which...
defect assignmentML-assisted testingload balancingdefect management - Question #108Machine Learning (ML)
Which of the following problems would best be solved using the supervised learning category of regression?
supervised learningregressionML categoriescontinuous output prediction - Question #109Testing of AI-based Systems
Which of the following is a problem with AI-generated test cases that are generated from the requirements?
AI-generated test casesexpected resultsrequirements-based testingtest automation - Question #110Specific Approaches to Testing AI-based Systems
Which of the following approaches would help overcome testing challenges associated with probabilistic and non-deterministic AI-based systems?
non-determinismprobabilistic systemsstatistical test validitytest repetition - Question #111Machine Learning (ML)
Which of the below TWO examples of AI system behavior are reward hacking:
reward hackingAI behaviorreinforcement learningunintended outcomes - Question #112Specific Approaches to Testing AI-based Systems
Which ONE of the below types of testing is NOT a type of experience-based testing applied to an AI-based system?
experience-based testingexploratory testingbias identificationtest techniques - Question #113Quality Characteristics for AI-based Systems
A robotic AI-based system is being built by a logistics company to operate within its unmanned warehouses. The warehouses can all be very different and new ones are being added eac...
adaptabilityautonomous systemsacceptance criteriatransfer learning - Question #114Test Strategies for AI-based Systems
Which ONE of the below statements BEST describes why test environments for autonomous systems might need to be different to other test environments?
autonomous systemstest environmentsimulationextreme scenarios - Question #115Testing of AI-based Systems
Which ONE of the following would be the LEAST effective input to an AI-based test optimization process?
test optimizationAI-assisted testingtest prioritizationdefect prediction - Question #116Ethics and Bias in AI Testing
Which ONE of the following statements is true about dynamic testing for inappropriate bias?
dynamic testinginappropriate biasprotected characteristicsdata attributes - Question #117Specific Approaches to Testing AI-based Systems
Which ONE of the following options for a test basis would give the LEAST coverage when using AI-based test generation?
AI-based test generationtest basiscoveragepseudo-oracle - Question #118Specific Approaches to Testing AI-based Systems
Which ONE of the following would be the MOST effective input to an AI-based defect prediction tool?
defect predictioncyclomatic complexitycode metricsAI-based testing - Question #119Specific Approaches to Testing AI-based Systems
In which ONE of the following situations would an ML model be MOST effective at determining the criticality of new defects?
defect criticalityML model effectivenesstraining data qualitydefect records - Question #120Introduction to AI and AI Testing
Which of the following technologies for implementing AI is considered to be a reasoning technique?
reasoning techniquesdeductive classifiersAI technologiesknowledge-based AI - Question #121Introduction to AI and AI Testing
Which of the following describes the AI effect?
AI effectAI definitionAI perceptionAI history - Question #122Machine Learning (ML)
A system is to be developed to detect lung cancer using X-ray images. Which statement BEST describes the difference between a conventional system and an AI system with supervised m...
supervised learningconventional vs AI systemspattern recognitiontraining data - Question #123Test Strategies for AI-based Systems
You are developing a "flower" ML model... Which of the following describes an objection that you can NEGLECT in your risk assessment?
ML model reuserisk assessmentmisclassificationtransfer learning - Question #124Quality Characteristics for AI-based Systems
Which characteristic of AI-based systems makes it difficult to ensure they are safe (e.g., not harming humans)?
AI safetycomplexityquality characteristicsinterpretability - Question #125Quality Characteristics for AI-based Systems
Which statement regarding flexibility and adaptability of AI-based systems is correct?
adaptabilityflexibilityself-learningquality characteristics - Question #126Ethics and Bias in AI Testing
The training of an ML model... What type of bias is LEAST important to look for when testing the model?
bias typesautomation biasalgorithmic biassample bias - Question #127Quality Characteristics for AI-based Systems
Which of the following statements about explainable AI is correct?
explainable AIinterpretabilityuser confidenceXAI - Question #128Machine Learning (ML)
Which supervised-learning classification/regression statement is correct?
classificationregressionsupervised learningML fundamentals - Question #129Machine Learning (ML)
Which of the following statements about reinforcement learning is correct?
reinforcement learningreward functionagentenvironment interaction - Question #130Machine Learning (ML)
Which of the following options is an example of the concept of overfitting?
overfittinggeneralizationtraining data biasmodel performance - Question #131Machine Learning (ML)
Which machine learning approach is most suitable for predicting customer purchase probability?
supervised learningclassificationML approach selectionprediction - Question #132Machine Learning (ML)
Which data-labeling approach uses a two-step process where labeling is first done by a tool and then verified or completed by a human?
data labelingAI-assisted labelingML workflowhuman-in-the-loop - Question #133Machine Learning (ML)
Which statement regarding data preparation in the ML workflow is correct?
data preparationdata gatheringdata qualityML workflow - Question #134Machine Learning (ML)
Which of the following descriptions of quality aspects of a data set is correct?
data qualityincomplete datadataset qualityunbalanced data - Question #135Machine Learning (ML)
Which statement regarding the use of training, validation, and test data sets is correct?
training data splitvalidation datatest datacross-validation - Question #136Machine Learning (ML)
Which of the following statements about ML functional performance metrics is correct?
clustering metricssilhouette coefficientROC curveregression metrics - Question #137Machine Learning (ML)
Which option gives the correct values for accuracy and precision from the confusion matrix?
confusion matrixaccuracyprecisionperformance metrics - Question #138Machine Learning (ML)
Which performance metric is BEST suited to assess the quality of trained models detecting fraudulent credit card transactions?
F1 scoreimbalanced classesfraud detectionsensitivity - Question #139Machine Learning (ML)
Which of the following statements about the structure and function of neural networks is true?
neural network architectureweightsbias neuronperceptron - Question #140Specific Approaches to Testing AI-based Systems
Which of the following neural network coverage criteria can be adapted for its application?
neural network coveragethreshold coverageneuron coveragestructural coverage - Question #141Testing of AI-based Systems
Which statement describes factors related to test data that make testing AI-based systems difficult?
test data challengesdata managementlarge datasetsAI testing difficulties - Question #142Testing of AI-based Systems
Which statement about testing levels for AI-based systems is correct?
testing levelsML model testingacceptance testingsystem testing - Question #143Ethics and Bias in AI Testing
Which statement about automation bias is correct?
automation biashuman factorsAI-assisted decisionsbias types - Question #144Test Strategies for AI-based Systems
Which of the following decisions is BEST as a test approach for the described situation?
test approach selectionregression testingexploratory testingimage data - Question #145Testing of AI-based Systems
Which challenge to testing self-learning systems puts you at risk of a data attack?
data poisoningself-learning systemsadversarial attackssecurity testing - Question #146Ethics and Bias in AI Testing
How can a tester check the system for bias as part of a review of data sources, acquisition, and preprocessing?
bias detectiondata preprocessing reviewdata acquisitionLIME - Question #147Quality Characteristics for AI-based Systems
Which statement regarding testing transparency, explainability, or interpretability is MOST correct?
explainability testinginterpretabilitytransparencyLIME - Question #148Test Strategies for AI-based Systems
Which AI-specific test objective and acceptance criterion should be selected MOST LIKELY for testing GPT_Legal?
test objectivesacceptance criteriaNLP testingbias-free data - Question #149Specific Approaches to Testing AI-based Systems
Which statement about testing to prevent data poisoning and adversarial attacks is correct?
adversarial testingdata poisoningvulnerability identificationsecurity testing - Question #150Specific Approaches to Testing AI-based Systems
Which statement regarding pairwise testing in an AI-based automotive lane-keeping assist system is correct?
pairwise testingcombinatorial testingautomotive AIparameter interaction