An engine manufacturing facility wants to apply machine learning to detect faulty bolts. Which of the following would result in bias in the model?
Correct Answer: A
The syllabus defines bias as: "Bias is the systematic difference in treatment of certain objects, people or groups in comparison to others." It also discusses: "Sample bias can occur if the data used for training the model does not represent the operational environment, or if some relevant faulty conditions are excluded deliberately." (Reference: ISTQB CT-AI Syllabus v1.0, Section 7.6 and 8.3)
CT-AI Exam Question 17
When verifying that an autonomous AI-based system is acting appropriately, which of the following are MOST important to include?
Correct Answer: C
The syllabus highlights that testing for unnecessary human intervention is a key focus for autonomous AI- based systems: "For autonomous AI-based systems, testers must ensure that the system does not prompt for unnecessary human intervention, as this contradicts the autonomy concept." (Reference: ISTQB CT-AI Syllabus v1.0, Section 8.2, page 59 of 99)
CT-AI Exam Question 18
Which of the following is an example of a clustering problem that can be resolved by unsupervised learning?
Correct Answer: A
The syllabus defines clustering as: "Clustering: This is when the problem requires the identification of similarities in input data points that allows them to be grouped based on common characteristics or attributes. For example, clustering is used to categorize different types of customers for the purpose of marketing." (Reference: ISTQB CT-AI Syllabus v1.0, Section 3.1.2, page 26 of 99)
CT-AI Exam Question 19
Which ONE of the following combinations of Training, Validation, Testing data is used during the process of learning/creating the model? SELECT ONE OPTION
Correct Answer: A
The process of developing a machine learning model typically involves the use of three types of datasets: Training Data: This is used to train the model, i.e., to learn the patterns and relationships in the data. Validation Data: This is used to tune the model's hyperparameters and to prevent overfitting during the training process. Test Data: This is used to evaluate the final model's performance and to estimate how it will perform on unseen data. Let's analyze each option: A . Training data - validation data - test data This option correctly includes all three types of datasets used in the process of creating and validating a model. The training data is used for learning, validation data for tuning, and test data for final evaluation. B . Training data - validation data This option misses the test data, which is crucial for evaluating the model's performance on unseen data after the training and validation phases. C . Training data - test data This option misses the validation data, which is important for tuning the model and preventing overfitting during training. D . Validation data - test data This option misses the training data, which is essential for the initial learning phase of the model. Therefore, the correct answer is A because it includes all necessary datasets used during the process of learning and creating the model: training, validation, and test data.
CT-AI Exam Question 20
You have been developing test automation for an e-commerce system. One of the problems you are seeing is that object recognition in the GUI is having frequent failures. You have determined this is because the developers are changing the identifiers when they make code updates. How could AI help make the automation more reliable?
Correct Answer: A
The syllabus discusses using AI-based tools to reduce GUI test brittleness: "AI can be used to reduce the brittleness of this approach, by employing AI-based tools to identify the correct objects using various criteria (e.g., XPath, label, id, class, X/Y coordinates), and to choose the historically most stable identification criteria." (Reference: ISTQB CT-AI Syllabus v1.0, Section 11.6.1)