Section2.2 - Data Preparationand4.1 - Challenges in Testing AI-Based Systemsdescribe difficulties in obtaining and managing large, representative datasets. AI-based systems requirerealistic, diverse, and representativedata reflecting real-world variations. The syllabus emphasizes that assembling such datasets is time-consuming, resource-intensive, and often constrained by availability, privacy, or domain complexity.
Option B directly corresponds to these documented challenges.
Option A is incorrect: using the same implementation risksdefect masking, not preventing it; the syllabus warns against this practice. Option C is incorrect because real-world data naturally evolves, and the syllabus notes thatdriftis normal; expecting stable input data contradicts operational reality. Option D is incorrect:
although data privacy is important, the syllabus does not claim that artificially generated data always requires legal approval, nor that sanitization/encryption is mandatory for synthetic data.
Thus,Option Baccurately reflects syllabus-defined difficulties in producing representative test data.

From the confusion matrix:
* True Positives (TP) = 15
* False Positives (FP) = 5
* False Negatives (FN) = 15
* True Negatives (TN) = 65
Accuracy= (TP + TN) / Total
= (15 + 65) / 100
=80%
Precision= TP / (TP + FP)
= 15 / (15 + 5)
= 15 / 20
=75%
Section3.2 - Functional Performance Criteriain the syllabus explains accuracy and precision exactly these ways when evaluating ML classification performance.
Option B is therefore the only correct pair of values.

The syllabus explains:
"Where the internal structure of an AI-based system is too complex for humans to understand, the system can only be tested as a black box. Even when the internal structure is visible, this provides no additional useful information to help with testing." This confirms that black-box testing is chosen because the tester does not need to understand the system's internal structure.
(Reference: ISTQB CT-AI Syllabus v1.0, Section 8.5, page 61 of 99)

The question asks which test is least likely to be performed during the ML model testing phase. Let's consider each option:
* Testing the accuracy of the classification model (A): Accuracy testing is a fundamental part of the ML model testing phase. It ensures that the model correctly classifies the data as intended and meets the required performance metrics.
* Testing the API of the service powered by the ML model (B): Testing the API is crucial, especially if the ML model is deployed as part of a service. This ensures that the service integrates well with other systems and that the API performs as expected.
* Testing the speed of the training of the model (C): This is least likely to be part of the ML model testing phase. The speed of training is more relevant during the development phase when optimizing and tuning the model. During testing, the focus is more on the model's performance and behavior rather than how quickly it was trained.
* Testing the speed of the prediction by the model (D): Testing the speed of prediction is important to ensure that the model meets performance requirements in a production environment, especially for real- time applications.
:
ISTQB CT-AI Syllabus Section 3.2 on ML Workflow and Section 5 on ML Functional Performance Metrics discuss the focus of testing during the model testing phase, which includes accuracy and prediction speed but not the training speed.

A . Identifying suitable tests by looking at the complexity of the test cases.
While complexity analysis can help in selecting important test cases, it does not directly address the issue of optimizing the entire regression suite effectively.
B . Using a random subset of tests.
Randomly selecting test cases may miss critical tests and does not ensure an optimized regression suite. This approach lacks a systematic method for ensuring comprehensive coverage.
C . Automating test scripts using AI-based test automation tools.
Automation helps in running tests efficiently but does not inherently optimize the selection of tests to prevent the suite from growing too large.
D . Using an AI-based tool to optimize the regression test suite by analyzing past test results.
This is the most effective approach as AI-based tools can analyze historical test data, identify patterns, and prioritize tests that are more likely to catch defects based on past results. This method ensures an optimized and manageable regression test suite by focusing on the most impactful test cases.
Therefore, the correct answer is D because using an AI-based tool to analyze past test results is the best option to optimize regression test selection and manage the size of the regression suite effectively.