Online Access Free AAIA Exam Questions

Which technique is MOST useful for identifying whether a model's outputs disproportionately disadvantage a protected group?

• A.Confusion matrix analysis
• B.Disparate impact / fairness metric analysis across subgroups
• C.Feature importance ranking
• D.Cross-validation

What is the PRIMARY purpose of a model inventory in AI governance?

• A.To store training datasets
• B.To log user login attempts
• C.To maintain visibility into all AI models in use, their risk classification, and ownership
• D.To track software licensing costs

An IS auditor is reviewing the company's AI procedure. Which of the following would be the MOST critical gap?

• A.Procedures for human oversight are not described.
• B.Mandatory assessments required for critical systems are not specified.
• C.The use of external data sources is not specified.
• D.Privacy principles are not defined in the AI procedure.

An IS auditor is auditing a financial system in which a generative AI tool is used to identify trends in batches of 4,000 rows, while the generative AI tool has a limit of 3,000 tokens. Which of the following is the GREATEST concern?

• A.The AI will process only a portion of the data set.
• B.The AI will prioritize high-value entries.
• C.The AI output will be biased toward the first 3,000 tokens.
• D.The AI will reject the data set and not analyze the data.

Which of the following is the PRIMARY advantage of using K-fold cross validation when evaluating the performance of a machine learning (ML) model?

• A.It enables the reduction of model bias by setting the K variable to higher values.
• B.It helps minimize computational costs when evaluating complex models.
• C.It facilitates performing regressions on smaller data sets.
• D.It uses multiple training and testing cycles to minimize overfitting.