AI-300 Exam Question 46
Drag and Drop Question
An organization operates a generative AI application in production by using Microsoft Foundry.
The application serves live user traffic and is updated by a data scientist team regularly as prompts and models evolve.
The application intermittently times out during production use, which requires ongoing visibility into runtime behavior.
The team must also validate model quality and safety before releasing new updates to avoid introducing regressions.
You need to apply the correct mechanisms for continuous runtime monitoring and for release time validation.
Which mechanisms should you use for each requirement? To answer, move the appropriate mechanisms to the correct requirements. You may use each mechanism once, more than once, or not at all. You may need to move the split bar between panes or scroll to view content.
NOTE: Each correct selection is worth one point.
An organization operates a generative AI application in production by using Microsoft Foundry.
The application serves live user traffic and is updated by a data scientist team regularly as prompts and models evolve.
The application intermittently times out during production use, which requires ongoing visibility into runtime behavior.
The team must also validate model quality and safety before releasing new updates to avoid introducing regressions.
You need to apply the correct mechanisms for continuous runtime monitoring and for release time validation.
Which mechanisms should you use for each requirement? To answer, move the appropriate mechanisms to the correct requirements. You may use each mechanism once, more than once, or not at all. You may need to move the split bar between panes or scroll to view content.
NOTE: Each correct selection is worth one point.
AI-300 Exam Question 47
A team develops and manages a conversational assistant by using Microsoft Foundry.
The team requires generative AI to automatically evaluate every pull request of an agentic application and fail the build if safety thresholds are exceeded.
You need to automate evaluations as part of CI.
What should you configure?
The team requires generative AI to automatically evaluate every pull request of an agentic application and fail the build if safety thresholds are exceeded.
You need to automate evaluations as part of CI.
What should you configure?
AI-300 Exam Question 48
Drag and Drop Question
A team maintains Infrastructure as Code (IaC) templates to provision Azure Machine Learning resources.
Provisioning must be triggered by changes in the templates and executed without manual intervention.
You need to automate resource provisioning.
Which action should you take for each requirement? To answer, move the appropriate actions to the correct requirements. You may use each action once, more than once, or not at all. You may need to move the split bar between panes or scroll to view content.
NOTE: Each correct selection is worth one point.
A team maintains Infrastructure as Code (IaC) templates to provision Azure Machine Learning resources.
Provisioning must be triggered by changes in the templates and executed without manual intervention.
You need to automate resource provisioning.
Which action should you take for each requirement? To answer, move the appropriate actions to the correct requirements. You may use each action once, more than once, or not at all. You may need to move the split bar between panes or scroll to view content.
NOTE: Each correct selection is worth one point.
AI-300 Exam Question 49
You are implementing hyperparameter tuning by using Bayesian sampling for an Azure ML Python SDK v2-based model training from a notebook. The notebook is in an Azure Machine Learning workspace. The notebook uses a training script that runs on a compute cluster with 20 nodes.
The code implements Bandit termination policy with slackjactor set to 0.2 and a sweep job with max_concurrent_trials set to 10.
You must increase effectiveness of the tuning process by improving sampling convergence.
You need to select which sampling convergence to use.
What should you select?
The code implements Bandit termination policy with slackjactor set to 0.2 and a sweep job with max_concurrent_trials set to 10.
You must increase effectiveness of the tuning process by improving sampling convergence.
You need to select which sampling convergence to use.
What should you select?
AI-300 Exam Question 50
Hotspot Question
You manage a Microsoft Foundry project.
You plan to build a RAG solution.
The solution must include two models:
- One for text output, named Model1. This model must resemble human
language and read naturally.
- One for creating embeddings, named Model2. This model must maximize
the retrieval of relevant results (high recall) while minimizing
irrelevant or incorrect matches (high precision).
You need to compare different models by using benchmarking metrics to select the appropriate models for Model1 and Model2.
Which benchmarking metric should you select for each model? To answer, select the appropriate options in the answer area.
NOTE: Each correct selection is worth one point.
You manage a Microsoft Foundry project.
You plan to build a RAG solution.
The solution must include two models:
- One for text output, named Model1. This model must resemble human
language and read naturally.
- One for creating embeddings, named Model2. This model must maximize
the retrieval of relevant results (high recall) while minimizing
irrelevant or incorrect matches (high precision).
You need to compare different models by using benchmarking metrics to select the appropriate models for Model1 and Model2.
Which benchmarking metric should you select for each model? To answer, select the appropriate options in the answer area.
NOTE: Each correct selection is worth one point.
