CCAR-F Exam Question 51
Your document extraction tool uses ML models to extract invoice fields (vendor, amount, date).
The models return confidence scores (0.0-1.0) for each extracted field. In production, you observe: (1) the agent proceeds with low-confidence extractions that are incorrect 23% of the time, and (2) the agent requests unnecessary human review for 31% of extractions that were actually correct. How should you restructure the tool's output?
The models return confidence scores (0.0-1.0) for each extracted field. In production, you observe: (1) the agent proceeds with low-confidence extractions that are incorrect 23% of the time, and (2) the agent requests unnecessary human review for 31% of extractions that were actually correct. How should you restructure the tool's output?
CCAR-F Exam Question 52
Your automated code review is missing genuine bugs in pull requests. Investigation reveals that the review prompt includes this instruction: "Only flag critical issues that would definitely cause production failures. Ignore minor concerns and anything you are uncertain about." Developers confirm that some missed findings are genuine logic errors that the model investigated but chose not to report. The team requires the review output to remain structured, with every finding tagged with metadata, and actionable. Which prompt change both removes the cause of the suppressed findings and preserves structured, tagged output for downstream filtering?
CCAR-F Exam Question 53
During testing, you find that when a customer says "I need a refund for my recent purchase," the agent calls process _refund immediately - but populates the required order_id parameter with a plausible-looking but fabricated value instead of first calling lookup_order to retrieve the actual order ID. The refund call fails because the fabricated ID doesn't exist. Which change directly addresses the root cause of the agent fabricating the order_id value?
CCAR-F Exam Question 54
You are building a structured data extraction system using Claude. The system extracts information from unstructured documents, validates the output using JavaScript Object Notation (JSON) schemas, and maintains high accuracy. It must handle edge cases gracefully and integrate with downstream systems.
Your extraction pipeline processes restaurant menus and must output structured JSON with fields for item names, descriptions, prices, and dietary tags. Some menus use inconsistent formatting-- prices as "$12" vs "12.00", dietary info as icons vs text.
What's the most reliable approach?
Your extraction pipeline processes restaurant menus and must output structured JSON with fields for item names, descriptions, prices, and dietary tags. Some menus use inconsistent formatting-- prices as "$12" vs "12.00", dietary info as icons vs text.
What's the most reliable approach?
CCAR-F Exam Question 55
Production monitoring shows that follow-up queries like "summarize what we learned about market trends" consistently take 40+ seconds. Investigation reveals the coordinator spawns the synthesis subagent for each summarization request, passing 80K+ tokens of accumulated findings. The coordinator already has these findings in its context from orchestrating the research.
What's the most effective way to improve response time for these follow-up summaries?
What's the most effective way to improve response time for these follow-up summaries?
