A platform team is building a failure taxonomy for Copilot agent evaluations. Match each failure signal to the most appropriate root cause category. Which mapping is correct?
1. Agent used gh pr merge before review approval
2. Agent passed tests but misunderstood the acceptance rule
3. Agent could not install private packages during setup
4. Agent ignored a linked design file not present in the issue
A. Reasoning error
B. Tool misuse
C. Context gap
D. Environment issue
E. Reviewer preference conflict
F. Billing or usage limitChoose an answer
Tap an option to check your answer.
Correct answer: 1-B, 2-A, 3-D, 4-C.
Why this is the answer
The correct mapping is 1-B, 2-A, 3-D, 4-C. 1. "Agent used gh pr merge before review approval" indicates Tool misuse (B). The agent used a tool (gh pr merge) incorrectly by not adhering to the required approval workflow, demonstrating a misunderstanding or misapplication of the tool's appropriate use within the process. 2. "Agent passed tests but misunderstood the acceptance rule" points to a Reasoning error (A). The agent successfully executed the technical task (passing tests) but failed to correctly interpret the higher-level acceptance criteria, indicating a flaw in its understanding or logical processing of the requirements. 3. "Agent could not install private packages during setup" is an Environment issue (D). This problem stems from the execution environment lacking the necessary configuration or access to install dependencies, rather than a flaw in the agent's logic or tool usage. 4. "Agent ignored a linked design file not present in the issue" signifies a Context gap (C). The agent missed crucial information (the linked design file) because it wasn't directly provided within the immediate issue context, highlighting a failure to retrieve or incorporate relevant external information.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed