Objective
Approve or correct an AI criterion grade while preserving the original evaluation.
Before you begin
You need Quality: Manage and a completed scored evaluation in QA Analysis · QA Grades. Manager review applies to scored weighted and critical criteria; unscored insights are not grade decisions.
Resolution
- Open the run. Find the ticket in QA Grades and open its full run page. Select the overall ticket target or the agent target you intend to review.
- Read the evidence. Expand a criterion and compare the AI grade, frozen scorecard standard, cited evidence, and conversation. The AI result remains on record after a manager decision.
This stylized run view places conversation evidence beside a criterion grade and its manager review controls. The sample ticket and grades are illustrative. - Choose a decision. Under Manager review, select Approve AI grade if the grade stands. Select Disagree to choose a different grade allowed by the frozen scorecard, including Not applicable when appropriate. The replacement choices exclude the AI's existing grade.
- Add context and save. Add an optional comment, then select Save decision. Decisions are saved one criterion at a time and take effect immediately; there is no final review submission. The run refreshes the effective score and review count.
- Check the result. Confirm the effective score and critical result reflect your decisions. Open Show change history on a criterion to see earlier decisions. The AI score remains available for comparison.
Reviewing every criterion before publication is optional in the product, though your team may require it as a process. See How Manager Decisions Affect The Effective Score before publishing an agent grade.