Reviewing papers

The Review Papers step lets you go through autograde results question by question and correct them by hand when needed. Grades with enough confidence are marked Ready automatically; lower-confidence ones are listed as Needs Review and wait for your approval.

Question list

The main Review Papers screen summarizes every question in the assignment/exam and its grading status. The 'Autograde: Completed' badge at the top confirms that the automatic flow has finished.

• Each row shows how many submissions are ungraded (for example: 12 Ungraded) and the overall progress percentage.
• Clicking a question opens the detail page that lists all student papers for that question.
• The Grade all questions link in the top right starts a bulk review flow.
• The Publish Grades button at the bottom of the page warns you until every question is finished; ignoring the warning when unfinished submissions are not marked Ready leaves publishing incomplete.

Reviewing a question

Clicking a question opens a table of students one by one. The badge on the right of each row shows that student's submission status: 'Ready' means the automatic grade is acceptable; 'Needs Review' means it is waiting for your approval.

• Ready: the AI assigned a grade and it is above the confidence threshold, so it can be approved.
• Needs Review: the AI was not confident, or found the answer unreadable or outside the criteria; it must be reviewed manually.
• Start from first ungraded takes you to the next review; you can view each answer one by one and change the score or criterion.
• Start from beginning reopens all submissions in order; useful when you want to check everything manually.

“Needs Review” submissions

Opening a submission shows a two-pane review screen: the student's scanned paper on the left, and on the right the criterion the AI chose for that question, its rationale, and the confidence percentage. You can accept the AI suggestion, pick a different criterion, or change the score by hand.

• The Rationale box in the right panel briefly explains why the AI made its choice. The Confidence bar next to it (for example: 58%) shows how sure it is; lower-confidence decisions are worth a closer look.
• The AI suggestion badge marks the criterion the AI selected. To accept it, press Finish Review; click a different criterion to change the choice immediately.
• Use the tools in the top bar of the paper image on the left — *zoom*, *pen*, *text*, and *hand* — to inspect the page; drawing tools help highlight an unreadable area or add a note.
• The Grade: 0.0 / 100.0 counter at the top reflects the paper's current total; it updates automatically when the criterion selection changes.
• The Next (Unreviewed) button at the bottom right jumps to the next Needs Review submission; this is the fastest way to work through only the low-confidence cases in order.
• To re-run an AI that graded incorrectly, return toautograde settings, update the instructions, and start again.

Approving a question

After you review every 'Needs Review' submission for a question, you return to the student table. When every row is 'Ready' or 'Reviewed', a green 'Ready to approve' badge and an 'Approve' button appear in the bottom bar; pressing that button closes the question for good and makes the results ready to publish.

• Ready: a submission that passed the AI's confidence threshold and needs no manual change. Reviewed: a submission that was previously Needs Review and has now been resolved with your approval.
• The Groups: Completed badge in the top right confirms that every criterion group for this question is closed consistently; if the badge is yellow, a group is still incomplete.
• The Ready to approve badge appears only when every submission has been handled (progress bar at 100%). If any submission is left unfinished, the *Approve* button stays disabled.
• Approve locks all submissions for that question and marks the row with a green check on the *Back to questions* page. You can still make changes after approval and before publishing grades, but each change requires approving the question again.
• Start from beginning on the right reopens all submissions in order; Review This Question is used for a summary check of the review flow.