Notla

Grading and results

Autograde settings

Notla's AI-assisted grading is configured per question. This page covers how to set the instructions given to the AI, the confidence thresholds and preview limits, and how to choose which questions to autograde.


Overview

To reach the autograde page, open the Review Papers step in the left menu and click the *Autograde: Not started* link in the top right. The page that opens has two parts: the AI configuration area and the list of questions to autograde.


AI instructions

The Instructions section lets you write a clear command for how the AI should grade that question. Use it for acceptable alternative answers, when to award partial credit, or spelling mistakes that should be ignored.

Autograder Settings page; description at the top: 'Configure autograde settings for this question'; large empty 'Instructions' text area in the middle, with 'Give the AI clear instructions for grading this question' below; Confidence Threshold slider (value 0.70) and Preview Limit slider further down.
Autograde configuration page for a question
  • If the Instructions field is left empty, the AI uses only the question title and grading criteria as reference.
  • Clear, short, example-focused instructions produce consistent results (for example: *"Check heterogeneous examples; answers such as tea-water or oil-water are accepted; if a class name is written, mark it invalid."* ).
  • The Grading Status box shows the current state of the setting (Not started, In progress, Completed). Autograder Status: Approved confirms that the model is ready to use.

Confidence threshold and preview limit

On the same page, two sliders sit below the instructions:

  • Confidence Threshold (0–1, default 0.70): if the AI's confidence in a grade is below this threshold, the grade is marked Needs Review and held for manual checking. A higher threshold means more manual review; a lower threshold means more automatic decisions.
  • Preview Limit (0–100, can be turned off): limits how many group items can be previewed before autograde runs; useful for a quick check in small classes.

Preview Limit off

The same section has a small toggle; when it is off, the feature is disabled and all submissions are graded directly without a preview.

Which questions will be autograded?

The lower part of the page lists every question in the assignment/exam under 'Select questions to autograde'. Each row has a checkbox and the current status (Not started, In progress, Completed).

Lower half of the same page; under 'Select questions to autograde', Q1, Q2, Q3, Q4 are checked, each with a 'Not started' badge; 'Select All / Deselect All' links on the right; green 'Re-run Autograde (6 Questions)' button at the bottom right; 'Save Settings' button at the bottom left.
Question selection list for autograde
  • Select All and Deselect All apply a bulk selection.
  • The status badge on the right of each question summarizes the previous run: Not started, In progress, Completed.
  • Save Settings stores changes without running autograde; useful if you want to come back later.
  • Re-run Autograde (N Questions) processes the selected questions again; existing grading results are overwritten.

Running autograde

When autograde starts, an orange 'Autograder settings are being processed. Please wait.' warning appears and the status of the selected questions updates to 'In progress'.

Same page; confidence threshold sliders at the top, then a blue 'Grading Status: In progress / Autograder Status: Approved' box, then an orange 'Autograder settings are being processed. Please wait.' warning; in the question list Q1 has an 'In progress' badge, the others 'Not started'.
Autograde is running
  • Duration depends on the number of questions and submissions; in large classes it can take more than a few minutes.
  • You can change other settings while it runs, but a new run waits until the current one finishes.
  • Each finished question updates to Completed; when you return to Review Papers you can preview the graded papers.

Important

Autograde only runs for students who have a submission. Students in the "No submission" state are not affected.

Next step

When autograde finishes, review the results and make manual corrections. Continue inReviewing papers.

Previous
Uploading student papers