District Admins: How to Tune AI Grading

Follow

AI grading is calibrated to state exemplars and rubrics to consistantly provide adjacant scoring.

District leaders can participate in this calibration process to help personalize feedback for specific needs or criteria. Click here for a click sheet explaining how, or view the slide show below.

First, you will need a district assessment with student work questions and a state rubric in your account. For help creating a question best suited for AI grading, click here.

  1. Edit the assessment (Lessons/Assessments>My Assessments>Actions>Edit) and navigate to the student work question.
  2. Click the Test/Tune AI Grading button, located on the right under the state rubric.
  3. Paste a sample student answer and click Test AI Grading to analyize feedback based on the current AI calibration.
  4. To adjust the calibration, click the Add Extra Scoring Instructions and type instructions.
  5. Click Save. Your instructions will be attached to the rubric and affect any AI grading no matter what assessment the rubric is attached to. When you return to an assessment any saved instructions will be available in the drop-down.
  6. Test AI Grading again. This time, it will take the extra scoring instructions into account.
  7. Continue to add and adjust extra scoring instructions until the AI is tuned to your liking.
  8. Click Close.
  9. Click Save Question

Note: Teachers can test the AI to see how it will respond, but they don't have the ability to tune the AI

 

Powered by Zendesk