The Multiple Evaluators feature in Assignments allows instructors to assign student assignment submissions to specific graders. This allows simple management of grading distribution to instructors for a large class, and additional settings enable the option for multiple graders to provide feedback before a final evaluation is published. Instructors can also prevent certain evaluators from being able to publish/release grades and feedback.
Select Evaluators
By default, all who have permission to grade (those with the role of Instructor) are able to evaluate and publish all submissions. To manage evaluators and who can publish do the following:
1. While creating or editing an assignment, expand the Evaluation & Feedback section
2. Select "Select Evaluators"
Only those with permission to grade can be selected as an evaluator. This includes those with the role of Instructor.
3. In the pop-up, select the individual(s) that you would like to be an evaluator for this assignment and click Done.
You can click on the checkbox at the top to select everyone within the list.
Those with permission to grade (Instructor) will always be able to see student submissions and override student grades in the Gradebook but if they are not selected as an evaluator, they will not be able to provide or change the assigned grades and feedback inside the Assignment tools for this assignment.
Select who can publish the final evaluation to students
Under "Publishers", in the drop-down menu, select one of:
- All evaluators can publish any evaluations
- Evaluators can only publish their own evaluations
- Manually select publishers
- As the instructor, if you want to publish all the grades and feedback after you have reviewed the grades and feedback your fellow colleagues provided, select this option.
Manually select publishers
If you select this option, you have to click on the "Select Publishers" button, select your name, and click "Done".
Allocate students to specific evaluators
By default, all evaluators can grade all submissions. To allocate certain students to certain evaluators, click "Manage Allocations".
You can have (1)Brightspace automatically allocate students to evaluators, or you can (3)manually allocate students to evaluators.
1. For automatic allocation, select from the drop-down list one of:
- Allocate all evaluators to every learner
- Randomly allocate 1 evaluator to every learner evenly
(If you have selected more than 2 evaluators in the previous steps above, you will see further options)
2. Click on "Apply Allocation Method"
You can still make manual edits, if necessary after applying the allocation.
3. For manual allocation, add or remove checkboxes in the boxes that intersect an evaluators and a student name.
4. When done managing allocation, click "Done" to apply your changes.
Coordinate Multiple Evaluators
Pay attention, depending on what setting you choose you cannot change it after the assignment has been locked.
If you have selected to allocate multiple evaluators to each student, choose how the evaluation process works. Select one of the two options:
One shared evaluation
All evaluators work on the same evaluation together. Publishers release this evaluation to learners.
If you are unsure you need delegated grading, choose this option, it is the safest option.
Multiple individual evaluations
Evaluators work on their own evaluations separately. Publishers aggregate results into one final evaluation and release it to learners.
The publisher will need to manually aggregate the submissions of each individual evaluation into the aggregated tab. All evaluators must have set their evaluation to "Ready to Aggregate" for this to work. We advise against this mode unless necessary.
If you select this option and have set up “Treat ungraded items as Zero” in the Grades tool, publishers may not be able to aggregate results until after the due date.
Confirm changes and complete setup
Review the steps carefully to ensure you have completed the set up correctly for your use case. Finish creating or editing your assignment and click "Save and Close"
