This article explains how the panel reviews individual scores and defines a final consensus score for each criterion in an Advanced Evaluation. Consensus Scoring is accessed after all individual scoring is completed. The way you set the final score depends on the consensus scoring method selected for your system.

Prerequisites

• You must be the Evaluation Chair / the Procurement Officer

• All individual scoring must be complete, as individual scores are locked once Consensus Scoring is accessed.
• To use Global Consensus Scoring, an administrator must enable it and the Uplifted method must be selected.

Consensus scoring methods

Your administrator selects the method in system settings. Check which method applies before you start.

• Classic Scoring Method: The Procurement Officer / Evaluation Chair may manually enter the final score for each criterion and respondent. You will not have the option to update individual scores.
• Uplifted Scoring Method: The final score is calculated as an average of the panel member scores after consensus. Changes to scores are made by updating individual panel members’ responses.
• Global Consensus Scoring (Uplifted only): Administrators can enable this option so the panel chair can enter a single agreed-upon score and comment for the entire group. You don’t need to update each individual evaluator’s record.

Steps

1. Access Consensus Scoring. Result: Individual scoring is locked off and can no longer be changed.

2. Review Aggregates of Individual Scores. Click the View comparative scoring button to review the total scores across each criterion and each respondent. Scores are visualised in a table for side-by-side comparison. To see the individual responses and comments provided by the evaluators, click View Evaluator access. When the Uplifted method is selected, you have the option to edit the individual scores here.
   

3. Click the View score variance button to check where evaluators disagree.

   Step through every question, not only the ones with large differences.
   Toggle between initial and current responses to see how scores changed. 
   
   Result: You can see which criteria need discussion before you set the final score.

4. Set the Consensus Score. Each consensus score is initially set as the average of all individual scores. What you do next depends on your method:

   1. Classic: The panel defines the final score for each criterion as a group. Overwrite the initial average consensus score and add a comment.
      
       
   2. Uplifted: Update the individual panel member responses. The final score is recalculated as the average of the panel member scores.
   3. Global Consensus Scoring: The chair enters one agreed score and comment for the entire group.

   Result: The consensus score and comment are saved for the criterion.
    

5. Download Scores. Individual and consensus scores can be downloaded.
   
6. Finalise Consensus Scoring. Once all review and updates are done, click Save and Continue to progress to the Shortlist stage.

Results / Validation

The consensus score and comments are captured as the official record. The final scores for all criteria are set and recorded.

What’s Next / Related

• View Key Information at a Glance: Refer to the Summary table for the average score for all criteria across all respondents, including icons for the highest scorer and score variance.
• Reference Documents: Documents submitted with supplier responses are available in the consensus review process and linked from each of the criteria.

Troubleshooting

1. I can’t edit individual scores. Individual scores lock when Consensus Scoring starts. With the Classic method, you enter the final score directly and can’t edit individual responses.
2. I don’t see the option to enter one score for the group. Global Consensus Scoring needs the Uplifted method selected and an administrator to enable it.
3. My updated scores aren’t showing as the initial scores. The initial score is recorded when the evaluation enters Consensus Scoring. If individual scoring is reopened and changed, the updated scores become the initial scores when the evaluation returns to Consensus.

Limits & Notes

• Customers of Advanced Evaluations will use the classic scoring functionality until it is switched to the updated version in their system settings.
• Evaluations that have already been completed using a particular scoring method will continue to be represented in that format, even if the system is switched to the new method.
• You can change the default score variance threshold in your settings.
• The initial score is recorded when the evaluation enters the Consensus Scoring stage. If individual scoring is reopened and scores are changed, then once the evaluation is moved back to Consensus, the updated scores will be recorded as the initial scores.