This article explains how the panel reviews individual scores and defines a final consensus score for each criterion in an evaluation. Consensus Scoring is accessed after all individual scoring is completed.
Prerequisites
You must be a member of the evaluation panel.
All individual scoring must be complete, as individual scores are locked once Consensus Scoring is accessed.
Steps
Access Consensus Scoring.
Result: Individual scoring is locked off and can no longer be changed.
Review Aggregates of Individual Scores.
The panel will review the total scores across each criterion and each respondent by clicking on View comparative scoring button.
Scores are visualised in table for side-by-side comparison.
By clicking on View Evaluator access, you can see the individual responses and comments provided by the evaluators and when the Uplifted consensus scoring method is selected, you have the option edit the individual scores.
Identify Discrepancies
Significant differences in scoring are highlighted with an amber exclamation icon. You can view the significant discrepancies by clicking on that option.
A discrepancy is recorded against any criterion where the highest score minus the lowest score exceeds 40% by default.
Note: You can change the discrepancy threshold in your settings.Overwrite the Initial Consensus Score
Each consensus score is initially set as the average of all individual scores. When classic consensus scoring is selected, the panel defines the final score for each criterion as a group, you can overwrite the initial average consensus score and add a comment. You will not have the option to update individual scores.
Download Scores
Individual and consensus scores can be downloaded.
Finalise Consensus Scoring
Once all review and update are done, click on Save and Continue to progress to Shortlist stage.
Results / Validation
The consensus score and comments are captured as the official record. The final scores for all criteria are set and recorded.
What's Next / Related
View Key Information at a Glance: Refer to the Summary table for the average score for all criteria across all respondents, including icons for the highest scorer and scoring discrepancies.
Reference Documents: Documents submitted with supplier responses are available in the consensus review process and linked from each of the criteria.
Limits & Notes
Customers of Advanced Evaluations will use the classic scoring functionality until it is switched to the updated version in their system settings.
Evaluations that have already been completed using a particular scoring method will continue to be represented in that format, even if the system is switched to the new method.
You can change the default discrepancy threshold in your settings.
- The initial score is recorded when the evaluation enters the Consensus Scoring stage. If individual scoring is reopened and scores are changed, then once the evaluation is moved back to Consensus, the updated scores will be recorded as the initial scores.