Set Evaluation Criteria

  • Updated

This article provides comprehensive instructions on how to configure evaluation criteria within the system to support flexible scoring requirements at a granular level to determine supplier conformity and scoring.

Prerequisites

  • Role: Procurement Officers

  • You must be at the Criteria step of an Advanced Evaluation.

  • If a Procurement Plan is linked and criteria are already completed, these fields will be pre-filled.

Step 1: Pre-Assessment (Optional)

The Pre-Assessment is used to determine if a supplier/respondent is conforming or non-conforming using "Pass/Fail" (Yes/No) options rather than weighted scores.

  1. Add criteria: Click Add criteria to create a Pre-Assessment criterion from scratch.

  2. Load Templates: Click Load Templates to add criteria from templates set up by Admins.

    • Individual requirements: Select specific individual criteria to load.

    • Requirements set: Select a group of criteria to load in bulk.

    • Note: You can preview questions by selecting them and hitting "Load selected".

  3. Skip this step: Select Skip this step if you are completing this outside the system; this moves you directly to weighted Evaluation Criteria.

  4. Adjust Templates: Modify loaded templates as needed:

    • 'Bin' icon: Delete the entire criterion.

    • Title: Change the criterion title.

    • Click on the question: Edit specific questions within the criterion.

    • "Delete": Remove a question from the criterion.

    • "Add a question": Include a new question in the criterion.

  5. Save: Click Save and Continue to move to weighted Evaluation Criteria.

Step 2: Evaluation Criteria

Evaluation Criteria are scored by the panel and then averaged for the consensus round. These criteria, questions, and answers are all assigned specific weightings.

  1. Load Templates: Click Load Templates in the top-right corner to use organisational templates.

  2. Set Weighting Style: Choose how criteria are calculated at the top of the page:

    • As %: All criteria must add up to 100%.

    • As points: Criteria are assigned points, and the system automatically weights them out of 100%. (e.g. 2 criterion are weighted 1 point each, therefore each criterion will be weight 1/2 = 50%)

  3. Weighting Cost: If enabled, Cost is the first criterion.

    • Weighting: This is automatically calculated, with the lowest cost receiving the highest score. If cost shouldn't be weighted, set this to 0.

    • Cost Effective Ratio: If your organisation uses this for consensus scoring, you cannot provide a manual weighting.

    • Hide cost: Select this to hide the submitted cost from evaluators.

    • Scoring method: Tick this if you prefer to set up your own manual cost criterion.

  4. Weighting Criteria: Provide a total weighting for each criterion in the top-right corner. This is the maximum score a respondent can receive for that criterion.

  5. Question Weighting & Options: Click on a question within a criterion to define:

    • Weighting: The points this question is worth relative to other questions.

    • Response type: Select between "Drop-down" or "Yes/No".

    • Pre-defined options: Select from admin-customised dropdown options.

    • Response Options: Define what evaluators select when scoring.

    • Points: Set the weighting of each specific response option.

    • + or - icons: Add or remove response options.

  6. Assigning Criteria: By default, all criteria are assigned to "All panel members".

    • To limit assignments, untick "All panel members" and select specific individuals or teams from the dropdown.

    • Note: If unticked, evaluators added later will not be assigned by default unless they are in an included team.

Results / Validation

Click Save and Continue to lock in your criteria and move to the next stage of the evaluation process.

Limits & Notes

  • Cost Weighting: If cost shouldn't be weighted, set the value to 0.

  • Pre-Assessment Scoring: Pre-Assessment questions should always be responded to with 'Yes' or 'No' (where 'Yes' equals a pass).

What's Next / Related