Skip to main content
Decisions: Criteria

Discover how to customize your review metrics in Decisions, enhancing the precision of applicant assessments with criteria settings.

Michael Stephenson avatar
Written by Michael Stephenson
Updated over a month ago

Overview

The Criteria feature within the Decisions Module allows you to build and customize evaluation metrics for applicants, such as class rank, GPA, essays, and more. With configurable options for each criterion, including conditional logic, this functionality is especially valuable for programs with limited access or seating, where accurate student ranking is essential. Each criterion you configure appears during the application review process, displaying only for relevant applicants, enabling reviewers to input their scores directly into the decision interface for a streamlined evaluation experience.

Accessing Criteria

  1. Navigate to Applications > Decisions > Decision Settings.

  2. Click on the Criteria tab.


Criteria Configurations

Types

  • Global: Applies one score per application, regardless of the number of reviewers.

  • Per Reviewer: Enables multiple scores per application, useful when different individuals evaluate the same application.

Weight

  • Sets the relative importance of each criterion on a scale from 1 to 10, with 1 being least important and 10 being most important. The default setting is 5.

Aggregate Score Type

  • Choose how to aggregate scores from each criteria item (only applies to Per Reviewer criteria type):

    • Average: Calculates the mean score.

    • Sum: Adds up all the scores.

    • Max: Uses the highest score given.

    • Min: Uses the lowest score given.

Score Types

  • Categorical: Establishes a ranking system with a defined number of levels from low to high. For example, categories might be labeled Very Low, Low, Average, and High.

  • Numerical: This option assigns scores as simple numerical values. You can set a maximum score, such as 10, and reviewers can select any number from 1 to 10.

  • Boolean: Offers a binary scoring option, typically labeled Yes or No. Labels are customizable, provided one equates to true and the other to false.

Understanding Weighted Scoring in Applicant Evaluation

To provide a clear understanding of how weighted scoring impacts applicant evaluations, let’s explore an example scenario with four criteria: Class Rank, GPA, Essay, and Letters of Recommendation.

Scenario:

An applicant has the following scores for each criterion:

  • Class Rank: 2 out of a maximum of 4

  • GPA: 1 out of a maximum of 4

  • Essay: 3 out of a maximum of 4

  • Letters of Recommendation: 1 out of a maximum of 1

Criteria Weights:

The importance of each criterion in the overall evaluation process is defined by its weight:

  • Class Rank: Weight = 5

  • GPA: Weight = 8

  • Essay: Weight = 4

  • Letters of Recommendation: Weight = 2

Weights indicate the relative importance of each criterion in the final score, allowing evaluators to prioritize certain aspects of an applicant's application.

Calculation Method:

  1. Proportionate Score Calculation: Each score is first converted into a proportion of the maximum possible score for that criterion:

    • Class Rank: 2/4 = 0.5

    • GPA: 1/4 ​= 0.25

    • Essay: 3/4 = 0.75

    • Letters of Recommendation: 1/1 = 1.0

    These proportions are then multiplied by their respective weights to reflect their importance:

    • Class Rank: 0.5 × 5 = 2.5

    • GPA: 0.25 × 8 = 2.0

    • Essay: 0.75 × 4 = 3.0

    • Letters of Recommendation: 1.0 × 2 = 2.0

  2. Weighted Sum and Normalization: The weighted scores are summed:

    • Total Weighted Score: 2.5 + 2.0 + 3.0 + 2.0 = 9.5

    To ensure the final score fits within the standardized maximum of 10, we normalize this sum based on the total of the weights:

    • Sum of Weights: 5 + 8 + 4 +2 = 19

    • Normalized Score: 9.5 ÷ 19 × 10 = 5.0

Conclusion:

The final score is 5 out of 10.

This score indicates how well the applicant performed across all weighted criteria, scaled to a maximum score of 10. This method ensures that each criterion's influence on the overall score is proportional to its assigned weight, providing a fair and balanced assessment of the applicant’s qualifications.


Adding Criteria

  1. Navigate to Applications > Decisions > Decision Settings.

  2. Click on the Criteria tab.

  3. Click the blue plus sign in the bottom right corner of the page.

  4. Configure the three tabs of the new criteria:

    • General

      • Provide a name, a short name (this will be visible if the full name is too long to display), and a brief description.

    • Works For

      • Select the application(s) you wish this criterion to work with.

    • Conditions

      • Add conditional logic to control when this criterion will be displayed. By setting conditions, you can ensure that this criterion only appears for applicants who meet specific requirements, helping reviewers focus on relevant evaluation items.

        • Click Add Condition to begin setting up criteria visibility rules.

        • Select from two condition types:

          • Segment Reference: Create a custom segment of Contacts based on specific properties, such as demographics or interaction history from their Contact record. This option is ideal if you want to tailor criteria for certain applicant groups based on customized characteristics.

          • User Segment: Use a pre-existing segment that you’ve already created. This option provides a faster setup if the relevant segment has been previously defined.

        • Once conditions are set, this criterion will only be visible for applicants who match the defined segment criteria.

  5. Click Create. Your criteria item will be added to the criteria list and open for you to configure.

  6. Configure the settings of the criteria item. Refer to the Criteria Configuration section above for a comprehensive explanation of each setting.


Editing, Reordering, + Deleting Criteria

  1. Navigate to Applications > Decisions > Decision Settings.

  2. Click on either the Criteria tab.

  3. In the lefthand menu, locate the criteria item you wish to edit, reorder, or delete.

  4. Click on the criteria item name.

  5. Follow the instructions below:

Editing

  • Criteria Settings (Type, Weight, etc.)

    1. Click on the cog/gear icon next to the criteria item.

    2. Make your changes.

    3. Click Save when you have finished.

  • Name, Short Name, Description, or Conditions

    1. Click on the pencil icon next to the criteria item.

    2. Navigate through the three tabs: general, works for, and conditions to make your changes.

    3. Click Update when you have finished.

Reordering

  • To reorder criteria items, use the double-sided arrow to the left of the criteria name and drag and drop the item to the desired location.

Deleting

  • Click on the trash can icon next to the criteria item. You will be prompted to confirm your action.



Utilizing Criteria for Application Reviews

The criteria you set up in Decision Settings are visible in each application decision, allowing you to score each item and include relevant notes. For further details, check out our article on Reviewing and Processing Application Decisions.

Criteria Behavior: Applications are evaluated against criteria, including any conditions, only at the time of submission. If criteria or conditions are updated after an application is submitted, those updates will not impact previously submitted applications.


The Decisions Module is included with the Element Engage package.

Did this answer your question?