Participant Weight Configuration
The 360-degree assessment supports both custom weight and fixed weight.
Custom Weight Value Settings
Supporting the calculation of multiple weight values within the same questionnaire: If there are inconsistencies in the levels of evaluators required for different Subject in your evaluation relationships—for example, some Subject need to be evaluated by supervisors, subordinates, and colleagues, while others only need evaluations from supervisors and colleagues, you can choose to set multiple weight values, as shown in the image:
Custom Weight Matching Rules
The weight calculation rules are based on the actual respondents who submit the questionnaire: The system's matching principle is that weights with fewer levels or entirely consistent weight settings are considered a match. If none of the settings match, the system will default to the first set weight value.
Recommendation: Set the most suitable matching relationship's weight value at the front (i.e., pay attention to the order of settings).
1. Originally, evaluators from three levels—supervisor, subordinate, and colleague—were needed to evaluate the evaluatee. However, if only supervisors and colleagues submit the questionnaire, the weight calculation will follow the second setting shown in the diagram.
2. Originally, evaluators from two levels—supervisor and colleague—were needed to evaluate the evaluatee. If, in the end, only one level, such as the supervisor, evaluates the evaluatee, the system will automatically calculate using the first setting shown in the diagram, as it is the default setting.
3. Originally, evaluators from two levels—supervisor and subordinate—were needed to evaluate the evaluatee. (Since the system's matching principle considers weights with fewer levels or entirely consistent weight settings as a match), it will default to the first setting shown in the diagram below.
4. Originally, evaluators from two levels—supervisor and subordinate—were needed to evaluate the evaluatee. (Since the system's matching principle considers weights with fewer levels or entirely consistent weight settings as a match), it will default to the second setting shown in the diagram above.
After evaluators submit their questionnaires, if the system does not find a matching weight rule that corresponds to your set weight values (as in point II), it will default to using the first set of weights for calculations. Therefore, during the process of collecting questionnaires, the weight calculations may change continuously. It is recommended that you analyze and review the data after all questionnaires have been collected and the assessment has concluded.
Fixed Weight Values
Except for self-assessments, which are not weighted, all other levels are equally distributed.
FAQ
Q1: What are the two types of weight configurations supported in 360-degree assessments?
A: The 360-degree assessment supports both custom weight and fixed weight configurations. Custom weight allows you to set different weight values for different evaluation scenarios, while fixed weight distributes all levels equally except for self-assessments which are not weighted.
Q2: When should I use custom weight values instead of fixed weights?
A: Use custom weight values when there are inconsistencies in the levels of evaluators required for different subjects. For example, if some subjects need evaluations from supervisors, subordinates, and colleagues while others only need evaluations from supervisors and colleagues, custom weights allow you to set appropriate weight values for each scenario.
Q3: How does the system match custom weight settings when not all evaluator levels submit questionnaires?
A: The system's matching principle considers weights with fewer levels or entirely consistent weight settings as a match. If none of the settings match, the system defaults to the first set weight value. It's recommended to set the most suitable matching relationship's weight value at the front.
Q4: What happens if the system cannot find a matching weight rule during questionnaire collection?
A: If the system doesn't find a matching weight rule that corresponds to your set weight values, it will default to using the first set of weights for calculations. Weight calculations may change continuously during the collection process, so it's recommended to analyze data after all questionnaires have been collected.
Q5: How does fixed weight distribution work for different evaluator levels?
A: With fixed weight values, except for self-assessments which are not weighted, all other levels are equally distributed. This means if you have supervisor, subordinate, and colleague levels, each would receive equal weight (e.g., 33.33% each) in the final calculation.
