Circulate Assessment

This guide explains how to use the Circulate Assessment question type in SurveyMars. Circulate Assessment is designed for scenarios where multiple evaluation items (such as people, products, or projects) need to be assessed using the same set of questions. It supports flexible display rules for evaluation items and automatically generates comparative and individual reports to help you conduct efficient multi-dimensional evaluation research.

Feature Overview

Circulate Assessment is suitable for the following scenarios:

1. When multiple people need to be evaluated using the same set of questions.

2. When multiple different products or projects need to be surveyed, and respondents are required to answer the same content for each product or project.

3. Based on the above scenarios, when you need to set random display rules for evaluation items (options include: fully random, in order, randomly select a few, let respondents choose a few, or let respondents choose first and then randomly select a few, etc.).

Setup Steps

Setting up Circulate Assessment typically involves the following 4 steps:

1. In the survey editor, add the "Circulate Assessment" question type.

2. Set evaluation items (the people, products, or projects to be evaluated).

3. Configure evaluation rules (system auto-selection or user manual selection of evaluation items).

4. Set Cyclic Questions (questions that appear for each evaluation item).

Evaluation Item Settings

1. Name is required. Please enter the name for each evaluation item.

2. If you have many evaluation items, use the batch add feature to enter them quickly.

3. Each evaluation item can optionally include Details and an image to help respondents understand the item being evaluated.

Evaluation Rule Settings

Evaluation rules are divided into two parts: system auto-selection of evaluation items and user manual selection of evaluation items. The difference is whether respondents need to manually choose which items to evaluate.

System auto-selection of evaluation items:

- Display in order: All configured evaluation items are shown to respondents in the set order by default.

- Random order: All evaluation items are shown in a shuffled order.

- Randomly select X items: A specified number of evaluation items are randomly drawn from the full list and shown to respondents.

User manual selection of evaluation items:

- Respondents must first select the items they want to evaluate, then the corresponding questions are presented in sequence.

- You can limit how many evaluation items respondents are allowed to select.

- You can set the Frequency (how many items are presented) for selected items, and configure whether to randomly display all or only some of the chosen evaluation items.

Set Cyclic Questions

Add Questions/Options for each evaluation item. The questions you add will appear every time an item is evaluated. You can add rating questions, single-choice questions, multiple-choice questions, and other question types as evaluation dimensions based on your research needs.

Circulate Assessment Report

1. The system generates two types of reports: Detailed Comparative Analysis and Report.

2. Detailed Comparative Analysis: Compare data across all evaluation items to easily identify the top-performing item in each dimension.

3. Report: View detailed data for each dimension of a single evaluation item, identify the strongest and weakest factors influencing user choices, and make targeted improvements.

Interpreting Random Rule Fields in Download Data

When you Download data, the "Does it appear?" field indicates the display status of evaluation items under random rules. Interpretation is as follows:

"Random"

- When it appears: a. When the rule set by the publisher requires respondents to select fewer items than they need to answer; b. When the rule set by the publisher requires the system to randomly select a certain number of items for respondents to answer.

- Meaning: Displaying "Random" means the system randomly selected this item for the respondent to answer.

- In short, showing "Random" means this item was definitely answered by the respondent.

"Yes"

- When it appears: a. When the rule set by the publisher requires respondents to select fewer items than they need to answer; b. When the rule set by the publisher requires respondents to answer items in order.

- Meaning: Under logic a, displaying "Yes" means the respondent manually selected this item but did not answer it (the system did not randomly select it). Under logic b, displaying "Yes" means the system selected this item and the respondent answered it.

"No"

- When it appears: When the number of items set by the survey publisher exceeds the number of items respondents need to answer each time.

- Meaning: Neither the respondent nor the system selected this item, so no answer is required.

FAQ

Q: What is the difference between "system auto-selection" and "user manual selection"?

A: With system auto-selection, evaluation items are presented directly according to your configured rules (in order, random, or random selection). With user manual selection, respondents must first choose which items to evaluate, then answer the questions in sequence.

Q: What do "Random", "Yes", and "No" mean in Download data?

A: These three values in the "Does it appear?" field indicate whether each evaluation item was selected and answered under random rules. "Random" means the system randomly selected and the item was answered; "Yes" means the item was selected (answered or not, depending on the rule); "No" means the item was not selected and no answer is required.

Important Notes

- Name is required for each evaluation item. Use batch add when you have many items to enter.

- When using user manual selection, set reasonable limits on how many items respondents can choose to avoid too many or too few selections.

- Questions added under Set Cyclic Questions will repeat for every evaluation item. Ensure the wording applies to all items.

- When you Download data, use the "Does it appear?" field together with your random rules to correctly interpret response status.

- Use Detailed Comparative Analysis to quickly identify top-performing items by dimension, and Report for in-depth analysis and improvement direction.