Qualtrics lets you randomize items in your survey, which is an important tool use when assigning control groups.

In this article:

• Randomizing Answer Choices
• Randomizing Questions

Randomizing Answer Choices

Randomizing answer choices helps overcome potential bias resulting from the order in which items are presented. To access Answer Choice randomization:

1. Click the Advanced Question Options dropdown.
2. Select Randomization.

   

There are three types of randomization:

• Randomize the order of all choices
• Present only a subset of the total choices (For example, if you decide to display only three of six possible answer choices.)

  

• Advanced Randomization where you specify which choices are randomized versus which choices are always fixed in the same location

Randomizing Questions

In the Advanced Randomization menu, use the Fixed Display Order box to determine where a choice is assigned to appear. For example, if you have an “Other” option, you may want it to always appear at the bottom of your choice list and not be randomized with the rest of your options.

Use the arrows to the right to move options into and out of various categories:

• All choices moved into the Randomize Questions box will all be randomized and re-inserted into the display order where the {Randomized} placeholders appear.
• Options placed into Random Subset will all be randomized but only your selected number will be re-inserted into the display order where the {Random Subset} placeholders appear.
• Options dragged into the Undisplayed Items will never be displayed to respondents.

Note: Using the Undisplayed Items category is helpful to prevent displaying outdated answer choices without deleting the options (and their collected data) from the survey.