Should online surveys force respondents to answer certain questions?

Online surveys can be configured so a respondent is required to provide a response to a question before proceeding to the next question. This practice is known as forced completion. Here are the arguments for and against this practice.

For

The case for forced completion is that the researcher gets data that is needed (as long as the right questions are asked in the right way).

Against

The case against forced completion is that it may reduce response rates. For example, some respondents might prefer to abandon a survey rather than answer a specific question such as their income. Although one could add a “prefer not to answer” option, this increases the amount of missing data.

All or Nothing

With many interviewing systems, especially the free or low-cost ones, the forced completion option is all or nothing (either “off” or “on”). Unfortunately, neither of these is a very good option because:

  • Turning the feature off means that the respondent can skip each important question. This decreases both the number of responses and the validity of the responses that are captured.
  • Turning the feature on can force respondents to answer questions that are not relevant to them (for example, forcing a response to an open-ended questions such as “Is there anything else you like about this product” can frustrate those who do not have anything to say on this subject but are required to type something in the text box in order to proceed with the survey. This can result in high rates of incomplete surveys.

Recommendation

The ideal approach is to force responses to most questions but allow the respondent to opt out of a response when appropriate. Before fielding a survey that does not allow this functionality, you should consider using one that does as it is likely to produce both a better quantity and quality of data.

About Todd Hollander

Hollander is Founder and President of Todd Hollander Market Research. He has over 25 years of experience in the design and analysis of strategic market research, is an instructor in the University of Georgia’s "Principles of Marketing Research" course, and is the author of "We’re Killing Our Kids," a highly-acclaimed book on the childhood obesity epidemic, and “The Online Survey Doctor,” a weblog dispensing expert advice about internet survey research.
This entry was posted in Questionnaire Design and tagged , , , , , , . Bookmark the permalink.

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>