Fatal flaw in online survey design: Making respondents answer every open-ended question

Open-ended questions are those in which respondents type a response in a text box rather than selecting from a predefined set of responses (radio buttons, checkboxes, drop-down lists, etc). When open-ended questions are used properly, they can provide a number of benefits. However, when used improperly, they can be the kiss of death for your survey.

As noted in a previous entry, one common mistake is to use too many open-ended questions in a survey, which may cause many respondents to abandon the interview. Another common mistake made by inexperienced researchers is to force responses to an open-ended question even when it is likely that many or most respondents will have no valuable response to offer.

An example of this would be the question:

Do you have any other comments or suggestions about our company?

If the survey software is programmed to require a response to this question, it is likely that many respondents will be frustrated when they receive an error message telling them they have to type a response before they can proceed to the next question. When this mistake is made, the open-ended responses often include a rash of expletives.

The bottom line: As a rule, a response to an open-ended question should only be required when it is reasonable to think that every respondent will have a meaningful response to offer. Otherwise, a response should be optional.

See also: How and when to use text boxes in online surveys

About Todd Hollander

Hollander is Founder and President of Todd Hollander Market Research. He has over 25 years of experience in the design and analysis of strategic market research, is an instructor in the University of Georgia’s "Principles of Marketing Research" course, and is the author of "We’re Killing Our Kids," a highly-acclaimed book on the childhood obesity epidemic, and “The Online Survey Doctor,” a weblog dispensing expert advice about internet survey research.
This entry was posted in Questionnaire Design and tagged , , , , , . Bookmark the permalink.

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>