Market Research: Foundations to Practice · Survey Design Fundamentals
Piloting and Pretesting a Survey
A survey that reads clearly to the person who wrote it can still confuse real respondents in ways the author never anticipated. This chapter covers why piloting is a non-negotiable step, not an optional nicety.
A survey that seems perfectly clear to the researcher who wrote it can still contain genuinely ambiguous wording, confusing skip logic, or an unanticipated gap in the answer options offered, because the person who wrote the questions already knows exactly what they meant by each one, an advantage no actual respondent encountering the question fresh will share.
Key Takeaways
- A survey author's own read-through is insufficient, since they already know their intended meaning in a way no fresh respondent will share.
- Cognitive interviewing has pilot participants think aloud while answering, revealing actual interpretation versus the researcher's intended meaning.
- A full pilot run tests total length, skip logic branching, and downstream data export before fielding the survey at full scale.
- Skipping piloting is a costly shortcut, since a flaw discovered after full fielding generally can't be fixed without re-fielding the entire study.