Market Research: Foundations to Practice · Writing Unbiased Survey Questions
Attention Checks and Response Quality Signals
A well-worded question still needs a way to detect whether the person answering it is actually reading it. This chapter covers the specific techniques used to catch inattentive responses.
Attention check questions are deliberately inserted into a survey to catch inattentive, low-effort, or fraudulent respondents, typically through an instruction embedded within a longer question, such as 'please select strongly disagree for this item,' which a genuinely attentive respondent reading the full text will pass easily, while an inattentive or automated respondent skimming or randomly clicking through will often fail [9].
Key Takeaways
- Attention check questions catch inattentive or fraudulent respondents through an embedded instruction that attentive readers pass but skimmers fail.
- Attention checks should be used sparingly (one or two per survey) and placed after respondents settle in, not immediately at the start.
- Straight-lining (identical answers across a grid regardless of content) is a detectable low-effort pattern, though not automatically proof of fraud alone.
- Fast completion time is a secondary, corroborating signal best combined with other quality flags, not used alone as a disqualifying criterion.