Exploring the effects of removing "too fast" responses and respondents from web surveys


Greszki, Robert ; Meyer, Marco ; Schoen, Harald



DOI: https://doi.org/10.1093/poq/nfu058
URL: http://poq.oxfordjournals.org/content/79/2/471
Document Type: Article
Year of publication: 2015
The title of a journal, publication series: Public Opinion Quarterly : POQ
Volume: 79
Issue number: 2
Page range: 471-503
Place of publication: Oxford
Publishing house: Oxford Univ. Press
ISSN: 0033-362X , 1537-5331
Publication language: English
Institution: Außerfakultäre Einrichtungen > Mannheim Centre for European Social Research - Research Department B
Subject: 320 Political science
Abstract: This paper addresses speeding, that is, “too fast” responses, in web surveys. Relying on the response process model, we argue that very short response times indicate low data quality, stemming from a lack of attention on the part of respondents. To identify speeding, prior research employed case-wise procedures. Using data from nine online surveys, we demonstrate that response behavior of individual respondents varies considerably during a survey. Thus, we use case- and page-wise procedures to capture speeding behavior that taps different, although related, phenomena. Moreover, page-specific speeding measures capture aspects of data quality that traditional quality measures do not cover. Employing both page-specific and case-wise speeding measures, we examine whether removing speeders makes a difference in substantive findings. The evidence indicates that removing “too fast” responses does not alter marginal distributions, irrespective of which speeder-correction technique is employed. Moreover, explanatory models yield, by and large, negligible coefficient differences (on average about one standard error). Only in exceptional cases differences exceed two standard errors. Our findings suggest that speeding primarily adds some random noise to the data and attenuate correlations, if it makes a difference at all. The paper concludes by discussing implications and limitations.




Dieser Eintrag ist Teil der Universitätsbibliographie.




Metadata export


Citation


+ Search Authors in

+ Page Views

Hits per month over past year

Detailed information



You have found an error? Please let us know about your desired correction here: E-Mail


Actions (login required)

Show item Show item