Careless Responding in Online Studies is Associated With Alcohol Use: A Mega-Analysis


Objective: The prevalence of research conducted online in the addiction field has increased rapidly over the past decade. However, little focus has been given to careless responding in these online studies, despite the issues it may cause for statistical inference and generalizability. Our aim was to examine whether alcohol use is associated with careless responses. Method: Raw data were requested from online studies examining alcohol use and related problems which also addressed careless responding. We obtained 13 data sets of 12,237 participants (M age = 42.16, SD = 15.65, 50.5% female). The sample had an average Alcohol Use Disorders Identification Test (AUDIT) score of 10.88 (SD = 7.77). Predictors included demographic information (age, gender) and AUDIT total scores. The primary outcome was whether an individual was classed as a careless responder, for example, by failing an explicit attention check question. Results: AUDIT total scores were associated with careless responding (OR = 1.07, 95% CI [1.06, 1.08], p <.001). Hazardous drinking or worse was associated with 2.21 greater odds (OR = 2.21, 95% CI [1.81, 2.71] of careless responding, whereas harmful drinking or worse was associated with 3.43 greater odds (OR = 3.43, 95% CI [2.83, 4.17]) and probable dependence was associated with 3.63 greater odds (OR = 3.63, 95% CI [2.95, 4.48]). Conclusions: Alcohol use and related problems are positively associated with careless responding in online research.

Publication DOI:
Additional Information: Copyright © 2023, The Author(s). This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0; This license permits copying and redistributing the work in any medium or format, as well as adapting the material for any purpose, even commercially. Analysis scripts and data can be found here at
Uncontrolled Keywords: Alcohol Use Disorders Identification Test,alcohol use,attention,careless responding,online research
Publication ISSN: 1939-1501
Last Modified: 18 Apr 2024 07:23
Date Deposited: 03 May 2023 09:26
Full Text Link:
Related URLs: (Related URL)
https://psycnet ... -64759-001.html (Publisher URL)
PURE Output Type: Article
Published Date: 2023-04-20
Published Online Date: 2023-04-20
Accepted Date: 2023-03-16
Authors: Jones, Andrew
Gillespie, Steven M.
Pennington, Charlotte R. (ORCID Profile 0000-0002-5259-642X)
Strickland, Justin C.
Robinson, Eric



Version: Published Version

License: Creative Commons Attribution

| Preview

Export / Share Citation


Additional statistics for this record