Thibault, Robert, Hardwicke, Tom E., Clark, Robbie W.A., Pennington, Charlotte Rebecca, Nilsonne, Gustav, O'Mahony, Aoife, Drax, Katie, Thompson, Jacqueline, Munafò, Marcus R. and TARG Meta-Research Group & Collaborators (2022). Discrepancy review: A feasibility study of a novel peer review intervention to reduce undisclosed discrepancies between registrations and publications. Royal Society Open Science, 9 (7),
Abstract
Undisclosed discrepancies often exist between study registrations and their associated publications. Discrepancies can increase risk of bias, and when undisclosed, they disguise this increased risk of bias from readers. To remedy this issue, we developed an intervention called discrepancy review. We provided journals with peer reviewers specifically assigned to check for undisclosed discrepancies between registrations and manuscripts submitted to journals. We performed discrepancy review on 18 manuscripts submitted to Nicotine and Tobacco Research and three manuscripts submitted to the European Journal of Personality. We iteratively refined the discrepancy review process based on feedback from discrepancy reviewers, editors and authors. Authors addressed the majority of discrepancy reviewer comments, and there was no opposition to running a trial from authors, editors or discrepancy reviewers. Outcome measures for a trial of discrepancy review could include the presence of primary or secondary outcome discrepancies, whether publications that are not the primary report from a clinical trial registration are clearly described as such, whether registrations are permanent, and an overarching subjective assessment of the impact of discrepancies in published articles. We found that discrepancy review could feasibly be introduced as a regular practice at some journals interested in this process. A full trial of discrepancy review would be needed to evaluate its impact on reducing undisclosed discrepancies.
Publication DOI: | https://doi.org/10.1101/2022.01.18.22269507 |
---|---|
Divisions: | College of Health & Life Sciences > Aston Institute of Health & Neurodevelopment (AIHN) College of Health & Life Sciences College of Health & Life Sciences > School of Psychology Aston University (General) |
Additional Information: | © 2022 The Authors. Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/, which permits unrestricted use, provided the original author and source are credited. |
Uncontrolled Keywords: | meta-research,outcome switching,peer review,pre-registration,selective reporting,trial registration,General |
Last Modified: | 18 Nov 2024 08:30 |
Date Deposited: | 25 Jul 2022 09:16 |
Full Text Link: | |
Related URLs: |
https://www.med ... 1.18.22269507v1
(Author URL) https://royalso ... 098/rsos.220142 (Publisher URL) http://www.scop ... tnerID=8YFLogxK (Scopus URL) |
PURE Output Type: | Review article |
Published Date: | 2022-07-27 |
Accepted Date: | 2022-07-07 |
Authors: |
Thibault, Robert
Hardwicke, Tom E. Clark, Robbie W.A. Pennington, Charlotte Rebecca ( 0000-0002-5259-642X) Nilsonne, Gustav O'Mahony, Aoife Drax, Katie Thompson, Jacqueline Munafò, Marcus R. , TARG Meta-Research Group & Collaborators |
Download
Version: Accepted Version
Access Restriction: Restricted to Repository staff only
Version: Published Version
License: Creative Commons Attribution
| Preview