Comparison of clinical trial changes in primary outcome and reported intervention effect size between trial registration and publication.
File(s)2019 Chen et al JAMA Open.pdf (936.22 KB)
Published version
Author(s)
Type
Journal Article
Abstract
Importance: Primary outcome change could threaten the validity of a clinical trial; however, evidence about the consequences on the reported intervention effect size is unclear. Objectives: To examine the status of randomized clinical trials whose primary outcome changed between trial registration and publication and to quantify the association of this change with the reported intervention effect size. Design, Setting, and Participants: In this cross-sectional study on the primary report of randomized clinical trials with clear prospectively registered primary outcomes, PubMed and Embase were searched for articles published between January 1, 2011, and December 31, 2015. The search was conducted in January 2016, identifying randomized clinical trials and the combination of keywords and text words related to registry. Main Outcomes and Measures: Based on the developed approach, trials were classified as having primary outcome change when there was a major discrepancy between the registered and published primary outcomes. Intervention effect was estimated or recalculated using the odds ratio (OR) for each comparison. Each component OR is structured so that an OR is less than 1 if the intervention group has a more favorable result than the control group. The ratio of ORs (ROR), which is the summary OR for trials with primary outcome change divided by those without, and its 95% CI were calculated, with a value less than 1 indicating a larger reported intervention effect size in trials with primary outcome change than those without. Results: Among 29 749 searched articles (28 810 MEDLINE and 939 Embase), 1488 articles were randomly selected for review. Of 389 trials with clear primary outcomes prospectively described in the registry (416 outcomes reported), 33.4% (130 of 389) of trials had at least 1 primary outcome change. Most (66 of 130) of the changes were either not reporting or omitting the primary outcome. In total, 338 trials (365 outcomes and 487 comparisons) were available for quantitative analysis on the reported intervention effect size bias assessment. Compared with those without primary outcome change, trials with primary outcome change showed a 16% (pooled ROR, 0.84; 95% CI, 0.73-0.96) larger reported intervention effect size. The result persisted after adjustment for potential confounders (ROR, 0.81; 95% CI, 0.71-0.93) and other sensitivity and subgroup analyses. Conclusions and Relevance: Results of this study suggest that inconsistencies between registered and published primary outcomes of clinical trials are common, and trials with primary outcome change are likely to have a larger intervention effect than those without.
Date Issued
2019-07-19
Date Acceptance
2019-05-28
Citation
JAMA Network Open, 2019, 2 (7), pp.1-12
ISSN
2574-3805
Publisher
JAMA Network
Start Page
1
End Page
12
Journal / Book Title
JAMA Network Open
Volume
2
Issue
7
Copyright Statement
© 2019 Chen T et al. JAMA Network Open. This is an open access article distributed under the terms of the CC-BY license (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium. You are not required to obtain permission to reuse this article content, provided that you credit the author and journal.
Identifier
https://www.ncbi.nlm.nih.gov/pubmed/31322690
PII: 2738347
Publication Status
Published
Coverage Spatial
United States
Date Publish Online
2019-07-19