Adjusting for verification bias in diagnostic accuracy measures when comparing multiple screening 2 tests - an application to the IP1-PROSTAGRAM study
File(s)s12874-021-01481-w.pdf (1.29 MB)
Published version
Author(s)
Day, Emily
Eldred-Evans, David
Prevost, A Toby
Hashim U, Ahmed
Fiorentino, Francesca
Type
Journal Article
Abstract
Introduction Novel screening tests used to detect a target condition are compared against either a reference standard or other existing screening methods. However, as it is not always possible to apply the reference standard on the whole population under study, verification bias is introduced. Statistical methods exist to adjust estimates to account for this bias. We extend common methods to adjust for verification bias when multiple tests are compared to a reference standard using data from a prospective double blind screening study for prostate cancer. Methods Begg and Greenes method and multiple imputation are extended to include the results of multiple screening tests which determine condition verification status. These two methods are compared to the complete case analysis using the IP1-PROSTAGRAM study data. IP1-PROSTAGRAM used a paired84 cohort double-blind design to evaluate the use of imaging as alternative tests to screen for prostate
85 cancer, compared to a blood test called prostate specific antigen (PSA). Participants with positive imaging (index) and/or PSA (control) underwent a prostate biopsy (reference). Results When comparing complete case results to Begg and Greenes and methods of multiple imputation there is a statistically significant increase in the specificity estimates for all screening tests. Sensitivity estimates remained similar across the methods, with completely overlapping 95% confidence intervals. Negative predictive value (NPV) estimates were higher when adjusting for verification bias, compared to complete case analysis, even though the 95% confidence intervals overlap. Positive predictive value (PPV) estimates were similar across all methods. Conclusion Statistical methods are required to adjust for verification bias in accuracy estimates of screening tests. Expanding Begg and Greenes method to include multiple screening tests can be computationally intensive, hence multiple imputation is recommended, especially as it can be modified for low prevalence of the target condition.
85 cancer, compared to a blood test called prostate specific antigen (PSA). Participants with positive imaging (index) and/or PSA (control) underwent a prostate biopsy (reference). Results When comparing complete case results to Begg and Greenes and methods of multiple imputation there is a statistically significant increase in the specificity estimates for all screening tests. Sensitivity estimates remained similar across the methods, with completely overlapping 95% confidence intervals. Negative predictive value (NPV) estimates were higher when adjusting for verification bias, compared to complete case analysis, even though the 95% confidence intervals overlap. Positive predictive value (PPV) estimates were similar across all methods. Conclusion Statistical methods are required to adjust for verification bias in accuracy estimates of screening tests. Expanding Begg and Greenes method to include multiple screening tests can be computationally intensive, hence multiple imputation is recommended, especially as it can be modified for low prevalence of the target condition.
Date Issued
2022-03-18
Date Acceptance
2021-11-18
Citation
BMC Medical Research Methodology, 2022, 22
ISSN
1471-2288
Publisher
BioMed Central
Journal / Book Title
BMC Medical Research Methodology
Volume
22
Copyright Statement
This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
License URL
Sponsor
Wellcome Trust
Grant Number
204998/Z/16/Z
Subjects
Science & Technology
Life Sciences & Biomedicine
Health Care Sciences & Services
Verification bias
Sensitivity
Specificity
Multiple imputation
Begg and Greenes
CANCER
SENSITIVITY
ESTIMATORS
IMPUTATION
IMPACT
Begg and Greenes
Multiple imputation
Sensitivity
Specificity
Verification bias
Bias
Double-Blind Method
Humans
Male
Mass Screening
Prospective Studies
Prostate-Specific Antigen
Sensitivity and Specificity
Humans
Prostate-Specific Antigen
Mass Screening
Sensitivity and Specificity
Prospective Studies
Double-Blind Method
Male
Bias
1117 Public Health and Health Services
General & Internal Medicine
Publication Status
Published
Article Number
ARTN 70