Multiple-test procedures and smile plots
File(s)Newson_Multiple-test procedures_StataJ.pdf (271.77 KB)
Published version
Author(s)
Newson, Roger
Team, The ALSPAC Study
Type
Journal Article
Abstract
multproc carries out multiple-test procedures, taking as input a list of p-values
and an uncorrected critical p-value, and calculating a corrected overall critical pvalue
for rejection of null hypotheses. These procedures define a conÞdence region
for a set-valued parameter, namely the set of null hypotheses that are true. They
aim to control either the family-wise error rate (FWER) or the false discovery
rate (FDR) at a level no greater than the uncorrected critical p-value. smileplot
calls multproc and then creates a smile plot, with data points corresponding to
estimated parameters, the p-values (on a reverse log scale) on the y-axis, and the
parameter estimates (or another variable) on the x-axis. There are y-axis reference
lines at the uncorrected and corrected overall critical p-values. The reference line
for the corrected overall critical p-value, known as the parapet line, is an informal
Òupper confidence limitÓ for the set of null hypotheses that are true and defines a
boundary between data mining and data dredging. A smile plot summarizes a set
of multiple analyses just as a Cochrane forest plot summarizes a meta-analysis.
Copyright 2003 by Stata Corporation.
and an uncorrected critical p-value, and calculating a corrected overall critical pvalue
for rejection of null hypotheses. These procedures define a conÞdence region
for a set-valued parameter, namely the set of null hypotheses that are true. They
aim to control either the family-wise error rate (FWER) or the false discovery
rate (FDR) at a level no greater than the uncorrected critical p-value. smileplot
calls multproc and then creates a smile plot, with data points corresponding to
estimated parameters, the p-values (on a reverse log scale) on the y-axis, and the
parameter estimates (or another variable) on the x-axis. There are y-axis reference
lines at the uncorrected and corrected overall critical p-values. The reference line
for the corrected overall critical p-value, known as the parapet line, is an informal
Òupper confidence limitÓ for the set of null hypotheses that are true and defines a
boundary between data mining and data dredging. A smile plot summarizes a set
of multiple analyses just as a Cochrane forest plot summarizes a meta-analysis.
Copyright 2003 by Stata Corporation.
Date Acceptance
2003-01-25
Citation
Stata Journal, 3 (2), pp.109-132
Start Page
109
End Page
132
Journal / Book Title
Stata Journal
Volume
3
Issue
2
Copyright Statement
© 2003 Stata Corporation. The Stata Journal and the contents of the supporting files (programs, datasets, and help files) are copyright by StataCorp LP. The contents of the supporting files (programs, datasets, and
help files) may be copied or reproduced by any means whatsoever, in whole or in part, as long as any copy
or reproduction includes attribution to both (1) the author and (2) the Stata Journal.
This paper is made available by permission of Stata Corporation
help files) may be copied or reproduced by any means whatsoever, in whole or in part, as long as any copy
or reproduction includes attribution to both (1) the author and (2) the Stata Journal.
This paper is made available by permission of Stata Corporation
Subjects
smile plot
multiple-test procedure
closed testing procedure
data mining
family-wise error rate
false discovery rate
Bonferroni
Sidak
Holm
Holland
Copenhaver
Hochberg
Rom
Simes
Benjamini
Yekutieli
Krieger
Liu