Scalable Bayesian nonparametric measures for exploring pairwise dependence via Dirichlet Process Mixtures
File(s)euclid.ejs.1479287224.pdf (1.81 MB)
Published version
Author(s)
Filippi, Sarah
Holmes, Chris C
Nieto-Barajas, Luis E
Type
Journal Article
Abstract
In this article we propose novel Bayesian nonparametric methods using Dirichlet Process Mixture (DPM) models for detecting pairwise dependence between random variables while accounting for uncertainty in the form of the underlying distributions. A key criteria is that the procedures should scale to large data sets. In this regard we find that the formal calculation of the Bayes factor for a dependent-vs.-independent DPM joint probability measure is not feasible computationally. To address this we present Bayesian diagnostic measures for characterising evidence against a “null model” of pairwise independence. In simulation studies, as well as for a real data analysis, we show that our approach provides a useful tool for the exploratory nonparametric Bayesian analysis of large multivariate data sets.
Date Issued
2016-11-16
Date Acceptance
2016-07-01
Citation
Electronic Journal of Statistics, 2016, 10 (2), pp.3338-3354
ISSN
1935-7524
Publisher
Institute of Mathematical Statistics
Start Page
3338
End Page
3354
Journal / Book Title
Electronic Journal of Statistics
Volume
10
Issue
2
Copyright Statement
© 2016 The Authors
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000390364400053&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Subjects
Science & Technology
Physical Sciences
Statistics & Probability
Mathematics
Bayes nonparametrics
contingency table
dependence measure
hypothesis testing
mixture model
mutual information
CONTINGENCY-TABLES
INDEPENDENCE
Publication Status
Published
Coverage Spatial
N Carolina State Univ Campus, Raleigh, NC
Date Publish Online
2016-11-16