Massive data compression for parameter-dependent covariance matrices
File(s)stx2326.pdf (947.33 KB)
Published version
OA Location
Author(s)
Heavens, AF
Sellentin, E
de Mijolla, D
Vianello, A
Type
Journal Article
Abstract
We show how the massive data compression algorithm MOPED can be used to reduce, by orders of magnitude, the number of simulated data sets which are required to estimate the covariance matrix required for the analysis of Gaussian-distributed data. This is relevant when the covariance matrix cannot be calculated directly. The compression is especially valuable when the covariance matrix varies with the model parameters. In this case, it may be prohibitively expensive to run enough simulations to estimate the full covariance matrix throughout the parameter space. This compression may be particularly valuable for the next generation of weak lensing surveys, such as proposed for Euclid and Large Synoptic Survey Telescope, for which the number of summary data (such as band power or shear correlation estimates) is very large, ∼104, due to the large number of tomographic redshift bins which the data will be divided into. In the pessimistic case where the covariance matrix is estimated separately for all points in an Monte Carlo Markov Chain analysis, this may require an unfeasible 109 simulations. We show here that MOPED can reduce this number by a factor of 1000, or a factor of ∼106 if some regularity in the covariance matrix is assumed, reducing the number of simulations required to a manageable 103, making an otherwise intractable analysis feasible.
Date Issued
2017-09-12
Date Acceptance
2017-09-05
Citation
Monthly Notices of the Royal Astronomical Society, 2017, 472 (4), pp.4244-4250
ISSN
0035-8711
Publisher
Oxford University Press (OUP)
Start Page
4244
End Page
4250
Journal / Book Title
Monthly Notices of the Royal Astronomical Society
Volume
472
Issue
4
Copyright Statement
This is an Open Access article distributed under the terms of the Creative
Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium,
Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium,
Subjects
0201 Astronomical And Space Sciences
Astronomy & Astrophysics
Publication Status
Published