On sparse representation in Fourier and local bases
File(s)ProSparseDragottiLuFinal.pdf (494.41 KB)
Accepted version
Author(s)
Dragotti, PL
Lu, YM
Type
Journal Article
Abstract
We consider the classical problem of finding the sparse representation of a signal in a pair of bases. When both bases are orthogonal, it is known that the sparse representation is unique when the sparsity K of the signal satisfies K <; 1/μ(D), where μ(D) is the mutual coherence of the dictionary. Furthermore, the sparse representation can be obtained in polynomial time by basis pursuit (BP), when K <; 0.91/μ(D). Therefore, there is a gap between the unicity condition and the one required to use the polynomial-complexity BP formulation. For the case of general dictionaries, it is also well known that finding the sparse representation under the only constraint of unicity is NP-hard. In this paper, we introduce, for the case of Fourier and canonical bases, a polynomial complexity algorithm that finds all the possible K-sparse representations of a signal under the weaker condition that K <; √2/μ(D). Consequently, when K <; 1/μ(D), the proposed algorithm solves the unique sparse representation problem for this structured dictionary in polynomial time. We further show that the same method can be extended to many other pairs of bases, one of which must have local atoms. Examples include the union of Fourier and local Fourier bases, the union of discrete cosine transform and canonical bases, and the union of random Gaussian and canonical bases.
Date Issued
2014-12-01
Date Acceptance
2014-10-02
Citation
IEEE Transactions on Information Theory, 2014, 60 (12), pp.7888-7899
ISSN
0018-9448
Publisher
Institute of Electrical and Electronics Engineers
Start Page
7888
End Page
7899
Journal / Book Title
IEEE Transactions on Information Theory
Volume
60
Issue
12
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000345511400031&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Subjects
Science & Technology
Technology
Computer Science, Information Systems
Engineering, Electrical & Electronic
Computer Science
Engineering
Sparse representation
union of bases
Prony's method
harmonic retrieval
basis pursuit
mutual coherence
UNCERTAINTY PRINCIPLES
ATOMIC DECOMPOSITION
FINITE RATE
MOMENTS
SIGNALS
INNOVATION
PAIRS
Networking & Telecommunications
0801 Artificial Intelligence and Image Processing
0906 Electrical and Electronic Engineering
1005 Communications Technologies
Publication Status
Published
Date Publish Online
2014-10-08