Learning deep analysis dictionaries for image super-resolution
File(s)DeepAnalysisDict_final_.pdf (3.19 MB)
Accepted version
Author(s)
Huang, Jun-Jie
Dragotti, Pier Luigi
Type
Journal Article
Abstract
Inspired by the recent success of deep neural networks and the recent efforts to develop multi-layer dictionary models, we propose a Deep Analysis dictionary Model (DeepAM) which is optimized to address a specific regression task known as single image super-resolution. Contrary to other multi-layer dictionary models, our architecture contains L layers of analysis dictionary and soft-thresholding operators to gradually extract high-level features and a layer of synthesis dictionary which is designed to optimize the regression task at hand. In our approach, each analysis dictionary is partitioned into two sub-dictionaries: an Information Preserving Analysis Dictionary (IPAD) and a Clustering Analysis Dictionary (CAD). The IPAD together with the corresponding soft-thresholds is designed to pass the key information from the previous layer to the next layer, while the CAD together with the corresponding soft-thresholding operator is designed to produce a sparse feature representation of its input data that facilitates discrimination of key features. DeepAM uses both supervised and unsupervised setup. Simulation results show that the proposed deep analysis dictionary model achieves better performance compared to a deep neural network that has the same structure and is optimized using back-propagation when training datasets are small. On noisy image super-resolution, DeepAM can be well adapted to unseen testing noise levels by rescaling the IPAD and CAD thresholds of the first layer.
Date Issued
2020-11-11
Date Acceptance
2020-11-04
Citation
IEEE Transactions on Signal Processing, 2020, 68, pp.6633-6648
ISSN
1053-587X
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Start Page
6633
End Page
6648
Journal / Book Title
IEEE Transactions on Signal Processing
Volume
68
Copyright Statement
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
https://ieeexplore.ieee.org/document/9257106
Subjects
Science & Technology
Technology
Engineering, Electrical & Electronic
Engineering
Dictionary Learning
Analysis Dictionary
Deep Neural Networks
Deep Model
SPARSE ANALYSIS MODEL
THRESHOLDING ALGORITHM
NEURAL-NETWORKS
SHRINKAGE
Networking & Telecommunications
Publication Status
Published
Date Publish Online
2020-11-11