Signal Processing - September 2017 - 172

Emerging Standards Awards from the
British Standard Institute.
Thomas Richter (richter@tik.uni-
stuttgart.de) received his M.S. degree in
physics, his M.S. degree in mathemat-
ics, and his Ph.D. degree in mathe-
matical physics in 1995, 1999, and
2000, respectively, from the Technical
University of Berlin, Germany. He is a
researcher at the TIK Computing Center
of the University of Stuttgart, Germany.
He has been a member of SC29WG1
since 2003.
To u r a d j Ebr a h i m i (Touradj.
Ebrahimi@epfl.ch) received his M.S.
degree in electrical engineering and his
Ph.D. degree in image and video coding
from École Polytechnique Fédérale de
Lausanne (EPFL), Switzerland, in 1989
and 1992, respectively. He is a profes-
sor at EPFL, heading its Multimedia
Signal Processing group. He is also the
convenor (chair) of the JPEG Stan -
dardization Committee.
Rafał K. Mantiuk (rkm38@cam
.ac.uk) received his M.S. degree in
computer science from the Technical

University of Szczecin, Poland, in 2003
and his Ph.D. degree in computer sci-
ence from the Max Planck Institute for
Computer Science, Germany, in 2006.
He is a senior lecturer at the Computer
Laboratory, University of Cambridge,
United Kingdom. He is the author of
a popular high dynamic range (HDR)
image quality metric, HDR-visual dif-
ference predictor-2, and the coauthor of
pfstools, software for high-dynamic range
image processing.

[5] A. Artusi, R. Mantiuk, R. Thomas, H. Philippe,
K. Pavel, A. Massimiliano, T. Arkady, and E.
Touradj, "Overview and evaluation of the JPEG XT
HDR image compression standard," Real Time Image
Process. J., pp. 1-16, Dec. 2015.

References

[9] E. Šikudova, T. Pouli, A. Artusi, A. Ahmet
Ogˇ uz, B. Francesco, E. Reinhard, and Z. M.
Mazlumoglu, "A gamut mapping framework for col-
or-accurate reproduction of HDR images," IEEE
Trans. Comput. Graph. Appl., vol. 36, no. 4, pp.
78-90, 2015.

[1] A. Artusi, F. Banterle, T. O. Aydin, D. Panozzo,
and O. Sork i ne -Hou r nu ng, Im age Content
Retargeting: Maintaining Color, Tone, and Spatial
Consistency. Boca Raton, FL: CRC, 2016.
[2] A. Artusi, R. Mantiuk, T. Richter, P. Korshunov,
P. Hanhart, T. Ebrahimi, and M. Agostinelli, "JPEG
XT: A compression standard for HDR and WCG
images," IEEE Signal Process. Mag., vol. 33, no. 2,
pp. 118-124, 2016.
[3] P. Debevec and J. Malik, "Recovering high
dynamic range radiance maps from photographs," in
Proc. 24th Annu. Conf. Computer Graphics and
Interactive Techniques, 1997, pp. 369-378.
[4] S. Pradeep and C. Aguerrebere, "Practical high
dynamic range imaging of everyday scenes:
Photographing the world as we see it with our own
eyes," IEEE Signal Process. Mag., vol. 33, no. 5, pp.
36-44, 2016.

[6] R. Thomas, A. Artusi, and E. Touradj, "JPEG
XT: A new family of JPEG backward-compatible
standards," IEEE Multimedia Mag., vol. 23, no. 3, pp.
80-88, 2016.
[7] R. Mantiuk, A. Efremov, K. Myszkowski, and
H.-P. Seidel, "Backward compatible high dynamic
range MPEG video compression," ACM Trans.
Graph., vol. 25, no. 3, pp. 713-723, 2006.
[8] T. Pouli, A. Artusi, F. Banterle, A. O. Akyüz,
H.-P. Seidel, and E. Reinhard, "Color correction for
tone reproduction," in Proc. Color and Imaging
Conf. Soc. Imaging Science and Technology, Nov.
2013, Albuquerque, NM, pp. 215-220.

[10] R. Mantiuk, R. Mantiuk, A. Tomaszewska, and
W. Heidrich, "Color correction for tone mapping,"
Comput. Graph. Forum, vol. 28, no. 2, pp. 193-202,
2009.
[11] M. Narwaria, R. K. Mantiuk, M. P. Da Silva, and
P. L. Callet, "HDR-VDP-2.2: A calibrated method for
objective quality prediction of high dynamic range and
standard images," J. Electron. Imaging, vol. 24, no. 1,
pp. 1-10, 2015.
[12] T. O. Aydin, R. Mantiuk, K. Myszkowski, and
H.-P. Seidel, "Dynamic range independent image
quality assessment," ACM Trans. Graph., vol. 27, no.
3, pp. 69:1-69:10, Aug. 2008.

Lei Zhang and Wangmeng Zuo

Image Restoration: From Sparse
and Low-Rank Priors to Deep Priors

T

he use of digital imaging devices,
ranging from professional digital
cinema cameras to consumer grade
smartphone cameras, has become ubiq-
uitous. The acquired image is a degraded
observation of the unknown latent image,
while the degradation comes from vari-
ous factors such as noise corruption,
camera shake, object motion, resolution
limit, hazing, rain streaks, or a combina-
Digital Object Identifier 10.1109/MSP.2017.2717489
Date of publication: 6 September 2017

172

tion of them. Image restoration (IR), as a
fundamental problem in image process-
ing and low-level vision, aims to recon-
struct the latent high-quality image from
its degraded observation. Image degrada-
tion is, in general, irreversible, and IR is
a typical ill-posed inverse problem. Due
to the large space of natural image con-
tents, prior information on image struc-
tures is crucial to regularize the solution
space and produce a good estimation
of the latent image. Image prior model-
ing and learning then are key issues in
IEEE SIGNAL PROCESSING MAGAZINE

|

September 2017

|

IR research. This lecture note describes
the development of image prior model-
ing and learning techniques, including
sparse representation models, low-rank
models, and deep learning models.

Relevance
IR plays an important role in many
applications, such as digital photogra-
phy, medical image analysis, remote
sensing, surveillance, and digital enter-
tainment. We give an introduction to the
major IR techniques developed in past
1053-5888/17©2017IEEE


http://www.stuttgart.de http://www.ac.uk

Table of Contents for the Digital Edition of Signal Processing - September 2017

Signal Processing - September 2017 - Cover1
Signal Processing - September 2017 - Cover2
Signal Processing - September 2017 - 1
Signal Processing - September 2017 - 2
Signal Processing - September 2017 - 3
Signal Processing - September 2017 - 4
Signal Processing - September 2017 - 5
Signal Processing - September 2017 - 6
Signal Processing - September 2017 - 7
Signal Processing - September 2017 - 8
Signal Processing - September 2017 - 9
Signal Processing - September 2017 - 10
Signal Processing - September 2017 - 11
Signal Processing - September 2017 - 12
Signal Processing - September 2017 - 13
Signal Processing - September 2017 - 14
Signal Processing - September 2017 - 15
Signal Processing - September 2017 - 16
Signal Processing - September 2017 - 17
Signal Processing - September 2017 - 18
Signal Processing - September 2017 - 19
Signal Processing - September 2017 - 20
Signal Processing - September 2017 - 21
Signal Processing - September 2017 - 22
Signal Processing - September 2017 - 23
Signal Processing - September 2017 - 24
Signal Processing - September 2017 - 25
Signal Processing - September 2017 - 26
Signal Processing - September 2017 - 27
Signal Processing - September 2017 - 28
Signal Processing - September 2017 - 29
Signal Processing - September 2017 - 30
Signal Processing - September 2017 - 31
Signal Processing - September 2017 - 32
Signal Processing - September 2017 - 33
Signal Processing - September 2017 - 34
Signal Processing - September 2017 - 35
Signal Processing - September 2017 - 36
Signal Processing - September 2017 - 37
Signal Processing - September 2017 - 38
Signal Processing - September 2017 - 39
Signal Processing - September 2017 - 40
Signal Processing - September 2017 - 41
Signal Processing - September 2017 - 42
Signal Processing - September 2017 - 43
Signal Processing - September 2017 - 44
Signal Processing - September 2017 - 45
Signal Processing - September 2017 - 46
Signal Processing - September 2017 - 47
Signal Processing - September 2017 - 48
Signal Processing - September 2017 - 49
Signal Processing - September 2017 - 50
Signal Processing - September 2017 - 51
Signal Processing - September 2017 - 52
Signal Processing - September 2017 - 53
Signal Processing - September 2017 - 54
Signal Processing - September 2017 - 55
Signal Processing - September 2017 - 56
Signal Processing - September 2017 - 57
Signal Processing - September 2017 - 58
Signal Processing - September 2017 - 59
Signal Processing - September 2017 - 60
Signal Processing - September 2017 - 61
Signal Processing - September 2017 - 62
Signal Processing - September 2017 - 63
Signal Processing - September 2017 - 64
Signal Processing - September 2017 - 65
Signal Processing - September 2017 - 66
Signal Processing - September 2017 - 67
Signal Processing - September 2017 - 68
Signal Processing - September 2017 - 69
Signal Processing - September 2017 - 70
Signal Processing - September 2017 - 71
Signal Processing - September 2017 - 72
Signal Processing - September 2017 - 73
Signal Processing - September 2017 - 74
Signal Processing - September 2017 - 75
Signal Processing - September 2017 - 76
Signal Processing - September 2017 - 77
Signal Processing - September 2017 - 78
Signal Processing - September 2017 - 79
Signal Processing - September 2017 - 80
Signal Processing - September 2017 - 81
Signal Processing - September 2017 - 82
Signal Processing - September 2017 - 83
Signal Processing - September 2017 - 84
Signal Processing - September 2017 - 85
Signal Processing - September 2017 - 86
Signal Processing - September 2017 - 87
Signal Processing - September 2017 - 88
Signal Processing - September 2017 - 89
Signal Processing - September 2017 - 90
Signal Processing - September 2017 - 91
Signal Processing - September 2017 - 92
Signal Processing - September 2017 - 93
Signal Processing - September 2017 - 94
Signal Processing - September 2017 - 95
Signal Processing - September 2017 - 96
Signal Processing - September 2017 - 97
Signal Processing - September 2017 - 98
Signal Processing - September 2017 - 99
Signal Processing - September 2017 - 100
Signal Processing - September 2017 - 101
Signal Processing - September 2017 - 102
Signal Processing - September 2017 - 103
Signal Processing - September 2017 - 104
Signal Processing - September 2017 - 105
Signal Processing - September 2017 - 106
Signal Processing - September 2017 - 107
Signal Processing - September 2017 - 108
Signal Processing - September 2017 - 109
Signal Processing - September 2017 - 110
Signal Processing - September 2017 - 111
Signal Processing - September 2017 - 112
Signal Processing - September 2017 - 113
Signal Processing - September 2017 - 114
Signal Processing - September 2017 - 115
Signal Processing - September 2017 - 116
Signal Processing - September 2017 - 117
Signal Processing - September 2017 - 118
Signal Processing - September 2017 - 119
Signal Processing - September 2017 - 120
Signal Processing - September 2017 - 121
Signal Processing - September 2017 - 122
Signal Processing - September 2017 - 123
Signal Processing - September 2017 - 124
Signal Processing - September 2017 - 125
Signal Processing - September 2017 - 126
Signal Processing - September 2017 - 127
Signal Processing - September 2017 - 128
Signal Processing - September 2017 - 129
Signal Processing - September 2017 - 130
Signal Processing - September 2017 - 131
Signal Processing - September 2017 - 132
Signal Processing - September 2017 - 133
Signal Processing - September 2017 - 134
Signal Processing - September 2017 - 135
Signal Processing - September 2017 - 136
Signal Processing - September 2017 - 137
Signal Processing - September 2017 - 138
Signal Processing - September 2017 - 139
Signal Processing - September 2017 - 140
Signal Processing - September 2017 - 141
Signal Processing - September 2017 - 142
Signal Processing - September 2017 - 143
Signal Processing - September 2017 - 144
Signal Processing - September 2017 - 145
Signal Processing - September 2017 - 146
Signal Processing - September 2017 - 147
Signal Processing - September 2017 - 148
Signal Processing - September 2017 - 149
Signal Processing - September 2017 - 150
Signal Processing - September 2017 - 151
Signal Processing - September 2017 - 152
Signal Processing - September 2017 - 153
Signal Processing - September 2017 - 154
Signal Processing - September 2017 - 155
Signal Processing - September 2017 - 156
Signal Processing - September 2017 - 157
Signal Processing - September 2017 - 158
Signal Processing - September 2017 - 159
Signal Processing - September 2017 - 160
Signal Processing - September 2017 - 161
Signal Processing - September 2017 - 162
Signal Processing - September 2017 - 163
Signal Processing - September 2017 - 164
Signal Processing - September 2017 - 165
Signal Processing - September 2017 - 166
Signal Processing - September 2017 - 167
Signal Processing - September 2017 - 168
Signal Processing - September 2017 - 169
Signal Processing - September 2017 - 170
Signal Processing - September 2017 - 171
Signal Processing - September 2017 - 172
Signal Processing - September 2017 - 173
Signal Processing - September 2017 - 174
Signal Processing - September 2017 - 175
Signal Processing - September 2017 - 176
Signal Processing - September 2017 - 177
Signal Processing - September 2017 - 178
Signal Processing - September 2017 - 179
Signal Processing - September 2017 - 180
Signal Processing - September 2017 - 181
Signal Processing - September 2017 - 182
Signal Processing - September 2017 - 183
Signal Processing - September 2017 - 184
Signal Processing - September 2017 - 185
Signal Processing - September 2017 - 186
Signal Processing - September 2017 - 187
Signal Processing - September 2017 - 188
Signal Processing - September 2017 - 189
Signal Processing - September 2017 - 190
Signal Processing - September 2017 - 191
Signal Processing - September 2017 - 192
Signal Processing - September 2017 - 193
Signal Processing - September 2017 - 194
Signal Processing - September 2017 - 195
Signal Processing - September 2017 - 196
Signal Processing - September 2017 - Cover3
Signal Processing - September 2017 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201809
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201807
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201805
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201803
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201801
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1117
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0917
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0717
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0517
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0317
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0117
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1116
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0916
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0716
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0516
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0316
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0116
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1115
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0915
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0715
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0515
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0315
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0115
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1114
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0914
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0714
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0514
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0314
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0114
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1113
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0913
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0713
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0513
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0313
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0113
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1112
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0912
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0712
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0512
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0312
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0112
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1111
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0911
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0711
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0511
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0311
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0111
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1110
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0910
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0710
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0510
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0310
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0110
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1109
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0909
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0709
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0509
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0309
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0109
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1108
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0908
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0708
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0508
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0308
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0108
https://www.nxtbookmedia.com