IEEE Signal Processing Magazine - January 2018 - 1

Contents

Volume 35 | Number 1 | January 2018

SPECIAL SECTION

84

DEEP LEARNING FOR
VISUAL UNDERSTANDING: PART 2
17
20

37

Junwei Han, Dingwen Zhang, Gong
Cheng, Nian Liu, and Dong Xu

101

FROM THE GUEST EDITORS

112

USING DEEP NEURAL
NETWORKS FOR INVERSE
PROBLEMS IN IMAGING

CONDITIONAL RANDOM FIELDS
MEET DEEP NEURAL NETWORKS
FOR SEMANTIC SEGMENTATION

Anurag Arnab, Shuai Zheng,
Sadeep Jayasumana, Bernardino
Romera-Paredes, Måns Larsson,
Alexander Kirillov, Bogdan
Savchynskyy, Carsten Rother,
Fredrik Kahl, and Philip H.S. Torr

THE DEEP REGRESSION BAYESIAN
NETWORK AND ITS APPLICATIONS

Siqi Nie, Meng Zheng, and Qiang Ji

Fatih Porikli, Shiguang Shan,
Cees Snoek, Rahul Sukthankar,
and Xiaogang Wang

Alice Lucas, Michael Iliadis,
Rafael Molina, and Aggelos K.
Katsaggelos

ADVANCED DEEP-LEARNING
TECHNIQUES FOR SALIENT
AND CATEGORY-SPECIFIC
OBJECT DETECTION

RECENT ADVANCES
IN ZERO-SHOT RECOGNITION

Yanwei Fu, Tao Xiang, Yu-Gang
Jiang, Xiangyang Xue, Leonid Sigal,
and Shaogang Gong

126

ON THE COVER
This second part of the special issue on deep learning for
visual understanding continues to provide tutorials on deeplearning techniques for understanding face images, object
detection, superresolution, denoising, deblurring, compressive sensing, zero-shot recognition, and conditional random
fields. This edition also includes articles on popular areas of
generative adversarial networks, deep regression Bayesian
networks, and model compression and acceleration. We
hope these articles will encourage further discussion and
facilitate applications of deep-learning techniques for computer vision to other areas of signal processing.
COVER IMAGE: ©ISTOCKPHOTO.COM/MONSITJ

53

MODEL COMPRESSION
AND ACCELERATION FOR
DEEP NEURAL NETWORKS

Yu Cheng, Duo Wang, Pan Zhou,
and Tao Zhang

FEATURE
137

ANALOG-TO-DIGITAL
COGNITIVE RADIO

Deborah Cohen, Shahar Tsiper,
and Yonina C. Eldar

GENERATIVE ADVERSARIAL
NETWORKS

NEWCASTLE UNIVERSITY

66
PG. 13

BACKGROUND-©ISTOCKPHOTO.COM/GONIN,
CIRCLES-©ISTOCKPHOTO.COM/ENJOYNZ

Antonia Creswell, Tom White,
Vincent Dumoulin, Kai
Arulkumaran, Biswa Sengupta,
and Anil A. Bharath

DEEP LEARNING FOR
UNDERSTANDING FACES

Rajeev Ranjan, Swami
Sankaranarayanan, Ankan Bansal,
Navaneeth Bodla, Jun-Cheng Chen,
Vishal M. Patel, Carlos D. Castillo,
and Rama Chellappa

PG. 137

IEEE SIGNAL PROCESSING MAGAZINE (ISSN 1053-5888) (ISPREG) is published bimonthly by the Institute of Electrical and Electronics Engineers, Inc., 3 Park Avenue, 17th Floor, New York,
NY 10016-5997 USA (+1 212 419 7900). Responsibility for the contents rests upon the authors and not the IEEE, the Society, or its members. Annual member subscriptions included in Society fee.
Nonmember subscriptions available upon request. Individual copies: IEEE Members US$20.00 (first copy only), nonmembers US$241.00 per copy. Copyright and Reprint Permissions: Abstracting is
permitted with credit to the source. Libraries are permitted to photocopy beyond the limits of U.S. Copyright Law for private use of patrons: 1) those post-1977 articles that carry a code at the bottom of
the first page, provided the per-copy fee indicated in the code is paid through the Copyright Clearance Center, 222 Rosewood Drive, Danvers, MA 01923 USA; 2) pre-1978 articles without fee. Instructors
are permitted to photocopy isolated articles for noncommercial classroom use without fee. For all other copying, reprint, or republication permission, write to IEEE Service Center, 445 Hoes Lane,
Piscataway, NJ 08854 USA. Copyright © 2018 by the Institute of Electrical and Electronics Engineers, Inc. All rights reserved. Periodicals postage paid at New York, NY, and at additional mailing offices.
Postmaster: Send address changes to IEEE Signal Processing Magazine, IEEE, 445 Hoes Lane, Piscataway, NJ 08854 USA. Canadian GST #125634188
Printed in the U.S.A.

Digital Object Identifier 10.1109/MSP.2017.2770479

IEEE SIGNAL PROCESSING MAGAZINE

|

January 2018

|

1


http://www.ISTOCKPHOTO.COM/MONSITJ

Table of Contents for the Digital Edition of IEEE Signal Processing Magazine - January 2018

Contents
IEEE Signal Processing Magazine - January 2018 - Cover1
IEEE Signal Processing Magazine - January 2018 - Cover2
IEEE Signal Processing Magazine - January 2018 - Contents
IEEE Signal Processing Magazine - January 2018 - 2
IEEE Signal Processing Magazine - January 2018 - 3
IEEE Signal Processing Magazine - January 2018 - 4
IEEE Signal Processing Magazine - January 2018 - 5
IEEE Signal Processing Magazine - January 2018 - 6
IEEE Signal Processing Magazine - January 2018 - 7
IEEE Signal Processing Magazine - January 2018 - 8
IEEE Signal Processing Magazine - January 2018 - 9
IEEE Signal Processing Magazine - January 2018 - 10
IEEE Signal Processing Magazine - January 2018 - 11
IEEE Signal Processing Magazine - January 2018 - 12
IEEE Signal Processing Magazine - January 2018 - 13
IEEE Signal Processing Magazine - January 2018 - 14
IEEE Signal Processing Magazine - January 2018 - 15
IEEE Signal Processing Magazine - January 2018 - 16
IEEE Signal Processing Magazine - January 2018 - 17
IEEE Signal Processing Magazine - January 2018 - 18
IEEE Signal Processing Magazine - January 2018 - 19
IEEE Signal Processing Magazine - January 2018 - 20
IEEE Signal Processing Magazine - January 2018 - 21
IEEE Signal Processing Magazine - January 2018 - 22
IEEE Signal Processing Magazine - January 2018 - 23
IEEE Signal Processing Magazine - January 2018 - 24
IEEE Signal Processing Magazine - January 2018 - 25
IEEE Signal Processing Magazine - January 2018 - 26
IEEE Signal Processing Magazine - January 2018 - 27
IEEE Signal Processing Magazine - January 2018 - 28
IEEE Signal Processing Magazine - January 2018 - 29
IEEE Signal Processing Magazine - January 2018 - 30
IEEE Signal Processing Magazine - January 2018 - 31
IEEE Signal Processing Magazine - January 2018 - 32
IEEE Signal Processing Magazine - January 2018 - 33
IEEE Signal Processing Magazine - January 2018 - 34
IEEE Signal Processing Magazine - January 2018 - 35
IEEE Signal Processing Magazine - January 2018 - 36
IEEE Signal Processing Magazine - January 2018 - 37
IEEE Signal Processing Magazine - January 2018 - 38
IEEE Signal Processing Magazine - January 2018 - 39
IEEE Signal Processing Magazine - January 2018 - 40
IEEE Signal Processing Magazine - January 2018 - 41
IEEE Signal Processing Magazine - January 2018 - 42
IEEE Signal Processing Magazine - January 2018 - 43
IEEE Signal Processing Magazine - January 2018 - 44
IEEE Signal Processing Magazine - January 2018 - 45
IEEE Signal Processing Magazine - January 2018 - 46
IEEE Signal Processing Magazine - January 2018 - 47
IEEE Signal Processing Magazine - January 2018 - 48
IEEE Signal Processing Magazine - January 2018 - 49
IEEE Signal Processing Magazine - January 2018 - 50
IEEE Signal Processing Magazine - January 2018 - 51
IEEE Signal Processing Magazine - January 2018 - 52
IEEE Signal Processing Magazine - January 2018 - 53
IEEE Signal Processing Magazine - January 2018 - 54
IEEE Signal Processing Magazine - January 2018 - 55
IEEE Signal Processing Magazine - January 2018 - 56
IEEE Signal Processing Magazine - January 2018 - 57
IEEE Signal Processing Magazine - January 2018 - 58
IEEE Signal Processing Magazine - January 2018 - 59
IEEE Signal Processing Magazine - January 2018 - 60
IEEE Signal Processing Magazine - January 2018 - 61
IEEE Signal Processing Magazine - January 2018 - 62
IEEE Signal Processing Magazine - January 2018 - 63
IEEE Signal Processing Magazine - January 2018 - 64
IEEE Signal Processing Magazine - January 2018 - 65
IEEE Signal Processing Magazine - January 2018 - 66
IEEE Signal Processing Magazine - January 2018 - 67
IEEE Signal Processing Magazine - January 2018 - 68
IEEE Signal Processing Magazine - January 2018 - 69
IEEE Signal Processing Magazine - January 2018 - 70
IEEE Signal Processing Magazine - January 2018 - 71
IEEE Signal Processing Magazine - January 2018 - 72
IEEE Signal Processing Magazine - January 2018 - 73
IEEE Signal Processing Magazine - January 2018 - 74
IEEE Signal Processing Magazine - January 2018 - 75
IEEE Signal Processing Magazine - January 2018 - 76
IEEE Signal Processing Magazine - January 2018 - 77
IEEE Signal Processing Magazine - January 2018 - 78
IEEE Signal Processing Magazine - January 2018 - 79
IEEE Signal Processing Magazine - January 2018 - 80
IEEE Signal Processing Magazine - January 2018 - 81
IEEE Signal Processing Magazine - January 2018 - 82
IEEE Signal Processing Magazine - January 2018 - 83
IEEE Signal Processing Magazine - January 2018 - 84
IEEE Signal Processing Magazine - January 2018 - 85
IEEE Signal Processing Magazine - January 2018 - 86
IEEE Signal Processing Magazine - January 2018 - 87
IEEE Signal Processing Magazine - January 2018 - 88
IEEE Signal Processing Magazine - January 2018 - 89
IEEE Signal Processing Magazine - January 2018 - 90
IEEE Signal Processing Magazine - January 2018 - 91
IEEE Signal Processing Magazine - January 2018 - 92
IEEE Signal Processing Magazine - January 2018 - 93
IEEE Signal Processing Magazine - January 2018 - 94
IEEE Signal Processing Magazine - January 2018 - 95
IEEE Signal Processing Magazine - January 2018 - 96
IEEE Signal Processing Magazine - January 2018 - 97
IEEE Signal Processing Magazine - January 2018 - 98
IEEE Signal Processing Magazine - January 2018 - 99
IEEE Signal Processing Magazine - January 2018 - 100
IEEE Signal Processing Magazine - January 2018 - 101
IEEE Signal Processing Magazine - January 2018 - 102
IEEE Signal Processing Magazine - January 2018 - 103
IEEE Signal Processing Magazine - January 2018 - 104
IEEE Signal Processing Magazine - January 2018 - 105
IEEE Signal Processing Magazine - January 2018 - 106
IEEE Signal Processing Magazine - January 2018 - 107
IEEE Signal Processing Magazine - January 2018 - 108
IEEE Signal Processing Magazine - January 2018 - 109
IEEE Signal Processing Magazine - January 2018 - 110
IEEE Signal Processing Magazine - January 2018 - 111
IEEE Signal Processing Magazine - January 2018 - 112
IEEE Signal Processing Magazine - January 2018 - 113
IEEE Signal Processing Magazine - January 2018 - 114
IEEE Signal Processing Magazine - January 2018 - 115
IEEE Signal Processing Magazine - January 2018 - 116
IEEE Signal Processing Magazine - January 2018 - 117
IEEE Signal Processing Magazine - January 2018 - 118
IEEE Signal Processing Magazine - January 2018 - 119
IEEE Signal Processing Magazine - January 2018 - 120
IEEE Signal Processing Magazine - January 2018 - 121
IEEE Signal Processing Magazine - January 2018 - 122
IEEE Signal Processing Magazine - January 2018 - 123
IEEE Signal Processing Magazine - January 2018 - 124
IEEE Signal Processing Magazine - January 2018 - 125
IEEE Signal Processing Magazine - January 2018 - 126
IEEE Signal Processing Magazine - January 2018 - 127
IEEE Signal Processing Magazine - January 2018 - 128
IEEE Signal Processing Magazine - January 2018 - 129
IEEE Signal Processing Magazine - January 2018 - 130
IEEE Signal Processing Magazine - January 2018 - 131
IEEE Signal Processing Magazine - January 2018 - 132
IEEE Signal Processing Magazine - January 2018 - 133
IEEE Signal Processing Magazine - January 2018 - 134
IEEE Signal Processing Magazine - January 2018 - 135
IEEE Signal Processing Magazine - January 2018 - 136
IEEE Signal Processing Magazine - January 2018 - 137
IEEE Signal Processing Magazine - January 2018 - 138
IEEE Signal Processing Magazine - January 2018 - 139
IEEE Signal Processing Magazine - January 2018 - 140
IEEE Signal Processing Magazine - January 2018 - 141
IEEE Signal Processing Magazine - January 2018 - 142
IEEE Signal Processing Magazine - January 2018 - 143
IEEE Signal Processing Magazine - January 2018 - 144
IEEE Signal Processing Magazine - January 2018 - 145
IEEE Signal Processing Magazine - January 2018 - 146
IEEE Signal Processing Magazine - January 2018 - 147
IEEE Signal Processing Magazine - January 2018 - 148
IEEE Signal Processing Magazine - January 2018 - 149
IEEE Signal Processing Magazine - January 2018 - 150
IEEE Signal Processing Magazine - January 2018 - 151
IEEE Signal Processing Magazine - January 2018 - 152
IEEE Signal Processing Magazine - January 2018 - 153
IEEE Signal Processing Magazine - January 2018 - 154
IEEE Signal Processing Magazine - January 2018 - 155
IEEE Signal Processing Magazine - January 2018 - 156
IEEE Signal Processing Magazine - January 2018 - 157
IEEE Signal Processing Magazine - January 2018 - 158
IEEE Signal Processing Magazine - January 2018 - 159
IEEE Signal Processing Magazine - January 2018 - 160
IEEE Signal Processing Magazine - January 2018 - 161
IEEE Signal Processing Magazine - January 2018 - 162
IEEE Signal Processing Magazine - January 2018 - 163
IEEE Signal Processing Magazine - January 2018 - 164
IEEE Signal Processing Magazine - January 2018 - 165
IEEE Signal Processing Magazine - January 2018 - 166
IEEE Signal Processing Magazine - January 2018 - 167
IEEE Signal Processing Magazine - January 2018 - 168
IEEE Signal Processing Magazine - January 2018 - 169
IEEE Signal Processing Magazine - January 2018 - 170
IEEE Signal Processing Magazine - January 2018 - 171
IEEE Signal Processing Magazine - January 2018 - 172
IEEE Signal Processing Magazine - January 2018 - 173
IEEE Signal Processing Magazine - January 2018 - 174
IEEE Signal Processing Magazine - January 2018 - 175
IEEE Signal Processing Magazine - January 2018 - 176
IEEE Signal Processing Magazine - January 2018 - 177
IEEE Signal Processing Magazine - January 2018 - 178
IEEE Signal Processing Magazine - January 2018 - 179
IEEE Signal Processing Magazine - January 2018 - 180
IEEE Signal Processing Magazine - January 2018 - Cover3
IEEE Signal Processing Magazine - January 2018 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201809
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201807
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201805
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201803
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201801
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1117
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0917
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0717
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0517
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0317
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0117
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1116
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0916
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0716
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0516
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0316
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0116
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1115
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0915
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0715
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0515
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0315
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0115
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1114
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0914
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0714
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0514
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0314
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0114
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1113
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0913
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0713
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0513
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0313
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0113
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1112
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0912
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0712
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0512
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0312
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0112
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1111
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0911
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0711
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0511
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0311
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0111
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1110
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0910
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0710
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0510
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0310
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0110
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1109
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0909
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0709
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0509
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0309
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0109
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1108
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0908
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0708
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0508
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0308
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0108
https://www.nxtbookmedia.com