Content Gazette - December 2021 - 24

Contents
Volume 38 | Number 6 | November 2021
SPECIAL SECTION
INTELLIGENT SIGNAL PROCESSING
FOR AFFECTIVE COMPUTING
9 FROM THE GUEST EDITORS
Björn W. Schuller, Rosalind Picard,
Elisabeth André, Jonathan Gratch,
and Jianhua Tao
12 ON THE EVOLUTION OF SPEECH
REPRESENTATIONS FOR
AFFECTIVE COMPUTING
Sina Alisamir and Fabien Ringeval
22 DEEP REPRESENTATION LEARNING
FOR AFFECTIVE SPEECH SIGNAL
ANALYSIS AND PROCESSING
Chi-Chun Lee, Kusha Sridhar,
Jeng-Lin Li, Wei-Cheng Lin,
Bo-Hao Su, and Carlos Busso
39 THE HITCHHIKER'S GUIDE TO
BIAS AND FAIRNESS IN FACIAL
AFFECTIVE SIGNAL PROCESSING
Jiaee Cheong, Sinan Kalkan, and
Hatice Gunes
84 INTEGRATING PSYCHOMETRICS
AND COMPUTING PERSPECTIVES
ON BIAS AND FAIRNESS IN
AFFECTIVE COMPUTING
Brandon M. Booth, Louis Hickman,
Shree Krishna Subburaj,
Louis Tay, Sang Eun Woo,
and Sidney K. D'Mello
96 DEEP LEARNING FOR MOBILE
MENTAL HEALTH
Jing Han, Zixing Zhang,
Cecilia Mascolo, Elisabeth André,
Jianhua Tao, Ziping Zhao, and
Björn W. Schuller
106 MUSIC EMOTION RECOGNITION
Juan Sebastián Gómez-Cañón,
Estefanía Cano, Tuomas Eerola,
Perfecto Herrera, Xiao Hu,
Yi-Hsuan Yang, and Emilia Gómez
ON THE COVER
In this special issue of IEEE Signal Processing Magazine,
we survey recent advances in affective computing with a
focus on intelligent signal processing. The nine articles
cover key topics including speech, music, facial, and general
multimodal affective state recognition from individuals
or groups, bias and fairness issues, as well as the application
in mobile health.
COVER IMAGE: AI IMAGES: ©SHUTTERSTOCK.COM/ASLYSUN,
BACKGROUND IMAGE LICENSED BY INGRAM PUBLISHING
FEATURE
115 AUDIO-BASED MUSICAL
VERSION IDENTIFICATION
Furkan Yesiler, Guillaume Doras,
Rachel M. Bittner, Christopher J.
Tralie, and Joan Serrà
50 FACIAL-VIDEO-BASED
PHYSIOLOGICAL SIGNAL
MEASUREMENT
Zitong Yu, Xiaobai Li,
and Guoying Zhao
15 m
59 EMOTION RECOGNITION FROM
MULTIPLE MODALITIES
Sicheng Zhao, Guoli Jia,
Jufeng Yang, Guiguang Ding,
and Kurt Keutzer
PG. 6
74 AFFECTS IN GROUPS
Ronald Böck
20 m
13.2
31.4
51.9
Passive RIS
Specular Reflection
Active RIS
11.8
30.8
50.7
10.4
30.1
49.4
5 m
PG. 146
IEEE SIGNAL PROCESSING MAGAZINE (ISSN 1053-5888) (ISPREG) is published bimonthly by the Institute of Electrical and Electronics Engineers, Inc., 3 Park Avenue, 17th Floor, New York,
NY 10016-5997 USA (+1 212 419 7900). Responsibility for the contents rests upon the authors and not the IEEE, the Society, or its members. Annual member subscriptions included in Society fee.
Nonmember subscriptions available upon request. Individual copies: IEEE Members US$20.00 (first copy only), nonmembers US$248 per copy. Copyright and Reprint Permissions: Abstracting
is permitted with credit to the source. Libraries are permitted to photocopy beyond the limits of U.S. Copyright Law for private use of patrons: 1) those post-1977 articles that carry a code at the bottom
of the first page, provided the per-copy fee is paid through the Copyright Clearance Center, 222 Rosewood Drive, Danvers, MA 01923 USA; 2) pre-1978 articles without fee. Instructors are
permitted to photocopy isolated articles for noncommercial classroom use without fee. For all other copying, reprint, or republication permission, write to IEEE Service Center, 445 Hoes Lane,
Piscataway, NJ 08854 USA. Copyright © 2021 by the Institute of Electrical and Electronics Engineers, Inc. All rights reserved. Periodicals postage paid at New York, NY, and at additional mailing offices.
Postmaster: Send address changes to IEEE Signal Processing Magazine, IEEE, 445 Hoes Lane, Piscataway, NJ 08854 USA. Canadian GST #125634188
Printed in the U.S.A.
Digital Object Identifier 10.1109/MSP.2021.3096151
www.signalprocessingsociety.org [24] DECEMBER 2021
IEEE SIGNAL PROCESSING MAGAZINE | November 2021 |
IEEE SIGNAL PROCESSING MAGAZINE | May 2021 |
1
9 5 m
29.3
48.1
10 m
y
RIS
21.3
34.2
57.7
5 m
17.4
33.1
55.2
16.4
32.7
55.5
14.2
31.9
52.8
14.3
31.9
52.9
12
30.9
50.9
12.2
31
51.1
x
10.5
30.1
49.5
https://ieeexplore.ieee.org/document/9591546 https://ieeexplore.ieee.org/document/9591552 https://ieeexplore.ieee.org/document/9591544 https://ieeexplore.ieee.org/document/9591500 https://ieeexplore.ieee.org/document/9591504 https://ieeexplore.ieee.org/document/9591501 https://ieeexplore.ieee.org/document/9591555 https://ieeexplore.ieee.org/document/9591505 https://ieeexplore.ieee.org/document/9591544 https://ieeexplore.ieee.org/document/9591556 https://ieeexplore.ieee.org/document/9591552 https://ieeexplore.ieee.org/document/9591548 https://ieeexplore.ieee.org/document/9591503 https://ieeexplore.ieee.org/document/9591550 https://ieeexplore.ieee.org/document/9591502 http://www.signalprocessingsociety.org

Content Gazette - December 2021

Table of Contents for the Digital Edition of Content Gazette - December 2021

Content Gazette - December 2021 - Cover1
Content Gazette - December 2021 - Cover2
Content Gazette - December 2021 - 1
Content Gazette - December 2021 - 2
Content Gazette - December 2021 - 3
Content Gazette - December 2021 - 4
Content Gazette - December 2021 - 5
Content Gazette - December 2021 - 6
Content Gazette - December 2021 - 7
Content Gazette - December 2021 - 8
Content Gazette - December 2021 - 9
Content Gazette - December 2021 - 10
Content Gazette - December 2021 - 11
Content Gazette - December 2021 - 12
Content Gazette - December 2021 - 13
Content Gazette - December 2021 - 14
Content Gazette - December 2021 - 15
Content Gazette - December 2021 - 16
Content Gazette - December 2021 - 17
Content Gazette - December 2021 - 18
Content Gazette - December 2021 - 19
Content Gazette - December 2021 - 20
Content Gazette - December 2021 - 21
Content Gazette - December 2021 - 22
Content Gazette - December 2021 - 23
Content Gazette - December 2021 - 24
Content Gazette - December 2021 - 25
Content Gazette - December 2021 - 26
Content Gazette - December 2021 - 27
Content Gazette - December 2021 - 28
Content Gazette - December 2021 - 29
Content Gazette - December 2021 - 30
Content Gazette - December 2021 - Cover3
Content Gazette - December 2021 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202312
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202311
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202310
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202309
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202308
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202307
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202306
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202305
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202304
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202303
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202302
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202301
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202212
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202211
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202210
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202209
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202208
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202207
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202206
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202205
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202204
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202203
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202202
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202201
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202112
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202111
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202110
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202109
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202108
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202107
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202106
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202105
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202104
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202103
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202102
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202101
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202012
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202011
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202010
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202009
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202008
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202007
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202006
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202005
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202004
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202003
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202002
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_202001
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201912
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201911
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201910
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201909
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201908
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201907
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201906
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201905
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201904
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201903
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201902
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201901
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201812
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201811
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201810
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201809
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201808
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201807
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201806
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201805
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201804
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201803
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201802
https://www.nxtbook.com/nxtbooks/ieee/contentgazette_201801
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1217
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1117
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1017
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0917
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0817
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0717
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0617
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0517
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0417
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0317
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0217
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0117
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1216
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1116
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1016
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0916
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0816
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0716
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0616
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0516
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0416
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0316
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0216
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0116
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1215
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1115
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1015
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0915
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0815
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0715
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0615
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0515
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0415
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0315
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0215
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0115
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1214
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1114
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1014
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0914
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0814
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0714
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0614
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0514
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0414
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0314
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0214
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0114
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1213
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1113
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1013
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0913
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0813
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0713
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0613
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0513
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0413
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0313
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0213
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0113
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1212
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1112
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1012
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0912
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0812
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0712
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0612
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0512
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0412
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0312
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0212
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0112
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1211
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1111
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_1011
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0911
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0811
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0711
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0611
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0511
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0411
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0311
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0211
https://www.nxtbook.com/nxtbooks/ieee/content_gazette_0111
https://www.nxtbookmedia.com