IEEE - Aerospace and Electronic Systems - July 2021 - 80

Feature Article:
DOI. No. 10.1109/MAES.2020.3049030
Machine Learning/Artificial Intelligence for Sensor
Data Fusion-Opportunities and Challenges
Erik Blasch , Air Force Office of Scientific Research, Arlington, VA 22203
USA
Tien Pham
Chee-Yee Chong , Independent Consultant, San Jose, CA 94024 USA
Wolfgang Koch
, Army Research Laboratory, Adelphi, MD 20783 USA
, Fraunhofer FKIE, D-53343 Wachtberg, Germany;
University of Bonn, 53113 Bonn, Germany
Henry Leung , University of Calgary, Calgary, AB T2N 1N4, Canada
Dave Braines, IBM, Hants SO21 2JN, U.K., Cardiff University, Cardiff
CF10 3AT, U.K.
Tarek Abdelzaher
61801 USA
, University of Illinois at Urbana-Champaign, Urbana, IL
INTRODUCTION
Machine learning (ML) methods are fundamental to the philosophy
of artificial intelligence (AI) approaches. With the
advent of the computer in the 1960s, both ML and sensor
datafusion (SDF) took prominence in the engineering community
with such developments of the Kalman filter, Bayesian
decision trees, expert systems, and probabilistic reasoning
Author's current addresses: Erik Blasch, Air Force
Office of Scientific Research, Arlington, VA 22203 USA
(e-mail: erik.blasch@gmail.com). Tien Pham, Army
Research Laboratory, Adelphi, MD 20783 USA (e-mail:
tien.pham1.civ@mail.mil). Chee-Yee Chong, Independent
Consultant, San Jose, CA 94024 USA (e-mail:
chee.y.chong@gmail.com). Wolfgang Koch, Fraunhofer
FKIE, D-53343 Wachtberg, Germany, and also University
of Bonn, 53113 Bonn, Germany (e-mail: wolfgang.
koch@fkie.fraunhofer.de). Henry Leung, University of
Calgary, Calgary, AB T2N 1N4, Canada (e-mail: leungh@ucalgary.ca).
Dave Braines, IBM United Kingdom
Limited, Hants SO21 2JN, U.K., and also Cardiff University,
Cardiff CF10 3AT, U.K. (e-mail: dave_braines@uk.ibm.com).
Tarek Abdelzaher, University of
Illinois at Urbana-Champaign, Urbana, IL 61801 USA
(e-mail: zaher@illinois.edu).
Manuscript received October 31, 2019, revised October
1, 2020; accepted October 4, 2020, and ready for
publication December 31, 2020.
Review handled by Peter Willett.
0885-8985/21/$26.00 ß U.S. Government work not
protected by U.S. copyright
80
[1]. While SDF expanded to multimodal analysis and informationfusioninthe
1990s[2],trendsinthe 21st century
include big data, uncertainty reduction, user coordination [3],
context reasoning [4], and multi-modal analysis, but it is only
in the last decade that a radical change in the AI/ML methods
surfaced with most notably deep learning (DL) [5], graphical
processing units, and reusable software.
AI/ML and data analytics pose both challenges and
opportunities for SDF. The challenges arise because they
appear to address the same problems as information fusion
(see Figure 1); however, SDF seeks methods for situation
and impact assessment, while AI/ML focuses on big data
analytics supporting object assessment classification.
These challenges can also be opportunities as AI/ML
spawned new research in deploying physics-based and
human-derived information fusion (PHIF), learning about
context, tracking with graph fusion, coordinating Internet
of Things (IoT) security, as well as facilitating dynamic
network analysis for multi-domain operations (MDO).
The 2019 panel members (i.e., the authors of this paper)
focused on AI/ML issues relating to SDF, illustrating potential
approaches and addressing challenges as summarized in
Table 1. Each panelist focused on the following questions.
What is the SDF problem?
Which part of the SDF problem needs machine
learning and why?
Where are opportunities to bring together AI/ML
and SDF?
When do challenges arise using machine learning
for SDF?
IEEE A&E SYSTEMS MAGAZINE
JULY 2021
https://www.orcid.org/0000-0001-6894-6108 https://www.orcid.org/0000-0001-6894-6108 https://www.orcid.org/0000-0001-6894-6108 https://www.orcid.org/0000-0001-6894-6108 https://www.orcid.org/0000-0001-6894-6108 https://www.orcid.org/0000-0003-1924-7604 https://www.orcid.org/0000-0003-1924-7604 https://www.orcid.org/0000-0003-1924-7604 https://www.orcid.org/0000-0003-1924-7604 https://www.orcid.org/0000-0003-1924-7604 https://www.orcid.org/0000-0002-8234-184X https://www.orcid.org/0000-0002-8234-184X https://www.orcid.org/0000-0002-8234-184X https://www.orcid.org/0000-0002-8234-184X https://www.orcid.org/0000-0002-8234-184X https://www.orcid.org/0000-0002-5734-3325 https://www.orcid.org/0000-0002-5734-3325 https://www.orcid.org/0000-0002-5734-3325 https://www.orcid.org/0000-0002-5734-3325 https://www.orcid.org/0000-0002-5734-3325 https://www.orcid.org/0000-0002-5984-107X https://www.orcid.org/0000-0002-5984-107X https://www.orcid.org/0000-0002-5984-107X https://www.orcid.org/0000-0002-5984-107X https://www.orcid.org/0000-0002-5984-107X https://www.orcid.org/0000-0003-3883-7220 https://www.orcid.org/0000-0003-3883-7220 https://www.orcid.org/0000-0003-3883-7220 https://www.orcid.org/0000-0003-3883-7220 https://www.orcid.org/0000-0003-3883-7220

IEEE - Aerospace and Electronic Systems - July 2021

Table of Contents for the Digital Edition of IEEE - Aerospace and Electronic Systems - July 2021

Contents
IEEE - Aerospace and Electronic Systems - July 2021 - Cover1
IEEE - Aerospace and Electronic Systems - July 2021 - Cover2
IEEE - Aerospace and Electronic Systems - July 2021 - Contents
IEEE - Aerospace and Electronic Systems - July 2021 - 2
IEEE - Aerospace and Electronic Systems - July 2021 - 3
IEEE - Aerospace and Electronic Systems - July 2021 - 4
IEEE - Aerospace and Electronic Systems - July 2021 - 5
IEEE - Aerospace and Electronic Systems - July 2021 - 6
IEEE - Aerospace and Electronic Systems - July 2021 - 7
IEEE - Aerospace and Electronic Systems - July 2021 - 8
IEEE - Aerospace and Electronic Systems - July 2021 - 9
IEEE - Aerospace and Electronic Systems - July 2021 - 10
IEEE - Aerospace and Electronic Systems - July 2021 - 11
IEEE - Aerospace and Electronic Systems - July 2021 - 12
IEEE - Aerospace and Electronic Systems - July 2021 - 13
IEEE - Aerospace and Electronic Systems - July 2021 - 14
IEEE - Aerospace and Electronic Systems - July 2021 - 15
IEEE - Aerospace and Electronic Systems - July 2021 - 16
IEEE - Aerospace and Electronic Systems - July 2021 - 17
IEEE - Aerospace and Electronic Systems - July 2021 - 18
IEEE - Aerospace and Electronic Systems - July 2021 - 19
IEEE - Aerospace and Electronic Systems - July 2021 - 20
IEEE - Aerospace and Electronic Systems - July 2021 - 21
IEEE - Aerospace and Electronic Systems - July 2021 - 22
IEEE - Aerospace and Electronic Systems - July 2021 - 23
IEEE - Aerospace and Electronic Systems - July 2021 - 24
IEEE - Aerospace and Electronic Systems - July 2021 - 25
IEEE - Aerospace and Electronic Systems - July 2021 - 26
IEEE - Aerospace and Electronic Systems - July 2021 - 27
IEEE - Aerospace and Electronic Systems - July 2021 - 28
IEEE - Aerospace and Electronic Systems - July 2021 - 29
IEEE - Aerospace and Electronic Systems - July 2021 - 30
IEEE - Aerospace and Electronic Systems - July 2021 - 31
IEEE - Aerospace and Electronic Systems - July 2021 - 32
IEEE - Aerospace and Electronic Systems - July 2021 - 33
IEEE - Aerospace and Electronic Systems - July 2021 - 34
IEEE - Aerospace and Electronic Systems - July 2021 - 35
IEEE - Aerospace and Electronic Systems - July 2021 - 36
IEEE - Aerospace and Electronic Systems - July 2021 - 37
IEEE - Aerospace and Electronic Systems - July 2021 - 38
IEEE - Aerospace and Electronic Systems - July 2021 - 39
IEEE - Aerospace and Electronic Systems - July 2021 - 40
IEEE - Aerospace and Electronic Systems - July 2021 - 41
IEEE - Aerospace and Electronic Systems - July 2021 - 42
IEEE - Aerospace and Electronic Systems - July 2021 - 43
IEEE - Aerospace and Electronic Systems - July 2021 - 44
IEEE - Aerospace and Electronic Systems - July 2021 - 45
IEEE - Aerospace and Electronic Systems - July 2021 - 46
IEEE - Aerospace and Electronic Systems - July 2021 - 47
IEEE - Aerospace and Electronic Systems - July 2021 - 48
IEEE - Aerospace and Electronic Systems - July 2021 - 49
IEEE - Aerospace and Electronic Systems - July 2021 - 50
IEEE - Aerospace and Electronic Systems - July 2021 - 51
IEEE - Aerospace and Electronic Systems - July 2021 - 52
IEEE - Aerospace and Electronic Systems - July 2021 - 53
IEEE - Aerospace and Electronic Systems - July 2021 - 54
IEEE - Aerospace and Electronic Systems - July 2021 - 55
IEEE - Aerospace and Electronic Systems - July 2021 - 56
IEEE - Aerospace and Electronic Systems - July 2021 - 57
IEEE - Aerospace and Electronic Systems - July 2021 - 58
IEEE - Aerospace and Electronic Systems - July 2021 - 59
IEEE - Aerospace and Electronic Systems - July 2021 - 60
IEEE - Aerospace and Electronic Systems - July 2021 - 61
IEEE - Aerospace and Electronic Systems - July 2021 - 62
IEEE - Aerospace and Electronic Systems - July 2021 - 63
IEEE - Aerospace and Electronic Systems - July 2021 - 64
IEEE - Aerospace and Electronic Systems - July 2021 - 65
IEEE - Aerospace and Electronic Systems - July 2021 - 66
IEEE - Aerospace and Electronic Systems - July 2021 - 67
IEEE - Aerospace and Electronic Systems - July 2021 - 68
IEEE - Aerospace and Electronic Systems - July 2021 - 69
IEEE - Aerospace and Electronic Systems - July 2021 - 70
IEEE - Aerospace and Electronic Systems - July 2021 - 71
IEEE - Aerospace and Electronic Systems - July 2021 - 72
IEEE - Aerospace and Electronic Systems - July 2021 - 73
IEEE - Aerospace and Electronic Systems - July 2021 - 74
IEEE - Aerospace and Electronic Systems - July 2021 - 75
IEEE - Aerospace and Electronic Systems - July 2021 - 76
IEEE - Aerospace and Electronic Systems - July 2021 - 77
IEEE - Aerospace and Electronic Systems - July 2021 - 78
IEEE - Aerospace and Electronic Systems - July 2021 - 79
IEEE - Aerospace and Electronic Systems - July 2021 - 80
IEEE - Aerospace and Electronic Systems - July 2021 - 81
IEEE - Aerospace and Electronic Systems - July 2021 - 82
IEEE - Aerospace and Electronic Systems - July 2021 - 83
IEEE - Aerospace and Electronic Systems - July 2021 - 84
IEEE - Aerospace and Electronic Systems - July 2021 - 85
IEEE - Aerospace and Electronic Systems - July 2021 - 86
IEEE - Aerospace and Electronic Systems - July 2021 - 87
IEEE - Aerospace and Electronic Systems - July 2021 - 88
IEEE - Aerospace and Electronic Systems - July 2021 - 89
IEEE - Aerospace and Electronic Systems - July 2021 - 90
IEEE - Aerospace and Electronic Systems - July 2021 - 91
IEEE - Aerospace and Electronic Systems - July 2021 - 92
IEEE - Aerospace and Electronic Systems - July 2021 - 93
IEEE - Aerospace and Electronic Systems - July 2021 - 94
IEEE - Aerospace and Electronic Systems - July 2021 - 95
IEEE - Aerospace and Electronic Systems - July 2021 - 96
IEEE - Aerospace and Electronic Systems - July 2021 - 97
IEEE - Aerospace and Electronic Systems - July 2021 - 98
IEEE - Aerospace and Electronic Systems - July 2021 - 99
IEEE - Aerospace and Electronic Systems - July 2021 - 100
IEEE - Aerospace and Electronic Systems - July 2021 - 101
IEEE - Aerospace and Electronic Systems - July 2021 - 102
IEEE - Aerospace and Electronic Systems - July 2021 - 103
IEEE - Aerospace and Electronic Systems - July 2021 - 104
IEEE - Aerospace and Electronic Systems - July 2021 - 105
IEEE - Aerospace and Electronic Systems - July 2021 - 106
IEEE - Aerospace and Electronic Systems - July 2021 - 107
IEEE - Aerospace and Electronic Systems - July 2021 - 108
IEEE - Aerospace and Electronic Systems - July 2021 - 109
IEEE - Aerospace and Electronic Systems - July 2021 - 110
IEEE - Aerospace and Electronic Systems - July 2021 - 111
IEEE - Aerospace and Electronic Systems - July 2021 - 112
IEEE - Aerospace and Electronic Systems - July 2021 - 113
IEEE - Aerospace and Electronic Systems - July 2021 - 114
IEEE - Aerospace and Electronic Systems - July 2021 - 115
IEEE - Aerospace and Electronic Systems - July 2021 - 116
IEEE - Aerospace and Electronic Systems - July 2021 - 117
IEEE - Aerospace and Electronic Systems - July 2021 - 118
IEEE - Aerospace and Electronic Systems - July 2021 - 119
IEEE - Aerospace and Electronic Systems - July 2021 - 120
IEEE - Aerospace and Electronic Systems - July 2021 - Cover3
IEEE - Aerospace and Electronic Systems - July 2021 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2022_tutorial
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2021_tutorials
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2019partII
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2018
https://www.nxtbookmedia.com