IEEE - Aerospace and Electronic Systems - June 2022 - 6
Feature Article::
DOI. No. 10.1109/MAES.2021.3053108
Using MLSTM and Multioutput Convolutional LSTM
Algorithms for Detecting Anomalous Patterns in
Streamed Data of Unmanned Aerial Vehicles
Ahmad Alos and Zouhair Dahrouj, Higher Institute for Applied Sciences and
Technology, Damascus, Syria
INTRODUCTION
During flights, the unmanned aerial vehicle (UAV) sends
back large amounts of telemetry data to a ground station.
The telemetry data are stored in rows, where each data
row contains the values of the UAV attributes. These
attributes are either commands (altitude command, the
rudder command, and the aileron command) or sensor
readings (airspeed, pitch, roll, and yaw). This incoming
data are heterogonous and grows in size very rapidly.
Human monitoring of the collected data is not sufficient to
identify anomalous cases instantly, which could indicate a
potential fault of the system. A possible fault might result
in a system failure, where the chances of catastrophic situations
are high. Hence, it is a matter of paramount necessity
to design efficient algorithms to extract abnormal
instances from the data flow of the concerned sensors and
label these extracted instances as potential faults [2]. To
foresee system failure, we use anomaly detection algorithms.
Anomaly detection algorithms find patterns in data
that do not follow an expected behavior [5]. Usually,
anomaly detection algorithms operate in one of three
modes [5], [19]: Supervised, semisupervised, and unsupervised.
The supervised anomaly detection algorithms
assume the availability of training data with given labels
for the Normal class as well as for the Anomalous class.
The semisupervised algorithms assume the training data
Authors' current addresses: Ahmad Alos, Zouhair Dahrouj,
Higher Institute for Applied Sciences and Technology,
Damascus, Syria (e-mails: ahmad.alos@hiast.edu.
sy; zouhair.dahrouj@hiast.edu.sy).
Manuscript received June 7, 2020, revised September 5,
2020; accepted January 5, 2021, and ready for
publication January 18, 2021.
Review handled by Tai-Hoon Kim.
0885-8985/21/$26.00 ß 2021 IEEE
6
have labeled instances for the Normal class only. The
unsupervised anomaly detectors do not involve any labeling
for the training data, where they make the implicit
assumption that the Normal instances are far more frequent
than the Abnormal ones.
In complex systems such as the UAV, the sensor faults are
categorized into three types: point, contextual, and collective
[5]. A point fault is observed as a single data instance that is
anomalous concerning the rest of the data [25]. A contextual
fault occurs when the sensor shows an invalid value concerning
the current context, such as a zero altitude value while the
UAV being airborne. A collective fault means that the sensor
shows a sequence of invalid values when put collectively
together. For example, the UAV is climbing down, but the
altimeter shows a fixed value [24].
The streamed data of the UAV are considered multivariate
temporal data that are received at a fixed rate of
time. Some explored algorithms consider the temporal
dependencies of the sequences [8]. However, the majority
of the existing algorithms do not contemplate the complex
relationships among the different UAV attributes, which
leaves a potential opportunity for new ideas.
Our contribution involves a comparative study of two
supervised approaches, which are state of the art, which use
existing deep learning tools: long short-term memory
(LSTM) and convolutional LSTM (ConvLSTM). We use
these two methods in a novel way to detect the potentially
defected sensors while analyzing the streamed data of the
UAV. The first approach involves using multiple long shortterm
memory (MLSTM) networks, where each LSTM network
is responsible for detecting anomalies in the continuous
values of one attribute. The input for MLSTM is reshaped
using a sliding window technique. The sliding window
reflects the effect of the previous values of each attribute.
Afterward, the data are separated and distributed to the multiple
LSTM networks so they can be analyzed, and then the
result of each LSTM is labeled as (Normal/Abnormal)
IEEE A&E SYSTEMS MAGAZINE
JUNE 2022
https://orcid.org/0000-0003-4549-780X
IEEE - Aerospace and Electronic Systems - June 2022
Table of Contents for the Digital Edition of IEEE - Aerospace and Electronic Systems - June 2022
Contents
IEEE - Aerospace and Electronic Systems - June 2022 - Cover1
IEEE - Aerospace and Electronic Systems - June 2022 - Cover2
IEEE - Aerospace and Electronic Systems - June 2022 - Contents
IEEE - Aerospace and Electronic Systems - June 2022 - 2
IEEE - Aerospace and Electronic Systems - June 2022 - 3
IEEE - Aerospace and Electronic Systems - June 2022 - 4
IEEE - Aerospace and Electronic Systems - June 2022 - 5
IEEE - Aerospace and Electronic Systems - June 2022 - 6
IEEE - Aerospace and Electronic Systems - June 2022 - 7
IEEE - Aerospace and Electronic Systems - June 2022 - 8
IEEE - Aerospace and Electronic Systems - June 2022 - 9
IEEE - Aerospace and Electronic Systems - June 2022 - 10
IEEE - Aerospace and Electronic Systems - June 2022 - 11
IEEE - Aerospace and Electronic Systems - June 2022 - 12
IEEE - Aerospace and Electronic Systems - June 2022 - 13
IEEE - Aerospace and Electronic Systems - June 2022 - 14
IEEE - Aerospace and Electronic Systems - June 2022 - 15
IEEE - Aerospace and Electronic Systems - June 2022 - 16
IEEE - Aerospace and Electronic Systems - June 2022 - 17
IEEE - Aerospace and Electronic Systems - June 2022 - 18
IEEE - Aerospace and Electronic Systems - June 2022 - 19
IEEE - Aerospace and Electronic Systems - June 2022 - 20
IEEE - Aerospace and Electronic Systems - June 2022 - 21
IEEE - Aerospace and Electronic Systems - June 2022 - 22
IEEE - Aerospace and Electronic Systems - June 2022 - 23
IEEE - Aerospace and Electronic Systems - June 2022 - 24
IEEE - Aerospace and Electronic Systems - June 2022 - 25
IEEE - Aerospace and Electronic Systems - June 2022 - 26
IEEE - Aerospace and Electronic Systems - June 2022 - 27
IEEE - Aerospace and Electronic Systems - June 2022 - 28
IEEE - Aerospace and Electronic Systems - June 2022 - 29
IEEE - Aerospace and Electronic Systems - June 2022 - 30
IEEE - Aerospace and Electronic Systems - June 2022 - 31
IEEE - Aerospace and Electronic Systems - June 2022 - 32
IEEE - Aerospace and Electronic Systems - June 2022 - 33
IEEE - Aerospace and Electronic Systems - June 2022 - 34
IEEE - Aerospace and Electronic Systems - June 2022 - 35
IEEE - Aerospace and Electronic Systems - June 2022 - 36
IEEE - Aerospace and Electronic Systems - June 2022 - 37
IEEE - Aerospace and Electronic Systems - June 2022 - 38
IEEE - Aerospace and Electronic Systems - June 2022 - 39
IEEE - Aerospace and Electronic Systems - June 2022 - 40
IEEE - Aerospace and Electronic Systems - June 2022 - 41
IEEE - Aerospace and Electronic Systems - June 2022 - 42
IEEE - Aerospace and Electronic Systems - June 2022 - 43
IEEE - Aerospace and Electronic Systems - June 2022 - 44
IEEE - Aerospace and Electronic Systems - June 2022 - 45
IEEE - Aerospace and Electronic Systems - June 2022 - 46
IEEE - Aerospace and Electronic Systems - June 2022 - 47
IEEE - Aerospace and Electronic Systems - June 2022 - 48
IEEE - Aerospace and Electronic Systems - June 2022 - Cover3
IEEE - Aerospace and Electronic Systems - June 2022 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2022_tutorial
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2021_tutorials
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2019partII
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2018
https://www.nxtbookmedia.com