IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 6
Monocular Visual Autonomous Landing System for Quadcopter Drones Using Software in the Loop
KALMAN FILTER
The Kalman filter is an estimator that infers hidden states
from indirect, inaccurate, and uncertain observations. It is
possible to use the Filter to handle noisy observations
from the detection module and produce a continuous estimate
of the template position at each time step t [6].
We assume that we have a linear dynamic system for a
landing platform such as in (3), where xt is the x coordinate
of a pixel at time index t and Dt is the time between
two consecutive image frames. Similarly, in (4),
x_ t corresponds
to the x velocity component of a pixel in the image
xt ¼ xt1 þ Dt _xt1
x_ t ¼ _xt1:
(3)
(4)
The set of states X 2 R10 is given by (5), with xc;yc
as the position of the centroid of the template in the image
frame. The filter states are the same as the vector of observations
plus their first-order derivatives
X ¼½xc;yc;Ow;Oh; u; x_c; y_c; O_w; O_h; _uT:
(5)
Knowing the transition dynamics and states of the filter,
the motion model of the system is then given by (6).
The matrix A 2 R1010, shown in (7), is the state transition
matrix of the system and w is a white noise random
vector such that wNð0;QQÞ. Q 2 R1010 is defined as
the covariance matrix of the process noise [31]. For the
sake of notation, I represents the identity matrix
Xt ¼ At1Xt1 þ wt1
A ¼
I55 DtI55
055
I55
(6)
:
1010
Kt ¼ PtHT
Likewise, the measurement model of the filter is given
in (8). H ¼ I510 is defined as the observation matrix and
v is a white noise random vector such that vNð0;RRÞ.
As for Q, here R 2 R55 is the covariance matrix of the
observation noise
Yt ¼ HtXt þ vt:
(8)
With the motion and measurement models defined, it is
possible to formulate the pose estimation process of the
platform by giving the Kalman filter equations (9)-(15). In
this set of equations, P is defined as the covariance matrix
of the posterior estimate, Y is the innovation vector, K is
the Kalman gain and S is the covariance matrix ofthe innovation.
Additionally,
X^ the corrected states after a measurement update.
The first two equations (9) and (10) are used in the
prediction step, and give an estimate of the states X at
6
X^t ¼Xt þKtYt
Pt ¼ðI10x10KtHtÞPt:
(14)
(15)
The set of states produced by the Kalman filter can be
X represents the predicted states and
applied in an IBVS module to control the landing procedure
and to obtain the position of the landing platform in
the current image frame, as shown in Figure 4. These
states are computed in the 2D image frame to reduce the
computation carried out by the on-board computer of the
UAV. Furthermore, since we are not estimating the relative
pose between the vehicle and the landing platform,
we are not feeding IMU data to the tracking module; this
allows for the use of a linear Kalman filter and avoids the
calculation of Jacobians at each time-step. Pseudocode for
the vision-based detection and tracking system is given in
Algorithm 1.
IEEE A&E SYSTEMS MAGAZINE
MAY 2022
t S1
t
(13)
(7)
Pt ¼ AtPt1AT
t þQt:
(10)
When an observation is obtained by the detection
module, the correction phase (11)-(15) is computed
immediately after the prediction step. This step aims to
correct the error in the estimations using an observation of
the template in the current image frame at time t
Yt ¼ ZtHtXt
St ¼ HtPtHT
t þRt
(11)
(12)
each time step regardless of whether an observation was
obtained
Xt ¼ AtXt1
(9)
Figure 4.
Estimation of the platform position using the Kalman filter vector
of states X.
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV
Table of Contents for the Digital Edition of IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV
Contents
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - Contents
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - Cover2
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 1
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 2
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 3
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 4
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 5
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 6
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 7
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 8
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 9
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 10
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 11
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 12
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 13
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 14
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 15
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 16
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 17
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 18
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 19
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 20
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 21
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 22
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 23
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 24
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 25
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 26
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 27
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 28
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 29
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 30
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 31
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 32
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 33
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 34
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 35
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 36
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 37
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 38
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 39
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 40
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 41
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 42
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 43
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 44
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 45
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 46
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 47
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 48
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 49
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 50
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 51
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 52
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 53
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 54
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 55
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 56
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 57
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 58
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 59
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 60
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 61
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 62
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 63
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 64
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 65
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 66
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 67
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 68
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 69
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 70
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 71
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 72
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 73
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 74
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 75
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 76
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 77
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 78
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 79
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 80
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 81
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 82
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 83
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 84
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 85
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 86
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 87
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 88
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 89
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 90
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 91
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 92
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 93
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 94
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 95
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 96
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 97
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 98
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 99
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 100
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 101
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 102
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 103
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - 104
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - Cover3
IEEE - Aerospace and Electronic Systems - May 2022 - Tutorial XV - Cover4
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2022_tutorial
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2021_tutorials
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2019partII
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2018
https://www.nxtbookmedia.com