IEEE - Aerospace and Electronic Systems - October 2022 - 34
Networks of UAVs of Low Complexity for Time-Critical Localization
Q-table, need to be delegated to the edge. In fact, given the
high-dimensional representation of the environment and the
presence of multiple UAVs with different views of it, the
edge served as a leader for fusing the received information,
storing and updating a globalQ-table. Thanks to this centralized
approach, both agents had better ambient awareness,
and they could infer a global policy according to Q-learning.
PERFORMANCEVERSUSTIME-CRITICAL
In the next, we assess the detection performance as a function
of time and number of UAVs. We omit a discussion
about the convergence to an optimal policy, which is of
secondary importance for time-critical applications as it
would require lengthy training procedures [64].
Figure 7 shows the UAV trajectories with blue and
yellow markers for two UAVs, and for the first and last
episodes. As expected, the UAV named " A, " whose position
was closer to the target, got sooner to the destination
but with a scarce map reconstruction. By contrast, the
UAV " B " was capable of reconstructing a better copy of
the map, and of finding a good trajectory after some training
episodes thanks to the aid offered by the other UAV.
In the next, we assess the learning performance in
terms of detection rate, defined as
Zk ¼
1
NMC
NXMC
m¼1
I9SNRk >h
(2)
where SNR is the vector of the SNRs experienced by the
UAVs, h is a threshold set to 15 dB to guarantee a reliable
detection rate (i.e., 80%), and k is the time accounting
for both episodes and time instants. The logical condition,
i.e., 9SNRk > h, is satisfied if at least one UAV receives
a power such that the SNR overcomes the threshold that
allows to correctly detect the target.
Figure 8 shows the percentage of times the target is
detected [e.g., Zk in (2)] through time and for different numbers
ofUAVs. As an example, for N ¼ 4, the target is considered
detected in the 60%-70% of times within the first
episode (e.g., Time ¼ 1)whereas,for N ¼ 1,such a value
is much lower. Notably, when multiple UAVs update a common
Q-table, the required time in terms of episodes is less
than the single agent case. This result confirms that the
employment of many coordinated UAVs allows to accelerate
the learning procedure, thus enabling the exploration of
large environments, which is crucial for time-critical applications.
On the other side, when the network is composed of
many UAVs, the consequent communication burden with
the edge should be accounted for.
CONCLUSIONS AND FUTURE PERSPECTIVES
It is clear that UAVs present a wide range of requirements:
they need to be autonomous, fast, multi-tasking, and
34
Figure 7.
Reference map is in subfigure (a): Red and green markers indicate
the initial positions ofUAVs and the target position, respectively.
Examples of estimated trajectories and maps for the first (b), (d)
and second agent (c), (e) and for the first (b), (c) and last (d), (e)
episodes.
intelligent. But, above all, they should preserve a low-complexity
implementation while accurately accomplishing the
mission for which they have been deployed. Consequently,
the onboard UAV-I needs to be properly designed and, when
necessary, delegated to a higher entity of the network thanks
to a communication scheme enabling such a distribution. In
this sense, even if the investigated case studies depend on the
specific setup, some general conclusions can be drawn.
FINALREMARKSONCOMMUNICATIONS
In Use Case 1, we considered both edge-based and peer-topeer
multi-hops solutions. In the edge scenario, the availability
of a global view of the environment naturally improves
the accuracy of the estimation, but the performance depends
on the latency due to access and processing delays. Indeed,
the presence ofaged measurements might lead to an old view
ofthe system state, especially in fast-changing environments.
In the case of multi-hops, the delays are dictated by the
connections created at each time instant between the nodes.
Therefore, if the network is small and can be connected with
IEEE A&E SYSTEMS MAGAZINE
OCTOBER 2022
IEEE - Aerospace and Electronic Systems - October 2022
Table of Contents for the Digital Edition of IEEE - Aerospace and Electronic Systems - October 2022
Contents
IEEE - Aerospace and Electronic Systems - October 2022 - Cover1
IEEE - Aerospace and Electronic Systems - October 2022 - Cover2
IEEE - Aerospace and Electronic Systems - October 2022 - Contents
IEEE - Aerospace and Electronic Systems - October 2022 - 2
IEEE - Aerospace and Electronic Systems - October 2022 - 3
IEEE - Aerospace and Electronic Systems - October 2022 - 4
IEEE - Aerospace and Electronic Systems - October 2022 - 5
IEEE - Aerospace and Electronic Systems - October 2022 - 6
IEEE - Aerospace and Electronic Systems - October 2022 - 7
IEEE - Aerospace and Electronic Systems - October 2022 - 8
IEEE - Aerospace and Electronic Systems - October 2022 - 9
IEEE - Aerospace and Electronic Systems - October 2022 - 10
IEEE - Aerospace and Electronic Systems - October 2022 - 11
IEEE - Aerospace and Electronic Systems - October 2022 - 12
IEEE - Aerospace and Electronic Systems - October 2022 - 13
IEEE - Aerospace and Electronic Systems - October 2022 - 14
IEEE - Aerospace and Electronic Systems - October 2022 - 15
IEEE - Aerospace and Electronic Systems - October 2022 - 16
IEEE - Aerospace and Electronic Systems - October 2022 - 17
IEEE - Aerospace and Electronic Systems - October 2022 - 18
IEEE - Aerospace and Electronic Systems - October 2022 - 19
IEEE - Aerospace and Electronic Systems - October 2022 - 20
IEEE - Aerospace and Electronic Systems - October 2022 - 21
IEEE - Aerospace and Electronic Systems - October 2022 - 22
IEEE - Aerospace and Electronic Systems - October 2022 - 23
IEEE - Aerospace and Electronic Systems - October 2022 - 24
IEEE - Aerospace and Electronic Systems - October 2022 - 25
IEEE - Aerospace and Electronic Systems - October 2022 - 26
IEEE - Aerospace and Electronic Systems - October 2022 - 27
IEEE - Aerospace and Electronic Systems - October 2022 - 28
IEEE - Aerospace and Electronic Systems - October 2022 - 29
IEEE - Aerospace and Electronic Systems - October 2022 - 30
IEEE - Aerospace and Electronic Systems - October 2022 - 31
IEEE - Aerospace and Electronic Systems - October 2022 - 32
IEEE - Aerospace and Electronic Systems - October 2022 - 33
IEEE - Aerospace and Electronic Systems - October 2022 - 34
IEEE - Aerospace and Electronic Systems - October 2022 - 35
IEEE - Aerospace and Electronic Systems - October 2022 - 36
IEEE - Aerospace and Electronic Systems - October 2022 - 37
IEEE - Aerospace and Electronic Systems - October 2022 - 38
IEEE - Aerospace and Electronic Systems - October 2022 - 39
IEEE - Aerospace and Electronic Systems - October 2022 - 40
IEEE - Aerospace and Electronic Systems - October 2022 - 41
IEEE - Aerospace and Electronic Systems - October 2022 - 42
IEEE - Aerospace and Electronic Systems - October 2022 - 43
IEEE - Aerospace and Electronic Systems - October 2022 - 44
IEEE - Aerospace and Electronic Systems - October 2022 - 45
IEEE - Aerospace and Electronic Systems - October 2022 - 46
IEEE - Aerospace and Electronic Systems - October 2022 - 47
IEEE - Aerospace and Electronic Systems - October 2022 - 48
IEEE - Aerospace and Electronic Systems - October 2022 - 49
IEEE - Aerospace and Electronic Systems - October 2022 - 50
IEEE - Aerospace and Electronic Systems - October 2022 - 51
IEEE - Aerospace and Electronic Systems - October 2022 - 52
IEEE - Aerospace and Electronic Systems - October 2022 - Cover3
IEEE - Aerospace and Electronic Systems - October 2022 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2023
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2022_tutorial
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2022
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2021_tutorials
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2021
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_february2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_january2020
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2019partII
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_july2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_june2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_april2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_may2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_march2019
https://www.nxtbook.com/nxtbooks/ieee/aerospace_december2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_august2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_october2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_september2018
https://www.nxtbook.com/nxtbooks/ieee/aerospace_november2018
https://www.nxtbookmedia.com