IEEE Consumer Electronics Magazine - January/February 2024 - 74
Special Section on Security and Privacy-Aware Emerging Computing
FIGURE 1. Real-time physical threat detection framework utilizing online learning.
domain, none of the approaches focuses on
utilizing the real-time data to keep the model upto-date.
Real-time training of threat detection
models on edge devices is cost-effective, powerefficient,
and privacy-preserving. It allows for
continuous adaptation to changing data, improving
the model's performance. Online learning
is well-suited for edge devices as it requires
minimal storage, is maintainable, and fast.3 The
proposed solution utilizes a low-power edge processor
to process visual and thermal video
frames in real time. The cloud environment label
annotates input data and updates the online feature
store to update the weights of the local
model copy (online model) in real time. The
edge model is updated by pulling weight parameters
from the online model through set triggers,
improving the physical security system's speed,
accuracy, and reliability. This approach combines
edge OD and online learning methods to
create a scalable, secure, and fast physical
threat detection model that trains and predicts
on real-time data. The features of the proposed
approach are as follows:
Proposed approach uses a lightweight version
of the OD algorithm on the edge to make
74
a real-time inference contributing to faster
inference time and offline availability of the
service.
Visual and thermal infrared (TIR) images are
used to train the model to ensure the availability
of service at different weather conditions,
and different time of the day.
Online learning is utilized to train the model
incrementally in real-time improving the performance
of the model, and purging the need
for data storage.
Creates privacy-preserved model learning
environment with no stored data.
REQUIREMENTS FOR PHYSICAL
THREAT DETECTION MODEL
Selecting the proper dataset, model, and evaluation
metrics are of key importance for any AI
system to succeed. This section elaborates on
these major components required to create the
online physical threat detection system on the
edge.
The Teledyne FLIR ADAS dataset offers labeled
thermal and visible images to train OD systems
using CNNs that recognize threats in both image
types. The dataset includes images in various
weather conditions to improve the detection
IEEE Consumer Electronics Magazine
IEEE Consumer Electronics Magazine - January/February 2024
Table of Contents for the Digital Edition of IEEE Consumer Electronics Magazine - January/February 2024
Contents
IEEE Consumer Electronics Magazine - January/February 2024 - Cover1
IEEE Consumer Electronics Magazine - January/February 2024 - Cover2
IEEE Consumer Electronics Magazine - January/February 2024 - Contents
IEEE Consumer Electronics Magazine - January/February 2024 - 2
IEEE Consumer Electronics Magazine - January/February 2024 - 3
IEEE Consumer Electronics Magazine - January/February 2024 - 4
IEEE Consumer Electronics Magazine - January/February 2024 - 5
IEEE Consumer Electronics Magazine - January/February 2024 - 6
IEEE Consumer Electronics Magazine - January/February 2024 - 7
IEEE Consumer Electronics Magazine - January/February 2024 - 8
IEEE Consumer Electronics Magazine - January/February 2024 - 9
IEEE Consumer Electronics Magazine - January/February 2024 - 10
IEEE Consumer Electronics Magazine - January/February 2024 - 11
IEEE Consumer Electronics Magazine - January/February 2024 - 12
IEEE Consumer Electronics Magazine - January/February 2024 - 13
IEEE Consumer Electronics Magazine - January/February 2024 - 14
IEEE Consumer Electronics Magazine - January/February 2024 - 15
IEEE Consumer Electronics Magazine - January/February 2024 - 16
IEEE Consumer Electronics Magazine - January/February 2024 - 17
IEEE Consumer Electronics Magazine - January/February 2024 - 18
IEEE Consumer Electronics Magazine - January/February 2024 - 19
IEEE Consumer Electronics Magazine - January/February 2024 - 20
IEEE Consumer Electronics Magazine - January/February 2024 - 21
IEEE Consumer Electronics Magazine - January/February 2024 - 22
IEEE Consumer Electronics Magazine - January/February 2024 - 23
IEEE Consumer Electronics Magazine - January/February 2024 - 24
IEEE Consumer Electronics Magazine - January/February 2024 - 25
IEEE Consumer Electronics Magazine - January/February 2024 - 26
IEEE Consumer Electronics Magazine - January/February 2024 - 27
IEEE Consumer Electronics Magazine - January/February 2024 - 28
IEEE Consumer Electronics Magazine - January/February 2024 - 29
IEEE Consumer Electronics Magazine - January/February 2024 - 30
IEEE Consumer Electronics Magazine - January/February 2024 - 31
IEEE Consumer Electronics Magazine - January/February 2024 - 32
IEEE Consumer Electronics Magazine - January/February 2024 - 33
IEEE Consumer Electronics Magazine - January/February 2024 - 34
IEEE Consumer Electronics Magazine - January/February 2024 - 35
IEEE Consumer Electronics Magazine - January/February 2024 - 36
IEEE Consumer Electronics Magazine - January/February 2024 - 37
IEEE Consumer Electronics Magazine - January/February 2024 - 38
IEEE Consumer Electronics Magazine - January/February 2024 - 39
IEEE Consumer Electronics Magazine - January/February 2024 - 40
IEEE Consumer Electronics Magazine - January/February 2024 - 41
IEEE Consumer Electronics Magazine - January/February 2024 - 42
IEEE Consumer Electronics Magazine - January/February 2024 - 43
IEEE Consumer Electronics Magazine - January/February 2024 - 44
IEEE Consumer Electronics Magazine - January/February 2024 - 45
IEEE Consumer Electronics Magazine - January/February 2024 - 46
IEEE Consumer Electronics Magazine - January/February 2024 - 47
IEEE Consumer Electronics Magazine - January/February 2024 - 48
IEEE Consumer Electronics Magazine - January/February 2024 - 49
IEEE Consumer Electronics Magazine - January/February 2024 - 50
IEEE Consumer Electronics Magazine - January/February 2024 - 51
IEEE Consumer Electronics Magazine - January/February 2024 - 52
IEEE Consumer Electronics Magazine - January/February 2024 - 53
IEEE Consumer Electronics Magazine - January/February 2024 - 54
IEEE Consumer Electronics Magazine - January/February 2024 - 55
IEEE Consumer Electronics Magazine - January/February 2024 - 56
IEEE Consumer Electronics Magazine - January/February 2024 - 57
IEEE Consumer Electronics Magazine - January/February 2024 - 58
IEEE Consumer Electronics Magazine - January/February 2024 - 59
IEEE Consumer Electronics Magazine - January/February 2024 - 60
IEEE Consumer Electronics Magazine - January/February 2024 - 61
IEEE Consumer Electronics Magazine - January/February 2024 - 62
IEEE Consumer Electronics Magazine - January/February 2024 - 63
IEEE Consumer Electronics Magazine - January/February 2024 - 64
IEEE Consumer Electronics Magazine - January/February 2024 - 65
IEEE Consumer Electronics Magazine - January/February 2024 - 66
IEEE Consumer Electronics Magazine - January/February 2024 - 67
IEEE Consumer Electronics Magazine - January/February 2024 - 68
IEEE Consumer Electronics Magazine - January/February 2024 - 69
IEEE Consumer Electronics Magazine - January/February 2024 - 70
IEEE Consumer Electronics Magazine - January/February 2024 - 71
IEEE Consumer Electronics Magazine - January/February 2024 - 72
IEEE Consumer Electronics Magazine - January/February 2024 - 73
IEEE Consumer Electronics Magazine - January/February 2024 - 74
IEEE Consumer Electronics Magazine - January/February 2024 - 75
IEEE Consumer Electronics Magazine - January/February 2024 - 76
IEEE Consumer Electronics Magazine - January/February 2024 - 77
IEEE Consumer Electronics Magazine - January/February 2024 - 78
IEEE Consumer Electronics Magazine - January/February 2024 - 79
IEEE Consumer Electronics Magazine - January/February 2024 - 80
IEEE Consumer Electronics Magazine - January/February 2024 - 81
IEEE Consumer Electronics Magazine - January/February 2024 - 82
IEEE Consumer Electronics Magazine - January/February 2024 - 83
IEEE Consumer Electronics Magazine - January/February 2024 - 84
IEEE Consumer Electronics Magazine - January/February 2024 - 85
IEEE Consumer Electronics Magazine - January/February 2024 - 86
IEEE Consumer Electronics Magazine - January/February 2024 - 87
IEEE Consumer Electronics Magazine - January/February 2024 - 88
IEEE Consumer Electronics Magazine - January/February 2024 - 89
IEEE Consumer Electronics Magazine - January/February 2024 - 90
IEEE Consumer Electronics Magazine - January/February 2024 - 91
IEEE Consumer Electronics Magazine - January/February 2024 - 92
IEEE Consumer Electronics Magazine - January/February 2024 - 93
IEEE Consumer Electronics Magazine - January/February 2024 - 94
IEEE Consumer Electronics Magazine - January/February 2024 - 95
IEEE Consumer Electronics Magazine - January/February 2024 - 96
IEEE Consumer Electronics Magazine - January/February 2024 - 97
IEEE Consumer Electronics Magazine - January/February 2024 - 98
IEEE Consumer Electronics Magazine - January/February 2024 - 99
IEEE Consumer Electronics Magazine - January/February 2024 - 100
IEEE Consumer Electronics Magazine - January/February 2024 - 101
IEEE Consumer Electronics Magazine - January/February 2024 - 102
IEEE Consumer Electronics Magazine - January/February 2024 - 103
IEEE Consumer Electronics Magazine - January/February 2024 - 104
IEEE Consumer Electronics Magazine - January/February 2024 - Cover3
IEEE Consumer Electronics Magazine - January/February 2024 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20240102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20231112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20221112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20211112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202010
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202009
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202007
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202004
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202003
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202001
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201909
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201907
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201905
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201903
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201901
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201811
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201809
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201807
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201805
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201803
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_october2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_october2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2015
https://www.nxtbookmedia.com