IEEE Consumer Electronics Magazine - January/February 2020 - 100

Special Section on Cognitive Science and AI for Human Cognition and Communication

Figure 4. Proposed system accuracy on different
datasets.

Figure 3. Confusion matrix on RVL-SLLL dataset for
signer independent with augmentation.

11 signers. The rest 60 samples produced by the
other 3 signers were used for test. The training
220 samples were augmented to 1,670 as in the
previous part.
The recognition accuracy was raised up
from 58.33% to 70% by data augmentation
(see Figure 4).
For the purpose of comparison, we selected
four prior works reporting methods on automatic
hand gesture recognition, which evaluated on
ArSL dataset and Purdue RVL-SLLL dataset.6-9 The
proposed system outperformed the four methods
(refer to Table 2) on the accompanied datasets.

CONCLUSION

ACKNOWLEDGMENT

An automatic hand gesture recognition was
presented in this article. The proposed system

The authors extend their appreciation to the
Researchers Supporting Project number (RSP2019/32), King Saud University, Riyadh, Saudi
Arabia for funding this work.

Table 2. Recognition accuracy (%) comparison with other works.
ArSL

RVL-SLLL

Signer
Dependent

Signer
Independent

Signer
Dependent

Signer
Independent

7

94

-

-

-

8

Method in

100

-

-

-

Method in9

99.5

-

-

-

Method in6

-

-

-

60

100

34.9

76.67

70

Method in

used linear mapping for frame selection. To overcome the lack of huge annotated dataset of hand
gestures, transfer learning had been investigated. The pre-trained C3D structure was finetuned in the proposed system for that purpose.
The proposed system achieved excellent accuracy in most of the cases and still need more
enhancement for the signer independent mode.
The performance of the proposed system has
been compared with some other state of the art
methods in the literature. As for the future work,
we will generalize the evaluation of the proposed
system on more hand gesture classes. We will
also investigate the effect of different parameters on the system performance such as the
frames' selection technique, the optimization
method, and the loss function.

& REFERENCES
1. M. S. Hossain, M. Al-Hammadi, and G. Muhammad,
"Automatic fruits classification using deep learning for
industrial applications," IEEE Trans. Ind. Inform., vol. 15,
no. 2, pp. 1027-1034, Feb. 2019.

Proposed
System

2. A. Karpathy, G. Toderici, S. Shetty, T. Leung,
R. Sukthankar, and L. Fei-Fei, "Large-scale video
classification with convolutional neural networks," in Proc.
IEEE Conf. Comput. Vision Pattern Recognit., 2014,
pp. 1725-1732.

100

IEEE Consumer Electronics Magazine



IEEE Consumer Electronics Magazine - January/February 2020

Table of Contents for the Digital Edition of IEEE Consumer Electronics Magazine - January/February 2020

Content
IEEE Consumer Electronics Magazine - January/February 2020 - Cover1
IEEE Consumer Electronics Magazine - January/February 2020 - Cover2
IEEE Consumer Electronics Magazine - January/February 2020 - Content
IEEE Consumer Electronics Magazine - January/February 2020 - 2
IEEE Consumer Electronics Magazine - January/February 2020 - 3
IEEE Consumer Electronics Magazine - January/February 2020 - 4
IEEE Consumer Electronics Magazine - January/February 2020 - 5
IEEE Consumer Electronics Magazine - January/February 2020 - 6
IEEE Consumer Electronics Magazine - January/February 2020 - 7
IEEE Consumer Electronics Magazine - January/February 2020 - 8
IEEE Consumer Electronics Magazine - January/February 2020 - 9
IEEE Consumer Electronics Magazine - January/February 2020 - 10
IEEE Consumer Electronics Magazine - January/February 2020 - 11
IEEE Consumer Electronics Magazine - January/February 2020 - 12
IEEE Consumer Electronics Magazine - January/February 2020 - 13
IEEE Consumer Electronics Magazine - January/February 2020 - 14
IEEE Consumer Electronics Magazine - January/February 2020 - 15
IEEE Consumer Electronics Magazine - January/February 2020 - 16
IEEE Consumer Electronics Magazine - January/February 2020 - 17
IEEE Consumer Electronics Magazine - January/February 2020 - 18
IEEE Consumer Electronics Magazine - January/February 2020 - 19
IEEE Consumer Electronics Magazine - January/February 2020 - 20
IEEE Consumer Electronics Magazine - January/February 2020 - 21
IEEE Consumer Electronics Magazine - January/February 2020 - 22
IEEE Consumer Electronics Magazine - January/February 2020 - 23
IEEE Consumer Electronics Magazine - January/February 2020 - 24
IEEE Consumer Electronics Magazine - January/February 2020 - 25
IEEE Consumer Electronics Magazine - January/February 2020 - 26
IEEE Consumer Electronics Magazine - January/February 2020 - 27
IEEE Consumer Electronics Magazine - January/February 2020 - 28
IEEE Consumer Electronics Magazine - January/February 2020 - 29
IEEE Consumer Electronics Magazine - January/February 2020 - 30
IEEE Consumer Electronics Magazine - January/February 2020 - 31
IEEE Consumer Electronics Magazine - January/February 2020 - 32
IEEE Consumer Electronics Magazine - January/February 2020 - 33
IEEE Consumer Electronics Magazine - January/February 2020 - 34
IEEE Consumer Electronics Magazine - January/February 2020 - 35
IEEE Consumer Electronics Magazine - January/February 2020 - 36
IEEE Consumer Electronics Magazine - January/February 2020 - 37
IEEE Consumer Electronics Magazine - January/February 2020 - 38
IEEE Consumer Electronics Magazine - January/February 2020 - 39
IEEE Consumer Electronics Magazine - January/February 2020 - 40
IEEE Consumer Electronics Magazine - January/February 2020 - 41
IEEE Consumer Electronics Magazine - January/February 2020 - 42
IEEE Consumer Electronics Magazine - January/February 2020 - 43
IEEE Consumer Electronics Magazine - January/February 2020 - 44
IEEE Consumer Electronics Magazine - January/February 2020 - 45
IEEE Consumer Electronics Magazine - January/February 2020 - 46
IEEE Consumer Electronics Magazine - January/February 2020 - 47
IEEE Consumer Electronics Magazine - January/February 2020 - 48
IEEE Consumer Electronics Magazine - January/February 2020 - 49
IEEE Consumer Electronics Magazine - January/February 2020 - 50
IEEE Consumer Electronics Magazine - January/February 2020 - 51
IEEE Consumer Electronics Magazine - January/February 2020 - 52
IEEE Consumer Electronics Magazine - January/February 2020 - 53
IEEE Consumer Electronics Magazine - January/February 2020 - 54
IEEE Consumer Electronics Magazine - January/February 2020 - 55
IEEE Consumer Electronics Magazine - January/February 2020 - 56
IEEE Consumer Electronics Magazine - January/February 2020 - 57
IEEE Consumer Electronics Magazine - January/February 2020 - 58
IEEE Consumer Electronics Magazine - January/February 2020 - 59
IEEE Consumer Electronics Magazine - January/February 2020 - 60
IEEE Consumer Electronics Magazine - January/February 2020 - 61
IEEE Consumer Electronics Magazine - January/February 2020 - 62
IEEE Consumer Electronics Magazine - January/February 2020 - 63
IEEE Consumer Electronics Magazine - January/February 2020 - 64
IEEE Consumer Electronics Magazine - January/February 2020 - 65
IEEE Consumer Electronics Magazine - January/February 2020 - 66
IEEE Consumer Electronics Magazine - January/February 2020 - 67
IEEE Consumer Electronics Magazine - January/February 2020 - 68
IEEE Consumer Electronics Magazine - January/February 2020 - 69
IEEE Consumer Electronics Magazine - January/February 2020 - 70
IEEE Consumer Electronics Magazine - January/February 2020 - 71
IEEE Consumer Electronics Magazine - January/February 2020 - 72
IEEE Consumer Electronics Magazine - January/February 2020 - 73
IEEE Consumer Electronics Magazine - January/February 2020 - 74
IEEE Consumer Electronics Magazine - January/February 2020 - 75
IEEE Consumer Electronics Magazine - January/February 2020 - 76
IEEE Consumer Electronics Magazine - January/February 2020 - 77
IEEE Consumer Electronics Magazine - January/February 2020 - 78
IEEE Consumer Electronics Magazine - January/February 2020 - 79
IEEE Consumer Electronics Magazine - January/February 2020 - 80
IEEE Consumer Electronics Magazine - January/February 2020 - 81
IEEE Consumer Electronics Magazine - January/February 2020 - 82
IEEE Consumer Electronics Magazine - January/February 2020 - 83
IEEE Consumer Electronics Magazine - January/February 2020 - 84
IEEE Consumer Electronics Magazine - January/February 2020 - 85
IEEE Consumer Electronics Magazine - January/February 2020 - 86
IEEE Consumer Electronics Magazine - January/February 2020 - 87
IEEE Consumer Electronics Magazine - January/February 2020 - 88
IEEE Consumer Electronics Magazine - January/February 2020 - 89
IEEE Consumer Electronics Magazine - January/February 2020 - 90
IEEE Consumer Electronics Magazine - January/February 2020 - 91
IEEE Consumer Electronics Magazine - January/February 2020 - 92
IEEE Consumer Electronics Magazine - January/February 2020 - 93
IEEE Consumer Electronics Magazine - January/February 2020 - 94
IEEE Consumer Electronics Magazine - January/February 2020 - 95
IEEE Consumer Electronics Magazine - January/February 2020 - 96
IEEE Consumer Electronics Magazine - January/February 2020 - 97
IEEE Consumer Electronics Magazine - January/February 2020 - 98
IEEE Consumer Electronics Magazine - January/February 2020 - 99
IEEE Consumer Electronics Magazine - January/February 2020 - 100
IEEE Consumer Electronics Magazine - January/February 2020 - 101
IEEE Consumer Electronics Magazine - January/February 2020 - 102
IEEE Consumer Electronics Magazine - January/February 2020 - 103
IEEE Consumer Electronics Magazine - January/February 2020 - 104
IEEE Consumer Electronics Magazine - January/February 2020 - 105
IEEE Consumer Electronics Magazine - January/February 2020 - 106
IEEE Consumer Electronics Magazine - January/February 2020 - 107
IEEE Consumer Electronics Magazine - January/February 2020 - 108
IEEE Consumer Electronics Magazine - January/February 2020 - Cover3
IEEE Consumer Electronics Magazine - January/February 2020 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20240102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20231112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20221112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20211112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202010
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202009
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202007
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202004
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202003
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202001
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201909
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201907
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201905
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201903
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201901
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201811
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201809
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201807
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201805
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201803
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_october2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_october2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2015
https://www.nxtbookmedia.com