IEEE Circuits and Systems Magazine - Q1 2021 - 32

functions, such as the sigmoid or the Rectified Linear
Unit (ReLU) in (42), are applied to obtain the values of the
feature maps. The pooling layer maps the features into a
lower resolution space, for example, with the function
in (43). Fully connected neural networks compute over
reduced spaces, applying weights to the inputs of artificial neurons that " fire " based on nonlinear functions.
The large amount of computation and the high memory
requirements are challenges faced in the development of
efficient CNNs, especially in devices with autonomy and
resource constraints. It will be shown how RNS, LNS, associated with fixed-point and FP representations, and SC
can be used to face these challenges.

conv " / w i y i + b

(41)

i

act " h t = tanh y ; h s =

1 ; h = max ^0, y h
RLU
1 + e -y

pool " p max = max ( y); p L2 =

/ y 2i

(42)
(43)

Although several proposals have been made to apply RNS to compute a CNN, only a few can be fully computed in the RNS domain [121]-[123]. These complete
solutions mitigate the overhead imposed by the nonlinear functions of the activation and pooling layers
by carefully selecting the RNS moduli sets. In [121], the

Microwave Resonator
Addresses and Couples
Qubits on Processor

Quantum Chip

Transmon Qubit:
Behaves Like an
Artificial Atom

Niobium Capacitor

100 µm
Josephson Junction:
Super Conducting
Inductor, Kept at
0.015 Kelvin

Figure 23. The transmon qubit and the quantum chip [169]: a type of superconducting charge qubit; the superconductors are
capacitatively shunted in order to decrease the sensitivity to charge noise.

32

IEEE CIRCUITS AND SYSTEMS MAGAZINE

FIRST QUARTER 2021



IEEE Circuits and Systems Magazine - Q1 2021

Table of Contents for the Digital Edition of IEEE Circuits and Systems Magazine - Q1 2021

Contents
IEEE Circuits and Systems Magazine - Q1 2021 - Cover1
IEEE Circuits and Systems Magazine - Q1 2021 - Cover2
IEEE Circuits and Systems Magazine - Q1 2021 - Contents
IEEE Circuits and Systems Magazine - Q1 2021 - 2
IEEE Circuits and Systems Magazine - Q1 2021 - 3
IEEE Circuits and Systems Magazine - Q1 2021 - 4
IEEE Circuits and Systems Magazine - Q1 2021 - 5
IEEE Circuits and Systems Magazine - Q1 2021 - 6
IEEE Circuits and Systems Magazine - Q1 2021 - 7
IEEE Circuits and Systems Magazine - Q1 2021 - 8
IEEE Circuits and Systems Magazine - Q1 2021 - 9
IEEE Circuits and Systems Magazine - Q1 2021 - 10
IEEE Circuits and Systems Magazine - Q1 2021 - 11
IEEE Circuits and Systems Magazine - Q1 2021 - 12
IEEE Circuits and Systems Magazine - Q1 2021 - 13
IEEE Circuits and Systems Magazine - Q1 2021 - 14
IEEE Circuits and Systems Magazine - Q1 2021 - 15
IEEE Circuits and Systems Magazine - Q1 2021 - 16
IEEE Circuits and Systems Magazine - Q1 2021 - 17
IEEE Circuits and Systems Magazine - Q1 2021 - 18
IEEE Circuits and Systems Magazine - Q1 2021 - 19
IEEE Circuits and Systems Magazine - Q1 2021 - 20
IEEE Circuits and Systems Magazine - Q1 2021 - 21
IEEE Circuits and Systems Magazine - Q1 2021 - 22
IEEE Circuits and Systems Magazine - Q1 2021 - 23
IEEE Circuits and Systems Magazine - Q1 2021 - 24
IEEE Circuits and Systems Magazine - Q1 2021 - 25
IEEE Circuits and Systems Magazine - Q1 2021 - 26
IEEE Circuits and Systems Magazine - Q1 2021 - 27
IEEE Circuits and Systems Magazine - Q1 2021 - 28
IEEE Circuits and Systems Magazine - Q1 2021 - 29
IEEE Circuits and Systems Magazine - Q1 2021 - 30
IEEE Circuits and Systems Magazine - Q1 2021 - 31
IEEE Circuits and Systems Magazine - Q1 2021 - 32
IEEE Circuits and Systems Magazine - Q1 2021 - 33
IEEE Circuits and Systems Magazine - Q1 2021 - 34
IEEE Circuits and Systems Magazine - Q1 2021 - 35
IEEE Circuits and Systems Magazine - Q1 2021 - 36
IEEE Circuits and Systems Magazine - Q1 2021 - 37
IEEE Circuits and Systems Magazine - Q1 2021 - 38
IEEE Circuits and Systems Magazine - Q1 2021 - 39
IEEE Circuits and Systems Magazine - Q1 2021 - 40
IEEE Circuits and Systems Magazine - Q1 2021 - 41
IEEE Circuits and Systems Magazine - Q1 2021 - 42
IEEE Circuits and Systems Magazine - Q1 2021 - 43
IEEE Circuits and Systems Magazine - Q1 2021 - 44
IEEE Circuits and Systems Magazine - Q1 2021 - 45
IEEE Circuits and Systems Magazine - Q1 2021 - 46
IEEE Circuits and Systems Magazine - Q1 2021 - 47
IEEE Circuits and Systems Magazine - Q1 2021 - 48
IEEE Circuits and Systems Magazine - Q1 2021 - 49
IEEE Circuits and Systems Magazine - Q1 2021 - 50
IEEE Circuits and Systems Magazine - Q1 2021 - 51
IEEE Circuits and Systems Magazine - Q1 2021 - 52
IEEE Circuits and Systems Magazine - Q1 2021 - 53
IEEE Circuits and Systems Magazine - Q1 2021 - 54
IEEE Circuits and Systems Magazine - Q1 2021 - 55
IEEE Circuits and Systems Magazine - Q1 2021 - 56
IEEE Circuits and Systems Magazine - Q1 2021 - 57
IEEE Circuits and Systems Magazine - Q1 2021 - 58
IEEE Circuits and Systems Magazine - Q1 2021 - 59
IEEE Circuits and Systems Magazine - Q1 2021 - 60
IEEE Circuits and Systems Magazine - Q1 2021 - 61
IEEE Circuits and Systems Magazine - Q1 2021 - 62
IEEE Circuits and Systems Magazine - Q1 2021 - 63
IEEE Circuits and Systems Magazine - Q1 2021 - 64
IEEE Circuits and Systems Magazine - Q1 2021 - 65
IEEE Circuits and Systems Magazine - Q1 2021 - 66
IEEE Circuits and Systems Magazine - Q1 2021 - 67
IEEE Circuits and Systems Magazine - Q1 2021 - 68
IEEE Circuits and Systems Magazine - Q1 2021 - 69
IEEE Circuits and Systems Magazine - Q1 2021 - 70
IEEE Circuits and Systems Magazine - Q1 2021 - 71
IEEE Circuits and Systems Magazine - Q1 2021 - 72
IEEE Circuits and Systems Magazine - Q1 2021 - 73
IEEE Circuits and Systems Magazine - Q1 2021 - 74
IEEE Circuits and Systems Magazine - Q1 2021 - 75
IEEE Circuits and Systems Magazine - Q1 2021 - 76
IEEE Circuits and Systems Magazine - Q1 2021 - 77
IEEE Circuits and Systems Magazine - Q1 2021 - 78
IEEE Circuits and Systems Magazine - Q1 2021 - 79
IEEE Circuits and Systems Magazine - Q1 2021 - 80
IEEE Circuits and Systems Magazine - Q1 2021 - 81
IEEE Circuits and Systems Magazine - Q1 2021 - 82
IEEE Circuits and Systems Magazine - Q1 2021 - 83
IEEE Circuits and Systems Magazine - Q1 2021 - 84
IEEE Circuits and Systems Magazine - Q1 2021 - 85
IEEE Circuits and Systems Magazine - Q1 2021 - 86
IEEE Circuits and Systems Magazine - Q1 2021 - 87
IEEE Circuits and Systems Magazine - Q1 2021 - 88
IEEE Circuits and Systems Magazine - Q1 2021 - Cover3
IEEE Circuits and Systems Magazine - Q1 2021 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2023Q3
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2023Q2
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2023Q1
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2022Q4
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2022Q3
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2022Q2
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2022Q1
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2021Q4
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2021q3
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2021q2
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2021q1
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2020q4
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2020q3
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2020q2
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2020q1
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2019q4
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2019q3
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2019q2
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2019q1
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2018q4
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2018q3
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2018q2
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2018q1
https://www.nxtbookmedia.com