IEEE Solid-States Circuits Magazine - Summer 2019 - 51
readout challenges (e.g., to manage
possible interference between readout columns), making the readoutcircuit area significant and, again,
scaling with array size. On the other
hand, one-T, one-resistor (R) structures are typically denser than SRAM
but now limited by MOSFET scaling.
Further, the asymmetry in device
characteristics between the T and
R (memory device) often imposes
additional area overheads to resolve
(e.g., the use of two complementary
bit cells).
An additional motivation for emerging resistive memory technologies is
nonvolatility, which has the potential to lower power, especially in
duty-cycled scenarios. This holds significant promise but will need to be
evaluated in application use cases.
Additionally, nonvolatility often limits the number of write cycles, posing
challenges for hardware-virtualization approaches.
Algorithmic Codesign
Machine-learning inference has emerged
as one of the biggest drivers for IMC,
both because the computations have
driven platforms to their energy
and throughput limits and because
the computations are dominated by
MVM, which limits the gains possible
from digital accelerators. Interestingly, machine-learning inference
presents distinct opportunities for
Backward
Prediction y
gi
L = y - y(x, θ, G)2
90
80
Loss Function L
Model
Parameters
θ (x, G, L)
70
60
50
40
30
L = y - y(x, θ)2
20
Prediction
y (x, θ(L), Zi )
"
Noisy
Forward
"
Testing
100
"
Noisy
Forward
This has the drawback of incurring
instance-by-instance training costs,
and recent IMC demonstrations have
explored incorporating the associated
hardware support to minimize such
costs [19]. In hardware-generalized
training, a statistical model of the distribution of variation-affected hardware is used in the training process
to learn parameters one time [20].
This avoids the need for instanceby-instance training. For the example
shown in Figure 13 of MRAM-based
IMC implementing a neural network
for vision classification (CIFAR-10), we
see that this can overcome significant
variation in the hardware (accuracy is
maintained at several multiples of the
actual MRAM-conductance variation).
Such algorithmic approaches show
considerable promise, presenting a
rich area for research. Specifically, a
critical challenge that will need to be
addressed is that operation relying
on algorithmic codesign will inherently disrupt hierarchical abstraction
based on the functional specification employed in architectural design
today. Thus, new, possibly statistical
approaches to composable architectural design and application mapping
will likely be required.
MRAM-Based BNN Simulation
(Applied to CIFAR-10)
Accuracy
G
addressing the SNR tradeoff in IMC
through algorithmic approaches.
Machine-learning inference involves
specifying a parametric model of
how data statistically relate to inferences (decisions) of interest and then
training the model parameters using
available data that are representative
of the statistics. In this way, statistical parameter optimization for a
given model affords flexibility in the
choice of actual model, which can
be selected for computational efficiency. For example, this aspect has
been exploited toward aggressive
quantization [2], which has already
been shown to yield benefits for IMC.
But it can also be exploited to overcome computational noise arising
from analog circuit nonidealities limiting IMC.
Because the nonidealities can be
statistical (e.g., variations) or deterministic (e.g., nonlinearity), a distinction
can be made between hardware-specific training of model parameters
and hardware-generalized training of
model parameters. In hardware-specific training, the specific variationaffected instance of hardware is used
in the training process to tune parameters to the specific hardware [7], [19].
"
Training
Instead of accessing raw bits row by row, IMC
accesses a computation result over many/all bits,
thereby amortizing the accessing costs.
10
1
2
3
4
5
6
7
8
9
Normalized MRAM Cell Standard Deviation
10
FIGURE 13: An illustration of an algorithm approach to overcome analog nonidealities [20]. BNN: binarized-neural-network.
IEEE SOLID-STATE CIRCUITS MAGAZINE
SU M M E R 2 0 19
51
IEEE Solid-States Circuits Magazine - Summer 2019
Table of Contents for the Digital Edition of IEEE Solid-States Circuits Magazine - Summer 2019
Contents
IEEE Solid-States Circuits Magazine - Summer 2019 - Cover1
IEEE Solid-States Circuits Magazine - Summer 2019 - Cover2
IEEE Solid-States Circuits Magazine - Summer 2019 - Contents
IEEE Solid-States Circuits Magazine - Summer 2019 - 2
IEEE Solid-States Circuits Magazine - Summer 2019 - 3
IEEE Solid-States Circuits Magazine - Summer 2019 - 4
IEEE Solid-States Circuits Magazine - Summer 2019 - 5
IEEE Solid-States Circuits Magazine - Summer 2019 - 6
IEEE Solid-States Circuits Magazine - Summer 2019 - 7
IEEE Solid-States Circuits Magazine - Summer 2019 - 8
IEEE Solid-States Circuits Magazine - Summer 2019 - 9
IEEE Solid-States Circuits Magazine - Summer 2019 - 10
IEEE Solid-States Circuits Magazine - Summer 2019 - 11
IEEE Solid-States Circuits Magazine - Summer 2019 - 12
IEEE Solid-States Circuits Magazine - Summer 2019 - 13
IEEE Solid-States Circuits Magazine - Summer 2019 - 14
IEEE Solid-States Circuits Magazine - Summer 2019 - 15
IEEE Solid-States Circuits Magazine - Summer 2019 - 16
IEEE Solid-States Circuits Magazine - Summer 2019 - 17
IEEE Solid-States Circuits Magazine - Summer 2019 - 18
IEEE Solid-States Circuits Magazine - Summer 2019 - 19
IEEE Solid-States Circuits Magazine - Summer 2019 - 20
IEEE Solid-States Circuits Magazine - Summer 2019 - 21
IEEE Solid-States Circuits Magazine - Summer 2019 - 22
IEEE Solid-States Circuits Magazine - Summer 2019 - 23
IEEE Solid-States Circuits Magazine - Summer 2019 - 24
IEEE Solid-States Circuits Magazine - Summer 2019 - 25
IEEE Solid-States Circuits Magazine - Summer 2019 - 26
IEEE Solid-States Circuits Magazine - Summer 2019 - 27
IEEE Solid-States Circuits Magazine - Summer 2019 - 28
IEEE Solid-States Circuits Magazine - Summer 2019 - 29
IEEE Solid-States Circuits Magazine - Summer 2019 - 30
IEEE Solid-States Circuits Magazine - Summer 2019 - 31
IEEE Solid-States Circuits Magazine - Summer 2019 - 32
IEEE Solid-States Circuits Magazine - Summer 2019 - 33
IEEE Solid-States Circuits Magazine - Summer 2019 - 34
IEEE Solid-States Circuits Magazine - Summer 2019 - 35
IEEE Solid-States Circuits Magazine - Summer 2019 - 36
IEEE Solid-States Circuits Magazine - Summer 2019 - 37
IEEE Solid-States Circuits Magazine - Summer 2019 - 38
IEEE Solid-States Circuits Magazine - Summer 2019 - 39
IEEE Solid-States Circuits Magazine - Summer 2019 - 40
IEEE Solid-States Circuits Magazine - Summer 2019 - 41
IEEE Solid-States Circuits Magazine - Summer 2019 - 42
IEEE Solid-States Circuits Magazine - Summer 2019 - 43
IEEE Solid-States Circuits Magazine - Summer 2019 - 44
IEEE Solid-States Circuits Magazine - Summer 2019 - 45
IEEE Solid-States Circuits Magazine - Summer 2019 - 46
IEEE Solid-States Circuits Magazine - Summer 2019 - 47
IEEE Solid-States Circuits Magazine - Summer 2019 - 48
IEEE Solid-States Circuits Magazine - Summer 2019 - 49
IEEE Solid-States Circuits Magazine - Summer 2019 - 50
IEEE Solid-States Circuits Magazine - Summer 2019 - 51
IEEE Solid-States Circuits Magazine - Summer 2019 - 52
IEEE Solid-States Circuits Magazine - Summer 2019 - 53
IEEE Solid-States Circuits Magazine - Summer 2019 - 54
IEEE Solid-States Circuits Magazine - Summer 2019 - 55
IEEE Solid-States Circuits Magazine - Summer 2019 - 56
IEEE Solid-States Circuits Magazine - Summer 2019 - 57
IEEE Solid-States Circuits Magazine - Summer 2019 - 58
IEEE Solid-States Circuits Magazine - Summer 2019 - 59
IEEE Solid-States Circuits Magazine - Summer 2019 - 60
IEEE Solid-States Circuits Magazine - Summer 2019 - 61
IEEE Solid-States Circuits Magazine - Summer 2019 - 62
IEEE Solid-States Circuits Magazine - Summer 2019 - 63
IEEE Solid-States Circuits Magazine - Summer 2019 - 64
IEEE Solid-States Circuits Magazine - Summer 2019 - 65
IEEE Solid-States Circuits Magazine - Summer 2019 - 66
IEEE Solid-States Circuits Magazine - Summer 2019 - 67
IEEE Solid-States Circuits Magazine - Summer 2019 - 68
IEEE Solid-States Circuits Magazine - Summer 2019 - 69
IEEE Solid-States Circuits Magazine - Summer 2019 - 70
IEEE Solid-States Circuits Magazine - Summer 2019 - 71
IEEE Solid-States Circuits Magazine - Summer 2019 - 72
IEEE Solid-States Circuits Magazine - Summer 2019 - 73
IEEE Solid-States Circuits Magazine - Summer 2019 - 74
IEEE Solid-States Circuits Magazine - Summer 2019 - 75
IEEE Solid-States Circuits Magazine - Summer 2019 - 76
IEEE Solid-States Circuits Magazine - Summer 2019 - 77
IEEE Solid-States Circuits Magazine - Summer 2019 - 78
IEEE Solid-States Circuits Magazine - Summer 2019 - 79
IEEE Solid-States Circuits Magazine - Summer 2019 - 80
IEEE Solid-States Circuits Magazine - Summer 2019 - 81
IEEE Solid-States Circuits Magazine - Summer 2019 - 82
IEEE Solid-States Circuits Magazine - Summer 2019 - 83
IEEE Solid-States Circuits Magazine - Summer 2019 - 84
IEEE Solid-States Circuits Magazine - Summer 2019 - 85
IEEE Solid-States Circuits Magazine - Summer 2019 - 86
IEEE Solid-States Circuits Magazine - Summer 2019 - 87
IEEE Solid-States Circuits Magazine - Summer 2019 - 88
IEEE Solid-States Circuits Magazine - Summer 2019 - 89
IEEE Solid-States Circuits Magazine - Summer 2019 - 90
IEEE Solid-States Circuits Magazine - Summer 2019 - 91
IEEE Solid-States Circuits Magazine - Summer 2019 - 92
IEEE Solid-States Circuits Magazine - Summer 2019 - 93
IEEE Solid-States Circuits Magazine - Summer 2019 - 94
IEEE Solid-States Circuits Magazine - Summer 2019 - 95
IEEE Solid-States Circuits Magazine - Summer 2019 - 96
IEEE Solid-States Circuits Magazine - Summer 2019 - 97
IEEE Solid-States Circuits Magazine - Summer 2019 - 98
IEEE Solid-States Circuits Magazine - Summer 2019 - 99
IEEE Solid-States Circuits Magazine - Summer 2019 - 100
IEEE Solid-States Circuits Magazine - Summer 2019 - 101
IEEE Solid-States Circuits Magazine - Summer 2019 - 102
IEEE Solid-States Circuits Magazine - Summer 2019 - 103
IEEE Solid-States Circuits Magazine - Summer 2019 - 104
IEEE Solid-States Circuits Magazine - Summer 2019 - 105
IEEE Solid-States Circuits Magazine - Summer 2019 - 106
IEEE Solid-States Circuits Magazine - Summer 2019 - 107
IEEE Solid-States Circuits Magazine - Summer 2019 - 108
IEEE Solid-States Circuits Magazine - Summer 2019 - 109
IEEE Solid-States Circuits Magazine - Summer 2019 - 110
IEEE Solid-States Circuits Magazine - Summer 2019 - 111
IEEE Solid-States Circuits Magazine - Summer 2019 - 112
IEEE Solid-States Circuits Magazine - Summer 2019 - Cover3
IEEE Solid-States Circuits Magazine - Summer 2019 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2019
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2019
https://www.nxtbook.com/nxtbooks/ieee/mssc_2019summer
https://www.nxtbook.com/nxtbooks/ieee/mssc_2019winter
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018fall
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018summer
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018spring
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018winter
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2014
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2014
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2014
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2014
https://www.nxtbookmedia.com