IEEE Solid-State Circuits Magazine - Fall 2017 - 55

Embedded Deep Neural
Network Processing

BACKGROUND-FOOTAGE FIRM, INC.

Algorithmic and processor techniques
bring deep learning to IoT and edge devices

Marian Verhelst and Bert Moons

D

eep learning has
recently become
im-mensely popular for image recognition, as well as
for other recognition and pattern matching tasks in, e.g., speech processing,
natural language processing, and so
forth. The online evaluation of deep
neural networks, however, comes with
significant computational complexity, making it, until recently, feasible
only on power-hungry server platforms in the cloud. In recent years,
we see an emerging trend toward embedded processing of deep learning
Digital Object Identifier 10.1109/MSSC.2017.2745818
Date of publication: 16 November 2017

1943-0582/17©2017IEEE

networks in edge devices: mobiles,
wearables, and Internet of Things
(IoT) nodes. This would enable us
to analyze data locally in real time,
which is not only favorable in terms
of latency but also mitigates privacy
issues. Yet evaluating the powerful
but large deep neural networks with
power budgets in the milliwatt or even
microwatt range requires a significant improvement in processing energy efficiency.
To enable such efficient evaluation of deep neural networks, optimizations at both the algorithmic and
hardware level are required. This
article surveys such tightly interwoven hardware-software processing techniques for energy efficiency

and shows how implementationdriven a lgor ithm ic innov ations,
together with customized yet flexible processing architectures, can
be t r ue g a m e c h a n g e r s . To h e lp
readers fully understand the implementation challenges as well as
opportunities for deep neural network algorithms, we start by briefly
summarizing the basic concept of
deep neural networks.

The Birth of Deep Learning
Deep learning [1] can be traced back
to neural networks, which have been
around for many decades and were
already gaining popularity in the
early 1960s. A neural network is a
brain-inspired computing system,

IEEE SOLID-STATE CIRCUITS MAGAZINE

FA L L 2 0 17

55



Table of Contents for the Digital Edition of IEEE Solid-State Circuits Magazine - Fall 2017

IEEE Solid-State Circuits Magazine - Fall 2017 - Cover1
IEEE Solid-State Circuits Magazine - Fall 2017 - Cover2
IEEE Solid-State Circuits Magazine - Fall 2017 - 1
IEEE Solid-State Circuits Magazine - Fall 2017 - 2
IEEE Solid-State Circuits Magazine - Fall 2017 - 3
IEEE Solid-State Circuits Magazine - Fall 2017 - 4
IEEE Solid-State Circuits Magazine - Fall 2017 - 5
IEEE Solid-State Circuits Magazine - Fall 2017 - 6
IEEE Solid-State Circuits Magazine - Fall 2017 - 7
IEEE Solid-State Circuits Magazine - Fall 2017 - 8
IEEE Solid-State Circuits Magazine - Fall 2017 - 9
IEEE Solid-State Circuits Magazine - Fall 2017 - 10
IEEE Solid-State Circuits Magazine - Fall 2017 - 11
IEEE Solid-State Circuits Magazine - Fall 2017 - 12
IEEE Solid-State Circuits Magazine - Fall 2017 - 13
IEEE Solid-State Circuits Magazine - Fall 2017 - 14
IEEE Solid-State Circuits Magazine - Fall 2017 - 15
IEEE Solid-State Circuits Magazine - Fall 2017 - 16
IEEE Solid-State Circuits Magazine - Fall 2017 - 17
IEEE Solid-State Circuits Magazine - Fall 2017 - 18
IEEE Solid-State Circuits Magazine - Fall 2017 - 19
IEEE Solid-State Circuits Magazine - Fall 2017 - 20
IEEE Solid-State Circuits Magazine - Fall 2017 - 21
IEEE Solid-State Circuits Magazine - Fall 2017 - 22
IEEE Solid-State Circuits Magazine - Fall 2017 - 23
IEEE Solid-State Circuits Magazine - Fall 2017 - 24
IEEE Solid-State Circuits Magazine - Fall 2017 - 25
IEEE Solid-State Circuits Magazine - Fall 2017 - 26
IEEE Solid-State Circuits Magazine - Fall 2017 - 27
IEEE Solid-State Circuits Magazine - Fall 2017 - 28
IEEE Solid-State Circuits Magazine - Fall 2017 - 29
IEEE Solid-State Circuits Magazine - Fall 2017 - 30
IEEE Solid-State Circuits Magazine - Fall 2017 - 31
IEEE Solid-State Circuits Magazine - Fall 2017 - 32
IEEE Solid-State Circuits Magazine - Fall 2017 - 33
IEEE Solid-State Circuits Magazine - Fall 2017 - 34
IEEE Solid-State Circuits Magazine - Fall 2017 - 35
IEEE Solid-State Circuits Magazine - Fall 2017 - 36
IEEE Solid-State Circuits Magazine - Fall 2017 - 37
IEEE Solid-State Circuits Magazine - Fall 2017 - 38
IEEE Solid-State Circuits Magazine - Fall 2017 - 39
IEEE Solid-State Circuits Magazine - Fall 2017 - 40
IEEE Solid-State Circuits Magazine - Fall 2017 - 41
IEEE Solid-State Circuits Magazine - Fall 2017 - 42
IEEE Solid-State Circuits Magazine - Fall 2017 - 43
IEEE Solid-State Circuits Magazine - Fall 2017 - 44
IEEE Solid-State Circuits Magazine - Fall 2017 - 45
IEEE Solid-State Circuits Magazine - Fall 2017 - 46
IEEE Solid-State Circuits Magazine - Fall 2017 - 47
IEEE Solid-State Circuits Magazine - Fall 2017 - 48
IEEE Solid-State Circuits Magazine - Fall 2017 - 49
IEEE Solid-State Circuits Magazine - Fall 2017 - 50
IEEE Solid-State Circuits Magazine - Fall 2017 - 51
IEEE Solid-State Circuits Magazine - Fall 2017 - 52
IEEE Solid-State Circuits Magazine - Fall 2017 - 53
IEEE Solid-State Circuits Magazine - Fall 2017 - 54
IEEE Solid-State Circuits Magazine - Fall 2017 - 55
IEEE Solid-State Circuits Magazine - Fall 2017 - 56
IEEE Solid-State Circuits Magazine - Fall 2017 - 57
IEEE Solid-State Circuits Magazine - Fall 2017 - 58
IEEE Solid-State Circuits Magazine - Fall 2017 - 59
IEEE Solid-State Circuits Magazine - Fall 2017 - 60
IEEE Solid-State Circuits Magazine - Fall 2017 - 61
IEEE Solid-State Circuits Magazine - Fall 2017 - 62
IEEE Solid-State Circuits Magazine - Fall 2017 - 63
IEEE Solid-State Circuits Magazine - Fall 2017 - 64
IEEE Solid-State Circuits Magazine - Fall 2017 - 65
IEEE Solid-State Circuits Magazine - Fall 2017 - 66
IEEE Solid-State Circuits Magazine - Fall 2017 - 67
IEEE Solid-State Circuits Magazine - Fall 2017 - 68
IEEE Solid-State Circuits Magazine - Fall 2017 - 69
IEEE Solid-State Circuits Magazine - Fall 2017 - 70
IEEE Solid-State Circuits Magazine - Fall 2017 - 71
IEEE Solid-State Circuits Magazine - Fall 2017 - 72
IEEE Solid-State Circuits Magazine - Fall 2017 - 73
IEEE Solid-State Circuits Magazine - Fall 2017 - 74
IEEE Solid-State Circuits Magazine - Fall 2017 - 75
IEEE Solid-State Circuits Magazine - Fall 2017 - 76
IEEE Solid-State Circuits Magazine - Fall 2017 - 77
IEEE Solid-State Circuits Magazine - Fall 2017 - 78
IEEE Solid-State Circuits Magazine - Fall 2017 - 79
IEEE Solid-State Circuits Magazine - Fall 2017 - 80
IEEE Solid-State Circuits Magazine - Fall 2017 - 81
IEEE Solid-State Circuits Magazine - Fall 2017 - 82
IEEE Solid-State Circuits Magazine - Fall 2017 - 83
IEEE Solid-State Circuits Magazine - Fall 2017 - 84
IEEE Solid-State Circuits Magazine - Fall 2017 - 85
IEEE Solid-State Circuits Magazine - Fall 2017 - 86
IEEE Solid-State Circuits Magazine - Fall 2017 - 87
IEEE Solid-State Circuits Magazine - Fall 2017 - 88
IEEE Solid-State Circuits Magazine - Fall 2017 - 89
IEEE Solid-State Circuits Magazine - Fall 2017 - 90
IEEE Solid-State Circuits Magazine - Fall 2017 - 91
IEEE Solid-State Circuits Magazine - Fall 2017 - 92
IEEE Solid-State Circuits Magazine - Fall 2017 - 93
IEEE Solid-State Circuits Magazine - Fall 2017 - 94
IEEE Solid-State Circuits Magazine - Fall 2017 - 95
IEEE Solid-State Circuits Magazine - Fall 2017 - 96
IEEE Solid-State Circuits Magazine - Fall 2017 - 97
IEEE Solid-State Circuits Magazine - Fall 2017 - 98
IEEE Solid-State Circuits Magazine - Fall 2017 - 99
IEEE Solid-State Circuits Magazine - Fall 2017 - 100
IEEE Solid-State Circuits Magazine - Fall 2017 - 101
IEEE Solid-State Circuits Magazine - Fall 2017 - 102
IEEE Solid-State Circuits Magazine - Fall 2017 - 103
IEEE Solid-State Circuits Magazine - Fall 2017 - 104
IEEE Solid-State Circuits Magazine - Fall 2017 - 105
IEEE Solid-State Circuits Magazine - Fall 2017 - 106
IEEE Solid-State Circuits Magazine - Fall 2017 - 107
IEEE Solid-State Circuits Magazine - Fall 2017 - 108
IEEE Solid-State Circuits Magazine - Fall 2017 - 109
IEEE Solid-State Circuits Magazine - Fall 2017 - 110
IEEE Solid-State Circuits Magazine - Fall 2017 - 111
IEEE Solid-State Circuits Magazine - Fall 2017 - 112
IEEE Solid-State Circuits Magazine - Fall 2017 - 113
IEEE Solid-State Circuits Magazine - Fall 2017 - 114
IEEE Solid-State Circuits Magazine - Fall 2017 - 115
IEEE Solid-State Circuits Magazine - Fall 2017 - 116
IEEE Solid-State Circuits Magazine - Fall 2017 - 117
IEEE Solid-State Circuits Magazine - Fall 2017 - 118
IEEE Solid-State Circuits Magazine - Fall 2017 - 119
IEEE Solid-State Circuits Magazine - Fall 2017 - 120
IEEE Solid-State Circuits Magazine - Fall 2017 - 121
IEEE Solid-State Circuits Magazine - Fall 2017 - 122
IEEE Solid-State Circuits Magazine - Fall 2017 - 123
IEEE Solid-State Circuits Magazine - Fall 2017 - 124
IEEE Solid-State Circuits Magazine - Fall 2017 - 125
IEEE Solid-State Circuits Magazine - Fall 2017 - 126
IEEE Solid-State Circuits Magazine - Fall 2017 - 127
IEEE Solid-State Circuits Magazine - Fall 2017 - 128
IEEE Solid-State Circuits Magazine - Fall 2017 - 129
IEEE Solid-State Circuits Magazine - Fall 2017 - 130
IEEE Solid-State Circuits Magazine - Fall 2017 - 131
IEEE Solid-State Circuits Magazine - Fall 2017 - 132
IEEE Solid-State Circuits Magazine - Fall 2017 - 133
IEEE Solid-State Circuits Magazine - Fall 2017 - 134
IEEE Solid-State Circuits Magazine - Fall 2017 - 135
IEEE Solid-State Circuits Magazine - Fall 2017 - 136
IEEE Solid-State Circuits Magazine - Fall 2017 - 137
IEEE Solid-State Circuits Magazine - Fall 2017 - 138
IEEE Solid-State Circuits Magazine - Fall 2017 - 139
IEEE Solid-State Circuits Magazine - Fall 2017 - 140
IEEE Solid-State Circuits Magazine - Fall 2017 - 141
IEEE Solid-State Circuits Magazine - Fall 2017 - 142
IEEE Solid-State Circuits Magazine - Fall 2017 - 143
IEEE Solid-State Circuits Magazine - Fall 2017 - 144
IEEE Solid-State Circuits Magazine - Fall 2017 - 145
IEEE Solid-State Circuits Magazine - Fall 2017 - 146
IEEE Solid-State Circuits Magazine - Fall 2017 - 147
IEEE Solid-State Circuits Magazine - Fall 2017 - 148
IEEE Solid-State Circuits Magazine - Fall 2017 - Cover3
IEEE Solid-State Circuits Magazine - Fall 2017 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2019
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2019
https://www.nxtbook.com/nxtbooks/ieee/mssc_2019summer
https://www.nxtbook.com/nxtbooks/ieee/mssc_2019winter
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018fall
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018summer
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018spring
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018winter
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2014
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2014
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2014
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2014
https://www.nxtbookmedia.com