IEEE Circuits and Systems Magazine - Q2 2020 - 36
obtained by permuting these level hypervectors in this
encoding method. For example, the level hypervector Lr i
corresponding to the i-th feature position is rotationally
permuted by (i - 1) positions, where 1 # i # N. We can
get the final encoded hypervector H by Eq. (16). Such an
encoding process is illustrated in Fig. 7.
H = Lr 1 5 tLr 2 5 g 5 t N - 1 Lr N ,
(16)
Lr i ! {L 1, L 2, f, L m}, where 1 # i # N.
Remark As stated in [29], for speech recognition, the
N-gram-based encoding method achieves lower accuracy
than record-based counterpart. This encoding method is
also used to address data types of letters, such as language
recognition [21] and DNA sequencing [31].
C. Benchmarking Metrics in HD Computing
In HD computing, there is always a tradeoff between accuracy and efficiency, e.g., see [32]. As shown in Fig. 8,
a large amount of work has been carried out to improve
the classification accuracy, energy efficiency, or both at
the same time.
Fmax
2
1
N
Fmin
CiM
CiM
CiM
L2
L1
LN
ρ
ρN-1
H
Figure 7. N-gram-based encoding [29]. CiM stores level
hypervectors which are mutually orthogonal.
1) Accuracy
In terms of accuracy, the encoding method plays a significant role since each encoding may not be efficient for
different types of data. Good encoding for HD to achieve
high accuracy is hard [33]. In this sense, an appropriate
choice of encoding method can improve the accuracy.
Efficient encoding approaches have been presented in
[34]. The approach in [29] integrates different encoding
methods together to achieve higher accuracy at the expense of hardware area. Compared to single-pass training, retraining iteratively improves the training accuracy [28]. Thus the classification accuracy is improved by
using a more accurately trained model. Moreover, using
binary hypervectors may degrade the accuracy. Hence
with enough resources, non-binary models can be used
to achieve high accuracy.
2) Efficiency
For efficiency, improvements mainly focus on algorithm
and hardware characteristics. From the algorithm perspective, dimension reduction is the most natural way
to realize efficiency. Simulations show that slightly reducing the dimensionality of hypervectors, the classification accuracy still remains in an acceptable range
but saves hardware resources [25]. Binarization, which
refers to employing binary hypervectors instead of nonbinary model, accelerates computation and reduces
hardware resources [35]. The precision is degraded
by quantizing the non-binary HD model. QuantHD has
been proposed in [25] to achieve higher efficiency with
minimal impact on accuracy. Sparsity was introduced in
HD computing in the framework of BSDC [36]. Tradeoff
between dense and sparse binary vectors has been presented in [32]. By introducing the concept of sparsity to
hypervector representation, [37] proposes a novel platform, SparseHD, which reduces inference computations
and leads to high efficiency. From the hardware perspective, HD computing involves a large number of bit-wise
operations, as well as the same computation flow for
HD Computing
Accuracy
Encoding
Retraining
Efficiency
Non-Binary
Binarization
Hardware
Algorithm
Quantization
Sparsity
In-Memory
CNFET
NanoTech
RRAM
FPGA
3D Intergration
Figure 8. Two benchmarking metrics in HD computing and some possible ways to improve these metrics.
36
IEEE CIRCUITS AND SYSTEMS MAGAZINE
SECOND QUARTER 2020
IEEE Circuits and Systems Magazine - Q2 2020
Table of Contents for the Digital Edition of IEEE Circuits and Systems Magazine - Q2 2020
Contents
IEEE Circuits and Systems Magazine - Q2 2020 - Cover1
IEEE Circuits and Systems Magazine - Q2 2020 - Cover2
IEEE Circuits and Systems Magazine - Q2 2020 - Contents
IEEE Circuits and Systems Magazine - Q2 2020 - 2
IEEE Circuits and Systems Magazine - Q2 2020 - 3
IEEE Circuits and Systems Magazine - Q2 2020 - 4
IEEE Circuits and Systems Magazine - Q2 2020 - 5
IEEE Circuits and Systems Magazine - Q2 2020 - 6
IEEE Circuits and Systems Magazine - Q2 2020 - 7
IEEE Circuits and Systems Magazine - Q2 2020 - 8
IEEE Circuits and Systems Magazine - Q2 2020 - 9
IEEE Circuits and Systems Magazine - Q2 2020 - 10
IEEE Circuits and Systems Magazine - Q2 2020 - 11
IEEE Circuits and Systems Magazine - Q2 2020 - 12
IEEE Circuits and Systems Magazine - Q2 2020 - 13
IEEE Circuits and Systems Magazine - Q2 2020 - 14
IEEE Circuits and Systems Magazine - Q2 2020 - 15
IEEE Circuits and Systems Magazine - Q2 2020 - 16
IEEE Circuits and Systems Magazine - Q2 2020 - 17
IEEE Circuits and Systems Magazine - Q2 2020 - 18
IEEE Circuits and Systems Magazine - Q2 2020 - 19
IEEE Circuits and Systems Magazine - Q2 2020 - 20
IEEE Circuits and Systems Magazine - Q2 2020 - 21
IEEE Circuits and Systems Magazine - Q2 2020 - 22
IEEE Circuits and Systems Magazine - Q2 2020 - 23
IEEE Circuits and Systems Magazine - Q2 2020 - 24
IEEE Circuits and Systems Magazine - Q2 2020 - 25
IEEE Circuits and Systems Magazine - Q2 2020 - 26
IEEE Circuits and Systems Magazine - Q2 2020 - 27
IEEE Circuits and Systems Magazine - Q2 2020 - 28
IEEE Circuits and Systems Magazine - Q2 2020 - 29
IEEE Circuits and Systems Magazine - Q2 2020 - 30
IEEE Circuits and Systems Magazine - Q2 2020 - 31
IEEE Circuits and Systems Magazine - Q2 2020 - 32
IEEE Circuits and Systems Magazine - Q2 2020 - 33
IEEE Circuits and Systems Magazine - Q2 2020 - 34
IEEE Circuits and Systems Magazine - Q2 2020 - 35
IEEE Circuits and Systems Magazine - Q2 2020 - 36
IEEE Circuits and Systems Magazine - Q2 2020 - 37
IEEE Circuits and Systems Magazine - Q2 2020 - 38
IEEE Circuits and Systems Magazine - Q2 2020 - 39
IEEE Circuits and Systems Magazine - Q2 2020 - 40
IEEE Circuits and Systems Magazine - Q2 2020 - 41
IEEE Circuits and Systems Magazine - Q2 2020 - 42
IEEE Circuits and Systems Magazine - Q2 2020 - 43
IEEE Circuits and Systems Magazine - Q2 2020 - 44
IEEE Circuits and Systems Magazine - Q2 2020 - 45
IEEE Circuits and Systems Magazine - Q2 2020 - 46
IEEE Circuits and Systems Magazine - Q2 2020 - 47
IEEE Circuits and Systems Magazine - Q2 2020 - 48
IEEE Circuits and Systems Magazine - Q2 2020 - Cover3
IEEE Circuits and Systems Magazine - Q2 2020 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2023Q3
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2023Q2
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2023Q1
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2022Q4
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2022Q3
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2022Q2
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2022Q1
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2021Q4
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2021q3
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2021q2
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2021q1
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2020q4
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2020q3
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2020q2
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2020q1
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2019q4
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2019q3
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2019q2
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2019q1
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2018q4
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2018q3
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2018q2
https://www.nxtbook.com/nxtbooks/ieee/circuitsandsystems_2018q1
https://www.nxtbookmedia.com