IEEE Spectrum November, 2008 - 8
0
Memory stacked on processor
0.005
0.01
Conventional architecture
0.015
0.02
multicore is
bad News for
Supercomputers
Adding cores slows data-intensive
applications
W
ith no other
way to improve
the performance
of processors further, chip
makers have staked their
future on putting more and
more processor cores on
the same chip. Engineers
at Sandia National
Laboratories, in New
Mexico, have simulated
future high-performance
computers containing the
8-core, 16-core, and 32-core
microprocessors that chip
makers say are the future
of the industry. The results
are distressing. Because of
limited memory bandwidth
and memory-management
schemes that are poorly
suited to supercomputers,
the performance of these
machines would level off or
even decline with more cores.
The performance is especially
bad for informatics applications-data-intensive programs that are increasingly
crucial to the labs' national
security function.
High-performance
computing has historically
focused on solving
differential equations
describing physical systems,
such as Earth's atmosphere
or a hydrogen bomb's fission
trigger. These systems lend
themselves to being divided
up into grids, so the physical
www.spectrum.ieee.org
Performance (seconds)
0.025
0.03
0.035
0.04
0.045
system can, to a degree, be
mapped to the physical
location of processors or
processor cores, thus minimizing delays in moving data.
But an increasing number
of important science and
engineering problems-
not to mention national
security problems-are of
a different sort. These fall
under the general category
of informatics and include
calculating what happens
to a transportation network
during a natural disaster and
searching for patterns that
predict terrorist attacks or
nuclear proliferation failures.
These operations often require
sifting through enormous
databases of information.
For informatics, more
cores doesn't mean better
performance [see red line in
the future: intel's experimental
chip has 80 cores. photo: Intel
2
Processor cores
4
8
16
32
64
trouble ahead: more cores per chip will slow some programs [red]
unless there's a big boost in memory bandwidth [yellow]. source: sandIa
"Trouble Ahead"], according
to Sandia's simulation.
"After about 8 cores, there's
no improvement," says
James Peery, director of
computation, computers,
information, and
mathematics at Sandia. "At
16 cores, it looks like 2." Over
the past year, the Sandia
team has discussed the
results widely with chip
makers, supercomputer
designers, and users of highperformance computers.
Unless computer architects
find a solution, Peery and
others expect that supercomputer programmers will
either turn off the extra cores
or use them for something
ancillary to the main problem.
At the heart of the trouble
is the so-called memory
wall-the growing disparity
between how fast a CPU
can operate on data and
how fast it can get the data it
needs. Although the number
of cores per processor is
increasing, the number of
connections from the chip
to the rest of the computer is
not. So keeping all the cores
fed with data is a problem. In
informatics applications, the
problem is worse, explains
Richard C. Murphy, a senior
member of the technical staff
at Sandia, because there
is no physical relationship
between what a processor
may be working on and
where the next set of data it
needs may reside. Instead
of being in the cache of the
core next door, the data
may be on a DRAM chip in
a rack 20 meters away and
need to leave the chip, pass
through one or more routers
and optical fibers, and find
its way onto the processor.
In an effort to get things
back on track, this year the
U.S. Department of Energy
formed the Institute for
Advanced Architectures
and Algorithms. Located
at Sandia and at Oak Ridge
National Laboratory, in
Tennessee, the institute's
work will be to figure out
what high-performance
computer architectures will
be needed five to 10 years
from now and help steer the
industry in that direction.
"The key to solving
this bottleneck is tighter,
and maybe smarter,
integration of memory
and processors," says
Peery. For its part, Sandia
is exploring the impact of
stacking memory chips
atop processors to improve
memory bandwidth.
The results, in simulation
at least, are promising
[see yellow line in "Trouble
Ahead]. -Samuel K. Moore
november 2008 * Ieee Spectrum * nA
15
http://www.spectrum.ieee.org
Table of Contents for the Digital Edition of IEEE Spectrum November, 2008
IEEE Spectrum November, 2008 - Cover1
IEEE Spectrum November, 2008 - Cover2
IEEE Spectrum November, 2008 - 1
IEEE Spectrum November, 2008 - 2
IEEE Spectrum November, 2008 - 3
IEEE Spectrum November, 2008 - 4
IEEE Spectrum November, 2008 - 5
IEEE Spectrum November, 2008 - 6
IEEE Spectrum November, 2008 - 7
IEEE Spectrum November, 2008 - 8
IEEE Spectrum November, 2008 - 9
IEEE Spectrum November, 2008 - 10
IEEE Spectrum November, 2008 - 11
IEEE Spectrum November, 2008 - 12
IEEE Spectrum November, 2008 - 13
IEEE Spectrum November, 2008 - 14
IEEE Spectrum November, 2008 - 15
IEEE Spectrum November, 2008 - 16
IEEE Spectrum November, 2008 - 17
IEEE Spectrum November, 2008 - 18
IEEE Spectrum November, 2008 - 19
IEEE Spectrum November, 2008 - 20
IEEE Spectrum November, 2008 - 21
IEEE Spectrum November, 2008 - 22
IEEE Spectrum November, 2008 - 23
IEEE Spectrum November, 2008 - 24
IEEE Spectrum November, 2008 - 25
IEEE Spectrum November, 2008 - 26
IEEE Spectrum November, 2008 - 27
IEEE Spectrum November, 2008 - 28
IEEE Spectrum November, 2008 - 29
IEEE Spectrum November, 2008 - 30
IEEE Spectrum November, 2008 - 31
IEEE Spectrum November, 2008 - 32
IEEE Spectrum November, 2008 - 33
IEEE Spectrum November, 2008 - 34
IEEE Spectrum November, 2008 - 35
IEEE Spectrum November, 2008 - 36
IEEE Spectrum November, 2008 - 37
IEEE Spectrum November, 2008 - 38
IEEE Spectrum November, 2008 - 39
IEEE Spectrum November, 2008 - 40
IEEE Spectrum November, 2008 - 41
IEEE Spectrum November, 2008 - 42
IEEE Spectrum November, 2008 - 43
IEEE Spectrum November, 2008 - 44
IEEE Spectrum November, 2008 - 45
IEEE Spectrum November, 2008 - 46
IEEE Spectrum November, 2008 - 47
IEEE Spectrum November, 2008 - Cover3
IEEE Spectrum November, 2008 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1217
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1117
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1017
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0917
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0817
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0717
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0617
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0517
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0417
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0317
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0217
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0117
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1216
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1116
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1016
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0916
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0816
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0716
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0616
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0516
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0416
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0316
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0216
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0116
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1215
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1115
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1015
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0915
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0815
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0715
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0615
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0515
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0415
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0315
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0215
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0115
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1214
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1114
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1014
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0914
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0814
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0714
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0614
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0514
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0414
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0314
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0214
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0114
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1213
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1113
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1013
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0913
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0813
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0713
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0613
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0513
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0413
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0313
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0213
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0113
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1212
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1112
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1012
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0912
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0812
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0712
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0612
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0512
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0412
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0312
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0212
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0112
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1211
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1111
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1011
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0911
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0811
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0711
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0611
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0511
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0411
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0311
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0211
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0111
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1210
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1110
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1010
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0910
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0810
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0710
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0610
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0510
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0410
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0310
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0210
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0110
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1209
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1109
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1009
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0909
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0809
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0709
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0609
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0509
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0409
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0309
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0209
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0109
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1208
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1108
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1008
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0908
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0808
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0708
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0608
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0508
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0408
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0308
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0208
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0108
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1207
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1107
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_1007
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0907
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0807
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0707
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0607
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0507
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0407
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0307
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0207
https://www.nxtbook.com/nxtbooks/ieee/spectrum_na_0107
https://www.nxtbookmedia.com