ASHRAE Journal - July 2019 - 21

TECHNICAL FEATURE

J U LY 2 0 19

ashrae.org

ASHRAE JOURNAL

21

©DLB ASSOCIATES

Cooling Load (kW/ft2)

can provide a more uniform cooling
FIGURE 1 Water Cooling Load Trends from 2010 to 2017. Footprint includes apportioned CDU area. Data shown
of the components compared to air
with permissions from HPE, SGI, Fujitsu, IBM, Dell, Huawei and Cray.
cooling, improving the reliability of
the system.
14
With these factors in mind,
24
Air
Scientific Servers
Indirect
12
ASHRAE TC 9.9, Mission Critical
(2018 Air Cooling Power Trends)
Direct
Facilities, Data Centers, Technology
10
Maximum Facility Supply Temperature in °C
Spaces and Electronic Equipment,
8
has recently published a 45-page
27
10
32 32
white paper "Water-Cooled Servers-
40
6
45 25 32 32 20
32
24
25
Common Designs, Components,
16
4
45 16
16 16
40
and Processes" (available for free at
20
16 10
40
16
45
45
45
https://tinyurl.com/y239t4rv). With
2
the advent of more water-cooled
0
IT products arriving in the market2010
2011
2012
2013
2014
2015
2016
2017
Year
of
Announcement
place, TC 9.9 felt the need to outline
some of the common processes,
parts and materials that could provide focus for use in
axis is the server power divided by the rack footprint.
future water-cooled designs and help accelerate the
Variations in rack height are not accommodated in this
trend toward increased use of water-cooled servers
figure, but it is noted that there was not a large variadeployed in data centers.
tion of rack heights. One other caveat in the denominaObviously, some parts in a water-cooled IT system will
tor for the area is that if the water-cooled server rack
be specific to the product design, such as cold plates,
required a coolant distribution unit (CDU) (see the secmanifolds, arrangement of piping, pumps, valves, etc.,
tion below for a description of the CDU implementabut some things like quick connects, hoses, hose contion into a data center) then this area was apportioned
nections, wetted materials, filtration, pressure testing
to the rack area. For example, if a CDU supported
of final water-cooling assemblies, water chemistry and
four server racks then 25% of the area of the CDU was
design options to integrate water-cooled IT equipment
added to the rack area to make up the denominator for
into the data center cooling infrastructure fall more
power/rack footprint.
into the category of common parts/processes that could
Each bar in Figure 1 displays the total maximum heat
be used by all current and potential manufacturers of
load dissipated by the water-cooled server rack. (For
water-cooled IT equipment.
comparison, the trend of the maximum air-cooled servThe TC 9.9 white paper effort is an attempt to provide
ers [scientific servers] as displayed in the latest ASHRAE
and make available those items that could be classiDatacom Series book IT Equipment Power Trends, 3rd Edition
fied as common. Several of these will be discussed in
is also shown in Figure 1.) The amount of power dissithis article. The remainder of this article, as well as
pated is categorized into three areas: air cooled, indirect
the white paper, are focused on the implementation of
water-cooled and direct water-cooled. These are defined
water-cooled IT equipment. Other liquid-cooling techas follows:
nologies for IT equipment are available, and in general
* Air Cooled: power that is transferred directly to the
these liquids will be associated with the technology cool- room air and cooled via traditional data center cooling.
ing system loop (TCS) for the IT equipment, while the
* Indirect Water-Cooled: power that is transferred inwater-cooled facilities loop (facility water system [FWS]) directly to water through an air-to-water heat exchanger
will still be required to remove the heat from the liquid- located within or on the rack (for example, a rear door
cooled TCS loop.
heat exchanger).
The data in the white paper displays some trends,
* Direct Water-Cooled: power that is transferred
including that of 28 water-cooled products announced directly to an attached heat transfer component like a
by IT OEMs from 2010 to 2017 (Figure 1). The vertical
cold plate.


https://www.tinyurl.com/y239t4rv https://www.ashrae.org/

ASHRAE Journal - July 2019

Table of Contents for the Digital Edition of ASHRAE Journal - July 2019

Contents
ASHRAE Journal - July 2019 - Intro
ASHRAE Journal - July 2019 - Cover1
ASHRAE Journal - July 2019 - Cover2
ASHRAE Journal - July 2019 - 1
ASHRAE Journal - July 2019 - Contents
ASHRAE Journal - July 2019 - 3
ASHRAE Journal - July 2019 - 4
ASHRAE Journal - July 2019 - 5
ASHRAE Journal - July 2019 - 6
ASHRAE Journal - July 2019 - 7
ASHRAE Journal - July 2019 - 8
ASHRAE Journal - July 2019 - 9
ASHRAE Journal - July 2019 - 10
ASHRAE Journal - July 2019 - 11
ASHRAE Journal - July 2019 - 12
ASHRAE Journal - July 2019 - 13
ASHRAE Journal - July 2019 - 14
ASHRAE Journal - July 2019 - 15
ASHRAE Journal - July 2019 - 16
ASHRAE Journal - July 2019 - 17
ASHRAE Journal - July 2019 - 18
ASHRAE Journal - July 2019 - 19
ASHRAE Journal - July 2019 - 20
ASHRAE Journal - July 2019 - 21
ASHRAE Journal - July 2019 - 22
ASHRAE Journal - July 2019 - 23
ASHRAE Journal - July 2019 - 24
ASHRAE Journal - July 2019 - 25
ASHRAE Journal - July 2019 - 26
ASHRAE Journal - July 2019 - 27
ASHRAE Journal - July 2019 - 28
ASHRAE Journal - July 2019 - 29
ASHRAE Journal - July 2019 - 30
ASHRAE Journal - July 2019 - 31
ASHRAE Journal - July 2019 - 32
ASHRAE Journal - July 2019 - 33
ASHRAE Journal - July 2019 - 34
ASHRAE Journal - July 2019 - 35
ASHRAE Journal - July 2019 - 36
ASHRAE Journal - July 2019 - 37
ASHRAE Journal - July 2019 - 38
ASHRAE Journal - July 2019 - 39
ASHRAE Journal - July 2019 - 40
ASHRAE Journal - July 2019 - 41
ASHRAE Journal - July 2019 - 42
ASHRAE Journal - July 2019 - 43
ASHRAE Journal - July 2019 - 44
ASHRAE Journal - July 2019 - 45
ASHRAE Journal - July 2019 - 46
ASHRAE Journal - July 2019 - 47
ASHRAE Journal - July 2019 - 48
ASHRAE Journal - July 2019 - 49
ASHRAE Journal - July 2019 - 50
ASHRAE Journal - July 2019 - 51
ASHRAE Journal - July 2019 - 52
ASHRAE Journal - July 2019 - 53
ASHRAE Journal - July 2019 - 54
ASHRAE Journal - July 2019 - 55
ASHRAE Journal - July 2019 - 56
ASHRAE Journal - July 2019 - 57
ASHRAE Journal - July 2019 - 58
ASHRAE Journal - July 2019 - 59
ASHRAE Journal - July 2019 - 60
ASHRAE Journal - July 2019 - 61
ASHRAE Journal - July 2019 - 62
ASHRAE Journal - July 2019 - 63
ASHRAE Journal - July 2019 - 64
ASHRAE Journal - July 2019 - 65
ASHRAE Journal - July 2019 - 66
ASHRAE Journal - July 2019 - 67
ASHRAE Journal - July 2019 - 68
ASHRAE Journal - July 2019 - 69
ASHRAE Journal - July 2019 - 70
ASHRAE Journal - July 2019 - 71
ASHRAE Journal - July 2019 - 72
ASHRAE Journal - July 2019 - 73
ASHRAE Journal - July 2019 - 74
ASHRAE Journal - July 2019 - 75
ASHRAE Journal - July 2019 - 76
ASHRAE Journal - July 2019 - 77
ASHRAE Journal - July 2019 - 78
ASHRAE Journal - July 2019 - 79
ASHRAE Journal - July 2019 - 80
ASHRAE Journal - July 2019 - 81
ASHRAE Journal - July 2019 - 82
ASHRAE Journal - July 2019 - 83
ASHRAE Journal - July 2019 - 84
ASHRAE Journal - July 2019 - 85
ASHRAE Journal - July 2019 - 86
ASHRAE Journal - July 2019 - 87
ASHRAE Journal - July 2019 - 88
ASHRAE Journal - July 2019 - 89
ASHRAE Journal - July 2019 - 90
ASHRAE Journal - July 2019 - 91
ASHRAE Journal - July 2019 - 92
ASHRAE Journal - July 2019 - 93
ASHRAE Journal - July 2019 - 94
ASHRAE Journal - July 2019 - 95
ASHRAE Journal - July 2019 - 96
ASHRAE Journal - July 2019 - 97
ASHRAE Journal - July 2019 - 98
ASHRAE Journal - July 2019 - 99
ASHRAE Journal - July 2019 - 100
ASHRAE Journal - July 2019 - 101
ASHRAE Journal - July 2019 - 102
ASHRAE Journal - July 2019 - 103
ASHRAE Journal - July 2019 - 104
ASHRAE Journal - July 2019 - 105
ASHRAE Journal - July 2019 - 106
ASHRAE Journal - July 2019 - 107
ASHRAE Journal - July 2019 - 108
ASHRAE Journal - July 2019 - 109
ASHRAE Journal - July 2019 - 110
ASHRAE Journal - July 2019 - 111
ASHRAE Journal - July 2019 - 112
ASHRAE Journal - July 2019 - 113
ASHRAE Journal - July 2019 - 114
ASHRAE Journal - July 2019 - 115
ASHRAE Journal - July 2019 - 116
ASHRAE Journal - July 2019 - 117
ASHRAE Journal - July 2019 - 118
ASHRAE Journal - July 2019 - 119
ASHRAE Journal - July 2019 - 120
ASHRAE Journal - July 2019 - Cover3
ASHRAE Journal - July 2019 - Cover4
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_FYONLJ
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2024november_v2
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2024november
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_BDMHLG
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_WJDGRY
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_ATMAHK
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_VHQRAW
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_XGMDXI
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_YELQLJ
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_QJLWMC
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_MCDEBX
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_WNYSQY
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_XATVOD
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_FJSHSS
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_CCBZDS
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_XDEFVG
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2023november_v2
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2023november
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_VHGNBL
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_WPKBNJ
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_UUVCDE
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_RTGDEW
https://www.nxtbook.com/nxtbooks/ashrae/ashraemexico_2023
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_LKRFXS
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_AZSOFG
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_ERCDBH
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_QWDFRV
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_JHGVDF
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_OPUYHG
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_SREIBM
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_LRTGLK
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_OKRFGH
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2022november_v2
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2022november
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_TZSERA
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_LVRUIX
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_RPTVYZ
https://www.nxtbook.com/nxtbooks/ashrae/mini_pub_catalog
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_XIYTGD
https://www.nxtbook.com/nxtbooks/ashrae/ashraemexico_2022
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_RFGDOB
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_PABXNU
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_REMKLS
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_PICVBT
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_AOYTVW
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_JQOPLS
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_IOYTBC
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_SGAJJF
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_IGHYER
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_PDRKLS
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2021november
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2021november_v2
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_XCODFR
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_QSLFGO
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_ILKVNM
https://www.nxtbook.com/nxtbooks/ashrae/ashraemexico_2021
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_OPDJKD
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_VJKSRY
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_SDHUTC
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_JPPKRR
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_SDLTTH
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_CKLLES
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_SLDOX
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_HJETUK
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_OLUHGE
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2020october
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2020october_v2
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_ZERDGH
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_QVMNEO
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_RTPOKE
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_BBATRE
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_STUBMW
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_TPEMPE
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_JNMKDS
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_FBTTPA
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_WQMMNE
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_TVBRYN
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_showguide2020
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_KTUZMA
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_ABEDGD
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201910
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201909
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2019septmeber_v2
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2019september
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201908
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201907
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201906
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201905
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201904
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_2019april
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201903
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_2019march
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201902
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201901
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_showguide2019
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_2018december
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_2018november
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2018fall_v2
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2018fall
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_2018october
https://www.nxtbook.com/nxtbooks/ashrae/ashraemexico_2018
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201810
https://www.nxtbook.com/nxtbooks/ashrae/ashraeinsights_201806
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201805
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201804
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201803
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201712
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201711
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201710
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2017fall_v2
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2017fall
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201709
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201705
https://www.nxtbook.com/nxtbooks/ashrae/ashrae_meetinginsert_201610
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2016fall_v2
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2016fall
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_acrexindia
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2015summer_v2
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_amca_2015summer
https://www.nxtbook.com/nxtbooks/amca/2014summer2
https://www.nxtbook.com/nxtbooks/amca/2014summer
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_acma_2014summer
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201311
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201309
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_acmasupp_2013fall
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201305
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201303
https://www.nxtbook.com/nxtbooks/ashrae/pubcatalog_2013winter
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201211
https://www.nxtbook.com/nxtbooks/ashrae/achr_expo_mexico2012
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201209
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201208_v3
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201208_v2
https://www.nxtbook.com/nxtbooks/ashrae/pubcatalog_2012summer
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201205
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201203
https://www.nxtbook.com/nxtbooks/ashrae/pubcatalog_2012winter
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201111_v2
https://www.nxtbook.com/nxtbooks/ashrae/ashraejournal_201109_v2
https://www.nxtbook.com/nxtbooks/ashrae/pubcatalog_2011summer
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201105
https://www.nxtbook.com/nxtbooks/ashrae/meetingplanner_201103
https://www.nxtbookmedia.com