US20110292600A1

US20110292600A1 - Dehumidifying and re-humidifying cooling apparatus and method for an electronics rack

Info

Publication number: US20110292600A1
Application number: US12/787,790
Authority: US
Inventors: Levi A. Campbell; Richard C. Chu; Michael J. Ellsworth, Jr.; Madhusudan K. Iyengar; Robert E. Simons
Original assignee: International Business Machines Corp
Current assignee: Lenovo International Ltd
Priority date: 2010-05-26
Filing date: 2010-05-26
Publication date: 2011-12-01
Also published as: US8189334B2

Abstract

Dehumidifying and re-humidifying cooling apparatus and method are provided for an electronics rack. The apparatus includes an air-to-liquid heat exchanger disposed at an air inlet side of the rack, wherein air flows through the rack from the air inlet side to an air outlet side. The heat exchanger, which is positioned for ingressing air to pass thereacross before passing through the electronics rack, is in fluid communication with a coolant loop for passing coolant through the heat exchanger, and the heat exchanger dehumidifies ingressing air to the electronics rack to reduce a dew point of air flowing through the rack. A condensate collector disposed at the air inlet side collects liquid condensate from the heat exchanger's dehumidifying of ingressing air, and an evaporator disposed at the air outlet side humidifies air egressing from the electronics rack employing condensate from the condensate collector.

Description

BACKGROUND

The present invention relates in general to cooling of an electronics rack(s) of a data center, including rack-mounted assemblages of individual electronics units, such as rack-mounted computer server units.
The power dissipation of integrated circuit chips, and the modules containing the chips, continues to increase in order to achieve increases in processor performance. This trend poses a cooling challenge at both the module and system level. Increased air flow rates are needed to effectively cool high power modules and to limit the temperature of the air that is exhausted into the data center.
In many large server applications, processors along with their associated electronics (e.g., memory, disk drives, power supplies, etc.) are packaged in removable drawer configurations stacked within a rack or frame. In other cases, the electronics may be in fixed locations within the rack or frame. Typically, the components are cooled by air moving in parallel airflow paths, usually front-to-back, impelled by one or more air moving devices (e.g., fans or blowers). In some cases it may be possible to handle increased power dissipation within a single drawer by providing greater airflow through the use of a more powerful air moving device or by increasing the rotational speed (i.e., RPMs) of an existing air moving device. However, this approach is becoming problematic at the electronic component and at the rack level in the context of a computer installation (e.g., a data center).
For example, the sensible heat load carried by the air exiting the rack is stressing the ability of the room air-conditioning to effectively handle the load. This is especially true for large installations with “server farms” or large banks of computer racks close together. In such installations, liquid cooling (e.g., refrigerant or water-cooling) is an attractive technology to manage the higher heat fluxes of selected high heat flux electronic components within the electronics rack. The liquid coolant absorbs the heat dissipated by the high heat flux components/modules in an efficient manner, with the heat typically being transferred from the liquid coolant to an outside environment, whether air or other liquid coolant.

BRIEF SUMMARY

In one aspect, an apparatus is provided herein for facilitating cooling of an electronics rack. The apparatus includes a heat exchange assembly, a condensate collector, and a condensate evaporator. The heat exchange assembly is configured to reside at an air inlet side of the electronics rack, wherein the electronics rack includes the air inlet side and an air outlet side for respectively enabling ingress and egress of air through the electronics rack. The heat exchange assembly includes an air-to-liquid heat exchanger positioned for ingressing air to pass thereacross before passing through the electronics rack. The air-to-liquid heat exchanger is in fluid communication with a coolant loop for passing coolant therethrough, and the air-to-liquid heat exchanger with coolant passing therethrough dehumidifies ingressing air to the electronics rack to lower a dew point temperature of the air flowing through the electronics rack. The condensate collector is disposed at the air inlet side of the electronics rack and collects liquid condensate from the air-to-liquid heat exchanger's dehumidifying of ingressing air to the electronics rack, while the condensate evaporator is disposed at the air outlet side of the electronics rack and is coupled in fluid communication with the condensate collector at the air inlet side of the electronics rack for receiving and evaporating liquid condensate from the condensate collector, wherein liquid condensate withdrawn from the ingressing air to the electronics rack at the air inlet side thereof is evaporated to the egressing air at the air outlet side of the electronics rack.
In another aspect, a cooled electronic system is provided which includes an electronics rack and a dehumidifying and re-humidifying cooling apparatus for the electronics rack. The electronics rack includes an air inlet side and an air outlet side for respectively enabling ingress and egress of air, at least one electronic component requiring cooling, and at least one air-moving device. The at least one air-moving device causes air to flow from the air inlet side of the electronics rack through the electronics rack, to the air outlet side thereof. The dehumidifying and re-humidifying cooling apparatus includes a heat exchange assembly, a condensate collector and a condensate evaporator. The heat exchange assembly is disposed at the air inlet side of the electronics rack, and includes an air-to-liquid heat exchanger positioned for ingressing air to pass thereacross before passing through the electronics rack. The air-to-liquid heat exchanger is in fluid communication with a coolant loop for passing coolant therethrough, and the air-to-liquid heat exchanger with the coolant passing therethrough dehumidifies ingressing air to the electronics rack to lower the dew point temperature of the air flowing through the electronics rack. The condensate collector is disposed at the air inlet side of the electronics rack and collects liquid condensate from the air-to-liquid heat exchanger's dehumidifying of ingressing air to the electronics rack. The condensate evaporator is disposed at the air outlet side of the electronics rack and is coupled in fluid communication with the condensate collector at the air inlet side of the electronics rack for receiving and evaporating liquid condensate from the condensate collector, wherein liquid condensate withdrawn from the ingressing air to the electronics rack at the air inlet side thereof is evaporated to the egressing air at the air outlet side of the electronics rack.
In a further aspect, a method of facilitating cooling of an electronics rack is provided. The method includes: disposing a heat exchange assembly at an air inlet side of the electronics rack, wherein the electronics rack includes the air inlet side and an air outlet side respectively enabling ingress and egress of air through the electronics rack, the heat exchange assembly including an air-to-liquid heat exchanger positioned for ingressing air to pass thereacross before passing through the electronics rack, the air-to-liquid heat exchanger being in fluid communication with a coolant loop for passing coolant therethrough, and the air-to-liquid heat exchanger with coolant passing therethrough dehumidifying ingressing air to the electronics rack to lower a dew point temperature of air flowing through the electronics rack; collecting liquid condensate from the air-to-liquid heat exchanger's dehumidifying of ingressing air to the electronics rack; moving the liquid condensate from the air inlet side of the electronics rack to the air outlet side thereof; and evaporating at the air outlet side of the electronics rack, the liquid condensate to humidify air egressing from the electronics rack.
Additional features and advantages are realized through the techniques of the present invention. Other embodiments and aspects of the invention are described in detail herein and are considered a part of the claimed invention.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

One or more aspects of the present invention are particularly pointed out and distinctly claimed as examples in the claims at the conclusion of the specification. The foregoing and other objects, features, and advantages of the invention are apparent from the following detailed description taken in conjunction with the accompanying drawings in which:

FIG. 1 depicts one embodiment of a conventional raised floor layout of an air-cooled data center;

FIG. 2A is an isometric view of one embodiment of a modular refrigeration unit (MRU) and its quick disconnect connectors for attachment to a cold plate and/or evaporator disposed within an electronics rack to cool one or more electronic components (e.g., modules) thereof, in accordance with an aspect of the present invention;

FIG. 2B is a schematic of one embodiment of a refrigerant loop for cooling an evaporator (or cold plate) coupled to a high heat flux electronic component (e.g., module) to be cooled, in accordance with an aspect of the present invention;

FIG. 3A depicts one embodiment of an electronics rack to employ a dehumidifying and re-humidifying cooling apparatus, in accordance with an aspect of the present invention;

FIG. 3B is a cross-sectional elevational view of the electronics rack of FIG. 3A, taken along line 3B-3B, and illustrating one embodiment of a dehumidifying and re-humidifying cooling apparatus, in accordance with an aspect of the present invention;

FIG. 3C depicts one embodiment of a control process for controlling the dehumidifying of ingressing air to the electronics rack, in accordance with an aspect of the present invention;

FIG. 3D depicts one embodiment of a control process for controlling evaporation of liquid condensate from the condensate evaporator at the air outlet side of the electronics rack, in accordance with an aspect of the present invention;

FIG. 4 is a cross-sectional elevational view of another embodiment of an electronics rack and a dehumidifying and re-humidifying cooling apparatus, in accordance with an aspect of the present invention;

FIG. 5 is a cross-sectional elevational view of still another embodiment of an electronics rack and a dehumidifying and re-humidifying cooling apparatus, in accordance with an aspect of the present invention;

FIG. 6 is a top plan view of one embodiment of a data center comprising multiple coolant distribution units and a plurality of electronics racks with dehumidifying and re-humidifying cooling apparatuses such as depicted in FIG. 5, in accordance with an aspect of the present invention;

FIG. 7 is a schematic of one embodiment of a coolant distribution unit illustrated in the data center of FIG. 6, in accordance with an aspect of the present invention;

FIG. 8 is an elevational view of one embodiment of a liquid-cooled electronics rack comprising multiple liquid-cooled electronics subsystems to be cooled, in accordance with an aspect of the present invention;

FIG. 9 is a partial schematic of the liquid-cooled electronics rack of FIG. 8, wherein an electronic component (e.g., module) is liquid-cooled by system coolant provided by one or more modular cooling units disposed within the electronics rack, in accordance with an aspect of the present invention;

FIG. 10 is a schematic of one embodiment of a modular cooling unit for the liquid-cooled electronics rack of FIGS. 8 & 9, in accordance with one aspect of the present invention;

FIG. 11 is a cross-sectional elevational view of one embodiment of a liquid-cooled electronics rack such as depicted in FIGS. 8-10, and a dehumidifying and re-humidifying cooling apparatus therefor, in accordance with an aspect of the present invention; and

FIG. 12 is a partial cross-sectional elevational view of an alternate embodiment of a liquid-cooled electronics rack such as depicted in FIGS. 8-10, and a dehumidifying and re-humidifying cooling apparatus therefor, in accordance with an aspect of the present invention.

DETAILED DESCRIPTION

As used herein, the terms “electronics rack”, “rack-mounted electronic equipment”, and “rack unit” are used interchangeably, and unless otherwise specified include any housing, frame, rack, compartment, blade server system, etc., having one or more heat generating components of a computer system or electronics system, and may be, for example, a stand alone computer processor having high, mid or low end processing capability. In one embodiment, an electronics rack may comprise multiple electronics subsystems, each having one or more heat generating components disposed therein requiring cooling. “Electronics subsystem” refers to any sub-housing, blade, book, drawer, node, compartment, etc., having one or more heat generating electronic components disposed therein. Each electronics subsystem of an electronics rack may be movable or fixed relative to the electronics rack, with rack-mounted electronics drawers of a multi-drawer rack unit and blades of a blade center system being two examples of subsystems of an electronics rack to be cooled.
“Electronic component” refers to any heat generating electronic component or module of, for example, a computer system or other electronics unit requiring cooling. By way of example, an electronic component may comprise one or more integrated circuit dies and/or other electronic devices to be cooled, including one or more processor dies, memory dies and memory support dies. As a further example, the electronic component may comprise one or more bare dies or one or more packaged dies disposed on a common carrier.
As used herein, “air-to-liquid heat exchanger” means any heat exchange mechanism characterized as described herein through which liquid coolant can circulate; and includes, one or more discrete air-to-liquid heat exchangers coupled either in series or in parallel. An air-to-liquid heat exchanger may comprise, for example, one or more coolant flow paths, formed of thermally conductive tubing (such as copper or other tubing) in thermal or mechanical contact with a plurality of air-cooled cooling or condensing fins. Size, configuration and construction of the air-to-liquid heat exchanger can vary without departing from the scope of the invention disclosed herein. A “liquid-to-liquid heat exchanger” may comprise, for example, two or more separate coolant flow paths, formed of thermally conductive tubings (such as copper or other tubing) in thermal communication with each other. Size, configuration and construction of the liquid-to-liquid heat exchanger can vary without departing from the scope of the invention disclosed herein.
Unless otherwise specified, the term “cold plate” or “liquid-cooled cold plate” refers to any conventional thermally conductive structure having one or more channels or passageways formed therein for flowing of liquid coolant therethrough. “Refrigerant evaporator” refers to the heat-absorbing mechanism or structure within a refrigeration loop. The refrigerant evaporator is alternatively referred to as a “sub-ambient evaporator” when temperature of the refrigerant passing through the refrigerant evaporator is below the temperature of ambient air entering the electronics rack. Within the refrigerant evaporator, heat is absorbed by evaporating the refrigerant of the refrigerant loop. “Condensate evaporator” refers to any condensate evaporation structure, which in one embodiment, may comprise one or more adjustable heaters for actively controlling an amount of evaporation, and thus an amount of humidification of egressing air. In addition, airflow through the electronics rack described herein comprises, in one example, ambient room air, which may be cooled via one or more computer room air-conditioning units, such as described below in connection with FIG. 1. This airflow through the electronics rack is an open path flow, drawing in room air into the electronics rack and expelling exhaust air from the electronics rack back into the room. Further, “data center” refers to a computer installation containing one or more electronics racks to be cooled. As a specific example, a data center may include one or more rows of rack-mounted computing units, such as server units.
One example of facility coolant disclosed below is water, and examples of coolant employed in the air-to-liquid heat exchanger of the dehumidifying and re-humidifying cooling apparatus disclosed are water or a refrigerant. However, the concepts disclosed herein are readily adapted to use with other types of coolant. For example, one or more of the coolants may comprise a dielectric liquid, a fluorocarbon liquid, a Fluorinert™ liquid, a liquid metal, a brine, or other similar coolant, while still maintaining the advantages and unique features of the present invention. Thus, although the facility coolant is described herein below as water, and the heat exchanger coolant is described below as either water or a refrigerant, these are only examples.
Reference is made below to the drawings, which are not drawn to scale for ease of understanding, wherein the same reference numbers used throughout different figures designate the same or similar components.
FIG. 1 depicts a raised floor layout of an air cooled data center 100 typical in the prior art, wherein multiple electronics racks 110 are disposed in one or more rows. A data center such as depicted in FIG. 1 may house several hundred, or even several thousand microprocessors. In the arrangement illustrated, chilled air enters the computer room via perforated floor tiles 160 from a supply air plenum 145 defined between the raised floor 140 and a base or sub-floor 165 of the room. Cooled air is taken in through louvered or screened doors at air inlet sides 120 of the electronics racks and expelled through the back (i.e., air outlet sides 130) of the electronics racks. Each electronics rack 110 may have one or more air moving devices (e.g., fans or blowers) to provide forced inlet-to-outlet airflow to cool the electronic components within the drawer(s) of the rack. The supply air plenum 145 provides conditioned and cooled air to the air-inlet sides of the electronics racks via perforated floor tiles 160 disposed in a “cold” aisle of the computer installation. The conditioned and cooled air is supplied to plenum 145 by one or more air conditioning units 150, also disposed within the data center 100. Room air is taken into each air conditioning unit 150 near an upper portion thereof. This room air comprises in part exhausted air from the “hot” aisles of the computer installation defined by opposing air outlet sides 130 of the electronics racks 110.
In high performance server systems, it has become desirable to supplement air-cooling of selected high heat flux electronic components, such as the processor modules, within the electronics rack. For example, the System z® server marketed by International Business Machines Corporation, of Armonk, N.Y., employs a vapor-compression refrigeration cooling system to facilitate cooling of the processor modules within the electronics rack. This refrigeration system employs R134 a refrigerant as the coolant, which is supplied to a refrigerant evaporator coupled to one or more processor modules to be cooled. The refrigerant is provided by a modular refrigeration unit (MRU), which supplies the refrigerant at an appropriate temperature.
FIG. 2A depicts one embodiment of a modular refrigeration unit 200, which may be employed within an electronic rack, in accordance with an aspect of the present invention. As illustrated, modular refrigeration unit 200 includes refrigerant supply and exhaust hoses 201 for coupling to a refrigerant evaporator or cold plate (not shown), as well as quick disconnect couplings 202, which respectively connect to corresponding quick disconnect couplings on either side of the refrigerant evaporator, that is coupled to the electronic component(s) or module(s) (e.g., server module(s)) to be cooled. Further details of a modular refrigeration unit such as depicted in FIG. 2A are provided in commonly assigned U.S. Pat. No. 5,970,731.
FIG. 2B is a schematic of one embodiment of modular refrigeration unit 200 of FIG. 2A, coupled to a refrigerant evaporator for cooling, for example, an electronic component within an electronic subsystem of an electronics rack. The electronic component may comprise, for example, a multichip module, a processor module, or any other high heat flux electronic component (not shown) within the electronics rack. As illustrated in FIG. 2B, a refrigerant evaporator 260 is shown that is coupled to the electronic component (not shown) to be cooled and is connected to modular refrigeration unit 200 via respective quick disconnect couplings 202. Within modular refrigeration unit 200, a motor 221 drives a compressor 220, which is connected to a condenser 230 by means of a supply line 222. Likewise, condenser 230 is connected to evaporator 260 by means of a supply line which passes through a filter/dryer 240, which functions to trap particulate matter present in the refrigerant stream and also to remove any water which may have become entrained in the refrigerant flow. Subsequent to filter/dryer 240, refrigerant flow passes through an expansion device 250. Expansion device 250 may be an expansion valve. However, it may also comprise a capillary tube or thermostatic valve. Thus, expanded and cooled refrigerant is supplied to evaporator 260. Subsequent to the refrigerant picking up heat from the electronic component coupled to evaporator 260, the refrigerant is returned via an accumulator 210 which operates to prevent liquid from entering compressor 220. Accumulator 210 is also aided in this function by the inclusion of a smaller capacity accumulator 211, which is included to provide an extra degree of protection against the entry of liquid-phase refrigerant into compressor 220. Subsequent to accumulator 210, vapor-phase refrigerant is returned to compressor 220, where the cycle repeats. In addition, the modular refrigeration unit is provided with a hot gas bypass valve 225 in a bypass line 223 selectively passing hot refrigerant gasses from compressor 220 directly to evaporator 260. The hot gas bypass valve is controllable in response to the temperature of evaporator 260, which is provided by a module temperature sensor (not shown), such as a thermistor device affixed to the evaporator/cold plate in any convenient location. In one embodiment, the hot gas bypass valve is electronically controlled to shunt hot gass directly to the evaporator when temperature is already sufficiently low. In particular, under low temperature conditions, motor 221 runs at a lower speed in response to the reduced thermal load. At these lower speeds and loads, there is a risk of motor 221 stalling. Upon detection of such a condition, the hot gas bypass valve is opened in response to a signal supplied to it from a controller of the modular refrigeration unit.
In certain implementations, customer data centers may have ambient air humidity levels that are in violation of standard specifications for IT equipment, yielding room dew point temperature values that are sufficiently high to risk water condensation on surfaces within the electronics rack (such as refrigeration-cooled surfaces within the electronics rack) that are cooler than the dew point. In such cases, while coolant-carrying tubes transporting refrigerant (which may be at a sub-ambient temperature) may be insulated, one or more surfaces of the refrigerant evaporator (or the electronic component being cooled thereby) may possess surface temperatures that are below the dew point of the humid air passing through the server rack. If this condition persists for a sufficient length of time, there is a possibility of moisture from the air stream passing through the electronics rack condensing on the (sub-ambient) cooled surfaces, leading to the collection of water inside of the rack. This collected water could then fall on exposed electronic components due to gravity, or may be carried along due to the momentum of the airflow near the water collection surface(s). If the condensed water makes contact with exposed electronic devices, it could result in corrosion of electronic components, as well as in the short circuiting of electrical conductors.
Thus, disclosed herein is a dehumidifying and re-humidifying cooling apparatus comprising a heat exchanger assembly for, for example, a front door of an electronics rack hingedly mounted to an air inlet side of the rack, wherein ambient room air passes through the electronics rack from an air inlet side to an air outlet side thereof. The heat exchange assembly includes an air-to-liquid heat exchanger positioned for ingressing air to pass thereacross before passing through the rack, and the heat exchanger is in fluid communication with a coolant loop for passing coolant therethrough. The air-to-liquid heat exchanger with the coolant passing therethrough dehumidifies ingressing air to the rack to lower a dew point temperature of the air flowing through the rack. A condensate collector is disposed at the air inlet side of the rack, below the air-to-liquid heat exchanger, for collecting liquid condensate from the air-to-liquid heat exchanger's dehumidifying of ingressing air to the rack. Further, a condensate evaporator is disposed at the air outlet side of the rack which humidifies air egressing from the electronics rack. The condensate evaporator is coupled in fluid communication with the condensate collector at the air inlet side of the rack, and evaporates liquid condensate received from the condensate collector. By dehumidifying the air entering the electronics rack, the dehumidifying and re-humidifying cooling apparatus disclosed herein mitigates the risk of water condensate forming in the proximity of exposed electronic components by, for example, cooling one or more electronic components within the rack to a temperature below the dew point temperature of the ambient air of the data center. The dehumidifying and re-humidifying cooling apparatus disclosed herein may also be used with water-cooled electronics racks, which when exposed to data center environments with sufficiently high dew point temperatures, can run the risk of water condensation as well. By way of example, reference in this regard commonly assigned U.S. Pat. No. 7,450,385, which describes in detail an embodiment of a liquid-based cooling apparatus for an electronics rack, wherein the liquid may comprise water. Such a liquid-based cooling apparatus may contain several metallic water-carrying structures (tubes, cold plates, etc.) within the electronic subsystems, which potentially could be sites for water condensation should (for example) the humidity levels of ambient air being drawn through the electronics rack be in violation of predefined specifications for the rack.
FIGS. 3A & 3B depict one embodiment of an electronics rack 300 comprising an air inlet side 301 and an air outlet side 302, which respectively enable open flow ingress 305 and egress 306 of ambient room air through the electronics rack to facilitate cooling of electronic components within the rack. Electronics rack 300 includes a perforated front door 303 coupled to the air inlet side 301 of the electronics rack, and a perforated rear door 304 coupled to the air outlet side 302 of electronics rack 300. In one implementation, cool, humid ambient air 305 ingresses through perforated front door 303, and heated, humid exhaust air 306 egresses through perforated rear door 304.
FIG. 3B is a cross-sectional elevational view of electronics rack 300 of FIG. 3A, taken along line 3B-3B. By way of example, electronics rack 300 may comprise a System z® electronics rack offered by International Business Machines Corporation, of Armonk, N.Y. Electronics rack 300 is shown to include one or more electronic subsystems 310, including processor modules to be cooled by sub-ambient evaporators 311. A modular refrigeration unit 200 is also provided, as well as power supplies 312 and miscellaneous components 313, such as input/output communication components 313. Perforated front door 303 is shown coupled to air inlet side 301 of electronics rack 300, and perforated rear door 304 is coupled to air outlet side 302 of electronics rack 300, wherein cool, humid ambient air 305 ingresses through perforated front door 303, passing across the electronic components within the electronics rack, and egresses as hot exhaust air 306. As illustrated, modular refrigeration unit 200 is in fluid communication with the sub-ambient or refrigerant evaporators coupled to the processor modules to be cooled 311, via a refrigerant loop 315.
In this example, it is assumed that the ambient air entering the electronics rack is humid, and is to be dehumidified, to facilitate the sub-ambient cooling of the high heat flux electronic components coupled to the evaporators. The dehumidifying and re-humidifying cooling apparatus disclosed herein includes, in part, an air-to-liquid heat exchanger 320 disposed at air inlet side 301 of electronics rack 300, for example, within perforated front door 303, as well as a condensate collector 330 disposed to collect liquid condensate from the air-to-liquid heat exchanger's dehumidifying of the ingressing ambient air, and a condensate evaporator 335 disposed at air outlet side 302 of electronics rack 300, for example, in perforated rear door 304, for humidifying exhaust air egressing from the electronics rack. Condensate evaporator 335 is shown coupled in fluid communication with condensate collector 330 via a line 331 configured to feed (e.g., via gravity) liquid condensate from condensate collector 330 to condensate evaporator 335. Liquid condensate delivered to condensate evaporator 335 may be heated, for example, via one or more adjustable water heaters 336 to evaporate the liquid condensate 337 into the exhaust air egressing from the air outlet side 302 of electronics rack 300.
In this embodiment, air-to-liquid heat exchanger 320 may comprise an air-to-water heat exchanger, wherein water is fed through the heat exchanger via a coolant loop 325. The water within coolant loop 325 is cooled via a liquid-to-liquid heat exchanger 326 in fluid communication with both refrigerant loop 315 and coolant loop 325. That is, refrigerant exiting modular refrigeration unit 200 passes through liquid-to-liquid heat exchanger 326 and cools the coolant within coolant loop 325 before passing through the sub-ambient evaporators 311. Coolant (e.g., water) is pumped 327 through coolant loop 325, including through air-to-liquid heat exchanger 320.
To facilitate operation of the dehumidifying and re-humidifying cooling apparatus disclosed herein, a controller 340 is provided coupled via data cables 345 to a plurality of rack inlet temperature and relative humidity sensors 341, as well as to a plurality of server inlet temperature and relative humidity sensors 342, and coolant temperature sensors 344 disposed in the coolant supply line and coolant return line of coolant loop 325 coupled to air-to-liquid heat exchanger 320. In addition, controller 340 is coupled, in one embodiment, to pump 327 for automatically controlling the ON/OFF state of pump 327, as well as the speed of the pump, and to heater(s) 336 disposed within condensate evaporator 335 for automatically controlling the rate of evaporation of liquid condensate from the condensate evaporator.
FIG. 3C illustrates one example of processing implemented by controller 340 for controlling dehumidifying of the ingressing ambient air passing across the air-to-liquid heat exchanger 320 of the dehumidifying and re-humidifying cooling apparatus of FIGS. 3A & 3B. In this example, coolant flowing through the air-to-liquid heat exchanger is assumed to be water, and liquid-to-liquid heat exchanger 326 (FIG. 3B) is a water-to-refrigerant heat exchanger. Control of the water flow rate through coolant loop 325 (FIG. 3B) can result in a higher or lower water temperature exiting the water-to-refrigerant heat exchanger and entering the air-to-liquid heat exchanger. A higher water flow rate resulting from a higher pump motor speed yields a lower water temperature exiting the liquid-to-liquid heat exchanger, and vice versa. Alternatively, a bypass valve (not shown) could be used in automatically controlling the coolant temperature entering the air-to-liquid heat exchanger, whether the coolant is water, a refrigerant, or other coolant. There can still be other approaches to controlling the coolant temperature entering the air-to-liquid heat exchanger. For example, the flow rate and temperature of refrigerant coolant on the cold side of the liquid-to-liquid heat exchanger could be manipulated.
In the process of FIG. 3C, the coolant temperature control is based on an extent of dehumidification deemed necessary based on a sensed dew point temperature of the ambient air entering the electronics rack (e.g., the servers within the rack), that is, the sensed dew point temperature of dehumidified air exiting the air-to-liquid heat exchanger (T_dp,a) as well as a coolest measured surface temperature (T_s1, T_s2. . . T_sN) of various cool surfaces monitored within the rack that will contact air passing through the electronics rack. The location of the cool surface temperature sensors can be determined a priori, based on lab testing of the particular electronics rack implementation. The cool surface temperatures could be sensed at various parts of the rack's interior; for example, on the tubing or the hoses that distribute sub-ambient coolant, or on the cold plates or evaporators that cool the processor modules. The coolest surface is denoted as T_{s, min}in FIG. 3C. Note that, in this discussion, dehumidifying of ambient air passing across the air-to-liquid heat exchanger may depend on the sensed dew point temperature of the ambient air passing across the air-to-liquid heat exchanger. For example, if the dew point is sufficiently low, e.g., the humidity of the ambient air is within specification for the electronics rack, then no dehumidification may be needed. Thus, the dehumidifying and humidifying cooling apparatus disclosed herein may be selectively activated and deactivated by the controller as needed, dependent on ambient air conditions.
Referring to the flowchart of FIG. 3C, the controller 340 (FIG. 3B) determines the dew point of the air leaving the dehumidifying air-to-liquid heat exchanger 320 (FIG. 3B) and entering the air inlet side of the electronics rack 350, as well as determines the monitored surface temperatures inside the electronics rack (T_s1. . . T_sN) of surfaces in contact with air and sub-ambient coolant circulating inside the electronics rack 352. The controller then determines the coolest surface temperature T _{s, min} 354. After these temperatures (T_dp,aand T_{s, min}) are sensed or determined, the difference in temperature between the coolest surface temperature T_{s, min}and the dew point temperature T_dp,a, is determined and the controller compares this difference with a first predetermined threshold value X° C. 356. If the difference is lower than the first predefined threshold X° C., then it means that the dew point of the air entering the server is close to a value when condensation might begin to occur. In such a case, the pump flow rate is increased (or if the pump is OFF, the pump is switched ON) 358 so as to increase (or start) dehumidifying of the air passing across the dehumidifying air-to-liquid heat exchanger, thus yielding a lower value for T_dp,a. In the case where the difference between T_{s, min}and T_dp,ais very large, that is greater than a second threshold value Y° C. (where X<Y) 362, then the air is deemed to be unnecessarily dry, and the pump flow rate can be ramped down (or the pump switched OFF) 364 to reduce the extent of dehumidification, thus yielding a higher T_dp,a. After waiting a defined time interval t 360, the processing determines a new dew point temperature for the air leaving the dehumidifying air-to-liquid heat exchanger (T_dp,a) and new surface temperatures inside the electronics rack (T_s1. . . T_sN) to identify a new coolest surface temperature T_{s, min}.
The preceding processing describes a method for controlling dehumidifying based on sensed air dew point temperature and sensed cool surface temperatures within the electronics rack. Alternative to this approach, the temperature of the cool surfaces could be reduced by a reduction in coolant temperature being applied within the electronics rack such that no condensation would occur within the rack, while still providing for greater cooling capability through the reduction of coolant temperature. In such a case, the dehumidifying air-to-liquid heat exchanger can be operated for maximum dehumidification in conjunction with a provision for coolest possible coolant being circulated through the liquid-cooled cold plates or evaporators within the electronics rack coupled to the one or more electronic components to be cooled. In cases (described below) where the coolant flowing through the dehumidifying air-to-liquid heat exchanger is in series flow with the coolant flowing through the liquid-cooled cold plates or evaporators, there is an intrinsic overall system attribute which would reduce the likelihood of condensation within the electronics rack. This is because any likely condensation that may occur based on coolant temperature and ambient dew point temperature would likely occur at the dehumidifying air-to-liquid heat exchanger, and not inside the electronics rack.
FIG. 3D depicts one implementation of a control process, which may also be implemented by controller 340 (FIG. 3B), for controlling operation of one or more heaters associated with the condensate evaporator for controlling a rate of liquid condensate evaporation into the exhaust air exiting the air outlet side of the electronics rack. The process starts 370 with the controller determining whether the water level within the condensate evaporator 335 (FIG. 3B) is too high 372. If “no”, then the heater is turned OFF (or the heater is left OFF) 374, after which the controller waits a time interval t 376 before repeating the process. If the water level within the evaporator is determined to be too high, that is, is above a defined water level threshold, then the controller turns the heater ON, or if the heater is adjustable, increases the amount of heat being applied to the condensate evaporator to increase the rate of evaporation 378, after which the controller waits time interval t 376 before repeating the process.
In operation, the surfaces of air-to-liquid heat exchanger 320 (FIG. 3B) function as surfaces for condensation of excess moisture present in humid ingressing ambient air. Air-to-liquid heat exchanger 320 is configured and mounted so that ingressing ambient air into the electronics rack necessarily passes across the air-to-liquid heat exchanger before passing through the electronics rack. In this manner, the exposed surfaces of the air-to-liquid heat exchanger condense water from the humid ingressing ambient air, and the condensed water drains from the surfaces of the heat exchanger to the bottom of the heat exchanger into condensate collector 330. This condensate is then extracted from condensate collector using, in one embodiment, a gravity drain line which transports the liquid condensate to the condensate evaporator located at the air outlet side of the electronics rack. At the evaporator, the liquid condensate is evaporated so that the humid ambient air entering the rack is dehumidified at the air inlet side of the rack, and then the dehumidified exhaust air exiting the electronics rack is re-humidified using the liquid condensate collected at the air inlet side thereof. The heat absorbed by the coolant (e.g., water) from the ingressing ambient air stream is both latent and sensible heat transfer, and (in the embodiment of FIG. 3B) this heat is rejected to the refrigerant flowing through the modular refrigeration unit via the liquid-to-liquid heat exchanger.
In the dehumidifying and re-humidifying cooling apparatus of FIG. 3B, quick disconnect couplings (not shown) can be employed in conjunction with hoses and barb fittings to plumb the air-to-liquid heat exchanger to the pump and liquid-to-liquid heat exchanger in a manner which facilitates easy assembly and disassembly, while still allowing the perforated front door to be opened and closed while the air-to-liquid heat exchanger is operational. The temperature and humidity sensors placed on both sides of the air-to-liquid heat exchanger provide real-time data to determine whether dehumidification is required, and if so, the temperature at which the chilled coolant should be provided, for example, by manipulating the pump speed. If dehumidification is not required, then the coolant loop's pump could be shut off. Similarly, heaters within the condensate evaporator could be powered to varying levels, depending on the water evaporation rate desired under the prevalent ambient conditions. For example, the condensate evaporator can be powered so that there is a constant condensate liquid in the evaporator so that whatever water is being condensed is also being subsequently evaporated. All surfaces exposed to the water condensate can be chemically treated to inhibit growth of biological or chemical matter.
FIG. 4 depicts an alternate embodiment of a dehumidifying and re-humidifying cooling apparatus, in accordance with an aspect of the present invention. This dehumidifying and re-humidifying cooling apparatus is identical to that described above in connection with FIG. 3B, with the exception that a coolant loop 400 is shown in fluid communication with the refrigerant loop 315 coupling modular refrigeration unit 200 to the sub-ambient evaporators coupled to the processor modules being liquid-cooled 311. Thus, in this embodiment, a portion of the chilled refrigerant from modular refrigeration unit 200 is routed directly through the air-to-liquid heat exchanger 320, and there is no external pump from the modular refrigeration unit required (or liquid-to-liquid heat exchanger required), with the modular refrigeration unit compressor and modular refrigeration unit heat exchanger being sized appropriately to allow for flow of refrigerant through the air-to-liquid heat exchanger 320. The remaining components of the dehumidifying and re-humidifying cooling apparatus depicted in FIG. 4 are similar to the corresponding labeled components described above in connection with FIG. 3B. In this implementation, liquid temperature sensors 344 are sensing temperature of the refrigerant flowing through coolant loop 400, rather than, for example, water, as in the case of the embodiment of FIG. 3B.
FIGS. 5-7 depict an alternate implementation of a dehumidifying and re-humidifying cooling apparatus for an electronics rack 300′, in accordance with an aspect of the present invention. Unless otherwise started, this dehumidifying and re-humidifying cooling apparatus is identical to that described in connection with FIG. 3B. Referring first to FIG. 5, one or more coolant distribution units within the data center are employed to provide chilled coolant via a coolant loop 500 (comprising a coolant supply line 501 and a coolant return line 502) coupling a respective coolant distribution unit and air-to-liquid heat exchanger 320 in fluid communication. Further, by way of example, modular refrigeration unit (MRU) 200 is depicted within electronics rack 300 coupled via a refrigerant loop 315 to sub-ambient evaporators coupled to one or more processor modules to be cooled 311. Alternatively, water-based cooling could be employed with the electronics rack in combination with the dehumidifying and re-humidifying cooling apparatus depicted in FIGS. 5-7.
FIGS. 6 & 7 depict embodiments of a data center and coolant distribution unit, respectively, which may be employed with a dehumidifying and re-humidifying cooling apparatus such as depicted in FIG. 5.
FIG. 6 depicts one embodiment of a data center, generally denoted 600, employing cooled electronics systems, in accordance with an aspect of the present invention. Data center 600 includes a plurality of rows of electronics racks 300′, each of which includes a perforated front door 303 and perforated rear door 304, such as described above in connection with the embodiment of FIGS. 3A & 3B. Each perforated front door 303 supports an air-to-liquid heat exchanger of a dehumidifying and re-humidifying cooling apparatus such as described above in connection with FIG. 5. Each perforated rear door 304 includes a condensate evaporator for re-humidifying the exhaust air egressing from the electronics rack. Multiple coolant distribution units 610, referred to hereinbelow as pumping units, are disposed within the data center (along with one or more air-conditioning units (not shown)). In this embodiment, each pumping unit forms a coolant distribution subsystem with one row of a plurality of electronics racks. Each pumping unit includes a liquid-to-liquid heat exchanger where heat is transferred from a coolant loop to a facility coolant loop. Chilled facility coolant, such as water, is received via a facility coolant supply line 611, and is returned via a facility coolant return line 612. Coolant, such as water, is provided via a coolant supply loop 500 (comprising the illustrated coolant supply and return lines). In one embodiment, coolant supply and return lines of the coolant loop are hard-plumbed within the data center, and preconfigured to align under and include branch lines extending towards the electronics racks of the respective row of electronics racks.
FIG. 7 depicts one embodiment of a coolant distribution unit 610 for the data center 600 of FIG. 6. Liquid-to-liquid heat exchanger 710 cools coolant passing through the coolant loop comprising coolant supply line 501 and coolant return line 502. (In one embodiment, the coolant has undergone heating within the respective air-to-liquid heat exchangers disposed within the perforated front doors of the electronics racks.) The facility coolant loop of liquid-to-liquid heat exchanger 710 comprises facility coolant supply line 611 and facility coolant return line 612, which in one embodiment, provide chilled facility water to the liquid-to-liquid heat exchanger. A control valve 701 may be employed in facility coolant supply line 611 to control facility coolant flow rate through the liquid-to-liquid heat exchanger 710. After the coolant is cooled within liquid-to-liquid heat exchanger 710, the coolant is collected in a reservoir 720 for pumping via a redundant pump assembly 730 back to the respective row of electronics racks via coolant supply line 501. As shown in FIG. 7, a bypass line 740 with a bypass valve 741 may be employed to control the amount of coolant fed back through the coolant supply line, and hence, control temperature of coolant delivered to the respective dehumidifying air-to-liquid heat exchangers mounted to the doors of the electronics racks.
FIGS. 8-10 depict one embodiment of a liquid-cooled electronics rack comprising multiple liquid-cooled electronic subsystems. The dehumidifying and re-humidifying cooling apparatus disclosed herein may also be employed in connection with such a liquid-cooled electronics rack. Embodiments of the resultant cooled electronic system are depicted in FIGS. 11 & 12, which are described below.
FIG. 8 depicts one embodiment of a liquid-cooled electronics rack 800. As illustrated, liquid-cooled electronics rack 800 comprises a plurality of electronics subsystems 810, which may be processor or server nodes. A bulk power regulator 820 is shown disposed at an upper portion of liquid-cooled electronics rack 800, and two modular cooling units (MCUs) 830 are disposed in a lower portion of the liquid-cooled electronics rack. In the embodiments described herein, the coolant is assumed to be water or an aqueous-based solution (by way of example only).
In addition to MCUs 830, the cooling system includes a system water supply manifold 831, a system water return manifold 832, and manifold-to-node fluid connect hoses 833 coupling system water supply manifold 831 to electronics subsystems 810, and node-to-manifold fluid connect hoses 834 coupling the individual electronics subsystems 810 to system water return manifold 832. Each MCU 830 is in fluid communication with system water supply manifold 831 via a respective system water supply hose 835, and each MCU 830 is in fluid communication with system water return manifold 832 via a respective system water return hose 836.
As illustrated, the heat load of the electronics subsystems is transferred from the system water to cooler facility water supplied by facility water supply line 840 and facility water return line 841 disposed, in the illustrated embodiment, in the space between a raised floor 891 and a base floor 892.
FIG. 9 schematically illustrates operation of the cooling system of FIG. 8, wherein a liquid-cooled cold plate 900 is shown coupled to an electronics module 901 of an electronics subsystem 810 within the liquid-cooled electronics rack 800. Heat is removed from electronics module 901 via the system coolant circulated via pump 920 through cold plate 900 within the system coolant loop defined by liquid-to-liquid heat exchanger 921 of modular cooling unit 830, lines 831/833, 834/832 and cold plate 900. The system coolant loop and modular cooling unit are designed to provide coolant of a controlled temperature and pressure, as well as controlled chemistry and cleanliness, to facilitate cooling of the electronics module(s). Furthermore, the system coolant is physically separate from the less controlled facility coolant in lines 840, 841, to which heat is ultimately transferred.
FIG. 10 depicts a more detailed embodiment of a modular cooling unit 830. As shown in FIG. 10, modular cooling unit 830 includes a first cooling loop wherein building chilled, facility coolant is supplied 1010 and passes through a control valve 1020 driven by a motor 1025. Valve 1020 determines an amount of facility coolant to be passed through liquid-to-liquid heat exchanger 921, with a portion of the facility coolant possibly being returned directly via a bypass orifice 1035. The modular cooling unit further includes a second cooling loop with a reservoir tank 1040 from which system coolant is pumped, either by pump 1050 or pump 1051, into the liquid-to-liquid heat exchanger 921 for conditioning and output thereof, as cooled system coolant to the subsystems of the electronics rack to be cooled. The cooled system coolant flows to and from the system water supply manifold and system water return manifold, respectively, of the liquid-cooled electronics rack via the system water supply hose 835 and system water return hose 836.
As noted, FIGS. 11 & 12 depict one embodiment of a liquid-cooled electronics rack, such as described above in connection with FIGS. 8-10, in combination with a dehumidifying and re-humidifying cooling apparatus, such as disclosed herein.
In FIG. 11, a liquid-cooled electronics rack 800′ is illustrated comprising a plurality of electronic subsystems 810, which may be processor or server nodes. Ambient air 805 ingresses via an air inlet side 801 of electronics rack 800′ through a perforated front door 803, and exhaust air 806 exiting from an air outlet side 802 of electronics rack 800′ egresses via a perforated rear door 804. Electronic subsystems 810 are liquid-cooled via one or more modular cooling units 830 which provide a first cooled system coolant thereto via coolant supply and return lines 835, 836 coupling modular cooling unit 830 to coolant inlet and return manifolds 831, 832, respectively. Respective manifold-to-node fluid connect hoses couple the coolant inlet and return manifolds to the respective electronic subsystems 810. A facility coolant loop 1150 provides facility coolant to the liquid-to-liquid heat exchanger within modular cooling unit 830.
In this implementation, the dehumidifying and re-humidifying cooling apparatus includes a dehumidifying air-to-liquid heat exchanger 1100 cooled via a second system coolant flowing through a system coolant loop 1125. This second system coolant within system coolant loop 1125 is cooled via an auxiliary liquid-to-liquid heat exchanger 1160, through which, in this example, the chilled facility coolant passes before being supplied to modular cooling unit 830. An auxiliary pump 1161 pumps coolant through system coolant loop 1125 to cool the surfaces of the dehumidifying air-to-liquid heat exchanger to a sub-ambient temperature to facilitate formation of condensate thereon. A condensate collector 1130 disposed, for example, below dehumidifying air-to-liquid heat exchanger 1100, collects liquid condensate resulting from dehumidifying the ingressing ambient air by the air-to-liquid heat exchanger. This liquid condensate is fed via a gravity feed line 331 to a condensate evaporator 335, which includes one or more adjustable heaters 336 for controlling the rate of condensate evaporation 337, and thus, the degree of re-humidifying applied to egressing exhaust air from electronics rack 800′ to produce re-humidified exhaust air 806.
The dehumidifying and re-humidifying cooling apparatus further includes a controller 1140, which is coupled via data cables 1145 to rack inlet temperature and relative humidity sensors 1141 and server inlet temperature and relative humidity sensors 1142, as well as to temperature sensors 1144 sensing the temperature of system coolant being delivered to dehumidifying air-to-liquid heat exchanger 1100, and exhausting from the air-to-liquid heat exchanger via system coolant loop 1125.
In operation, humid ambient air enters through perforated front door 803, where excess moisture is condensed upon contacting the surfaces of the dehumidifying air-to-liquid heat exchanger. Heat gained is within the system coolant loop at the dehumidifying air-to-liquid heat exchanger via latent and sensible heat transfer mechanisms, and is subsequently rejected via sensible heat transfer in the auxiliary liquid-to-liquid heat exchanger 1160. Water condensate collected at the condensate collector within the perforated front door is transferred to the condensate evaporator at the rear door for re-humidifying of the egressing exhaust air passing through the perforated rear door 804. The temperature and relative humidity sensors on either side of the air-to-liquid heat exchanger collect ambient air data at the inlet of the perforated front door and the inlet to the servers, to ensure that an appropriate amount of chilled coolant is being provided to the dehumidifying air-to-liquid heat exchanger to facilitate removal of a specific amount of moisture from the air stream. As in the embodiments of the refrigerant-cooled modules depicted in FIGS. 3A-5, the dehumidifying and re-humidifying cooling apparatus of FIG. 11 is operated to ensure that ambient air entering the electronic subsystems (e.g., servers) is appropriately dehumidified to avoid undesirable condensation of water in close proximity to electronic components.
FIG. 12 depicts an alternate embodiment of a dehumidifying and re-humidifying cooling apparatus for a liquid-cooled electronics rack such as depicted in FIGS. 8-10. In this embodiment, modular cooling unit 830 supplies chilled system coolant via a chilled coolant supply line 1171 to dehumidifying air-to-liquid heat exchanger 1100. A system coolant return line 1172 from dehumidifying air-to-liquid heat exchanger 1100 couples the air-to-liquid heat exchanger to the system water supply manifold 831 for delivery thereof via the node-to-manifold fluid connect hoses to the electronic subsystems 810 of liquid-cooled electronics rack 800″. Exhaust system coolant from the electronic subsystems is returned via system water return manifold 832 in fluid communication with modular cooling unit 830 via a return line 1173. As in the other embodiments of the dehumidifying and re-humidifying cooling apparatus, ambient air passes through perforated front door 803 across dehumidifying air-to-liquid heat exchanger 1100, and through air inlet side 801 of liquid-cooled electronics rack 800, for facilitating cooling of electronic components within the rack, and is then expelled through air outlet side 802 of electronics rack 800″ via a perforated rear door 804. Liquid condensate is collected in a condensate collector 803, for example, disposed at the bottom of dehumidifying air-to-liquid heat exchanger 1100, and is subsequently gravity-fed 1131 to a condensate evaporator 1135, which includes one or more water heaters 1136 for controlling the rate of evaporation 1137 of the liquid condensate at the perforated rear door 804 for re-humidifying the egressing exhaust air from the electronics rack before passing into the data center. A facility coolant loop 1150 supplies facility coolant to each MCU 830 to facilitate cooling of the system coolant flowing through the dehumidifying air-to-liquid heat exchanger and liquid-cooled electronic subsystems.
Note that in the dehumidifying and re-humidifying cooling apparatus embodiment of FIG. 12, there is no dedicated liquid-to-liquid heat exchanger or pump external to the modular cooling unit to provide the below dew point chilled coolant (e.g., water) to the dehumidifying air-to-liquid heat exchanger. In the embodiment illustrated, the modular cooling unit itself is used to chill the system coolant temperature to below a dew point temperature of the ambient air entering the electronics rack, and this chilled coolant is first passed through the dehumidifying air-to-liquid heat exchanger, and subsequently through the liquid-cooled electronic subsystems in series fluid communication with the dehumidifying air-to-liquid heat exchanger. In the embodiments of FIGS. 11 & 12, the liquid-cooled electronic subsystems can be cooled with water significantly below the data center's ambient air dew point, leading to a greater heat transfer capability of the modular cooling unit under relatively humid conditions, e.g., humidity conditions which might be out-of-specification for the electronics rack.
As will be appreciated by one skilled in the art, aspects of the controller described above may be embodied as a system, method or computer program product. Accordingly, aspects of the controller may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit”, “module” or “system”. Furthermore, aspects of the controller may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer-readable signal medium may include a propagated data signal with computer-readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer-readable signal medium may be any computer-readable medium that is not a computer-readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus or device.
Program code embodied on a computer readable medium may be transmitted using an appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language, such as Java, Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages.
Aspects of the present invention are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
Although embodiments have been depicted and described in detail herein, it will be apparent to those skilled in the relevant art that various modifications, additions, substitutions and the like can be made without departing from the spirit of the invention and these are therefore considered to be within the scope of the invention as defined in the following claims.

Claims

1. An apparatus for facilitating cooling of an electronics rack, the apparatus comprising:

a heat exchange assembly configured to reside at an air inlet side of the electronics rack, wherein the electronics rack comprises the air inlet side and an air outlet side, the air inlet side and the air outlet side respectively enabling ingress and egress of air through the electronics rack, and wherein the heat exchange assembly comprises an air-to-liquid heat exchanger positioned for ingressing air to pass thereacross before passing through the electronics rack, the air-to-liquid heat exchanger being in fluid communication with a coolant loop for passing coolant therethrough, and the air-to-liquid heat exchanger with coolant passing therethrough dehumidifying ingressing air to the electronics rack to lower a dew point temperature of air flowing through the electronics rack;

a condensate collector disposed at the air inlet side of the electronics rack for collecting liquid condensate from the air-to-liquid heat exchanger's dehumidifying of ingressing air to the electronics rack; and

a condensate evaporator disposed at the air outlet side of the electronics rack and humidifying air egressing from the electronics rack, the condensate evaporator being coupled in fluid communication with the condensate collector at the air inlet side of the electronics rack and evaporating liquid condensate received therefrom.

2. The apparatus of claim 1, further comprising a gravity-feed line coupling the condensate collector and the condensate evaporator in fluid communication, and transferring liquid condensate from the condensate collector at the air inlet side of the electronics rack to the condensate evaporator at the air outlet side of the electronics rack.

3. The apparatus of claim 1, further comprising a modular refrigeration unit disposed within the electronics rack and at least one refrigerant evaporator coupled in fluid communication therewith via a refrigerant loop for passing refrigerant through the at least one refrigerant evaporator for cooling at least one electronic component within the electronics rack coupled thereto, the at least one refrigerant evaporator, the at least one electronic component coupled thereto, or the refrigerant loop comprising a surface cooled to a temperature below a dew point temperature of the ingressing air prior to dehumidifying thereof by the air-to-liquid heat exchanger.

4. The apparatus of claim 3, further comprising a liquid-to-liquid heat exchanger coupled to the coolant loop and to the refrigerant loop for facilitating cooling of coolant flowing through the coolant loop via refrigerant flowing through the refrigerant loop, and a pump in fluid communication with the coolant loop for pumping coolant through the air-to-liquid heat exchanger.

5. The apparatus of claim 4, further comprising a controller coupled to the pump, the controller controlling coolant flow rate through the coolant loop as a function of a determined dew point temperature of air exiting the air-to-liquid heat exchanger and a determined coolest surface temperature of at least one surface of, or coupled to, the at least one refrigerant evaporator, the at least one electronic component coupled thereto, or the refrigerant loop, and the controller at least one of determines whether a difference in temperature between the determined coolest surface temperature and the determined dew point temperature of air exiting the air-to-liquid heat exchanger is less than a first predetermined threshold, and if so, the controller automatically increases pump speed to increase the flow of system coolant through the air-to-liquid heat exchanger, or determines whether the difference between the coolest surface temperature and the determined dew point temperature of air exiting the air-to-liquid heat exchanger is greater than a second predefined threshold, and if so, the controller automatically reduces pump speed to reduce the flow of coolant through the air-to-liquid heat exchanger.

6. The apparatus of claim 3, wherein the coolant loop is coupled in fluid communication with the refrigerant loop and the coolant flowing through the air-to-liquid heat exchanger is the refrigerant.

7. The apparatus of claim 3, wherein the coolant loop is coupled to a coolant distribution unit external to the electronics rack, the coolant loop providing cooled coolant to the air-to-liquid heat exchanger and expelling heat from the air-to-liquid heat exchanger to a facility coolant loop passing through the coolant distribution unit, and wherein the apparatus further comprises a controller for controlling an amount of dehumidifying of ingressing air to the electronics rack to control the dew point temperature of the air flowing through the electronics rack.

8. The apparatus of claim 1, further comprising a modular cooling unit disposed within the electronics rack for liquid cooling at least one electronic component of the electronics rack, the modular cooling unit being cooled via facility coolant passing through a facility coolant loop coupled thereto, wherein the facility coolant loop receives facility coolant from a source and passes at least a portion thereof through the modular cooling unit, and wherein the apparatus further comprises an auxiliary liquid-to-liquid heat exchanger disposed within the electronics rack and coupled to the coolant loop and to the facility coolant loop for cooling coolant flowing through the coolant loop via facility coolant flowing through the facility coolant loop, the coolant loop further comprising a pump for adjustably pumping coolant through the coolant loop.

9. The apparatus of claim 1, further comprising a modular cooling unit associated with the electronics rack for facilitating liquid cooling of at least one electronic component of the electronics rack, the modular cooling unit receiving facility coolant from a source via a facility coolant loop and expelling heat in a liquid-to-liquid heat exchanger from the at least one electronic component to the facility coolant in the facility coolant loop, wherein the coolant loop is coupled to the liquid-to-liquid heat exchanger for cooling coolant passing therethrough, the coolant loop coupling in series fluid communication the liquid-to-liquid heat exchanger, the air-to-liquid heat exchanger and at least one cold plate coupled to the at least one electronic component to be cooled by the modular cooling unit.

10. A cooled electronic system comprising:

an electronics rack, the electronics rack comprising:

an air inlet side and an air outlet side, the air inlet and air outlet sides respectively enabling ingress and egress of air;

at least one electronic component requiring cooling;

at least one air-moving device, the at least one air-moving device causing air to flow from the air inlet side of the electronics rack through the electronics rack, to the air outlet side thereof; and

a dehumidifying and re-humidifying cooling apparatus for the electronics rack, the dehumidifying and re-humidifying cooling apparatus comprising:

a heat exchange assembly residing at the air inlet side of the electronics rack, the heat exchange assembly comprising an air-to-liquid heat exchanger positioned for ingressing air to pass thereacross before passing through the electronics rack, the air-to-liquid heat exchanger being in fluid communication with a coolant loop for passing coolant therethrough, and wherein the air-to-liquid heat exchanger with coolant passing therethrough dehumidifies ingressing air to the electronics rack to lower a dew point temperature of air flowing through the electronics rack;

a condensate collector disposed at the air inlet side of the electronics rack and collecting liquid condensate from the air-to-liquid heat exchanger's dehumidifying of ingressing air to the electronics rack; and

11. The cooled electronic system of claim 10, wherein the dehumidifying and re-humidifying cooling apparatus further comprises a gravity-feed line coupling the condensate collector and the condensate evaporator in fluid communication, and transferring liquid condensate from the condensate collector at the air inlet side of the electronics rack to the condensate evaporator at the air outlet side of the electronics rack.

12. The cooled electronic system of claim 10, wherein the dehumidifying and re-humidifying cooling apparatus further comprises an adjustable heater associated with the condensate evaporator for controlling evaporating of liquid condensate received from the condensate collector.

13. The cooled electronic system of claim 10, further comprising a modular refrigeration unit disposed within the electronics rack and at least one refrigerant evaporator coupled in fluid communication therewith via a refrigerant loop for passing refrigerant through the at least one refrigerant evaporator for cooling at least one electronic component within the electronics rack coupled thereto, the refrigerant evaporator, the at least one electronic component coupled thereto or the refrigerant loop comprising a surface cooled to a temperature below a dew point temperature of the ingressing air prior to dehumidifying thereof by the air-to-liquid heat exchanger, wherein the dehumidifying avoids formation of condensation on the surface cooled below dew point of the ingressing air prior to dehumidifying thereof.

14. The cooled electronic system of claim 13, further comprising a liquid-to-liquid heat exchanger coupled to the coolant loop and to the refrigerant loop for facilitating cooling of system coolant flowing through the coolant loop via refrigerant flowing through the refrigerant loop, and a pump in fluid communication with the coolant loop for pumping system coolant through the air-to-liquid heat exchanger.

15. The cooled electronic system of claim 10, wherein the system coolant loop of the dehumidifying and re-humidifying cooling apparatus is coupled in fluid communication with the refrigerant loop and the coolant flowing through the air-to-liquid heat exchanger is the refrigerant.

16. The cooled electronic system of claim 10, wherein the coolant loop of the dehumidifying and re-humidifying cooling apparatus is coupled to a coolant distribution unit external to the electronics rack, the coolant loop providing cooled coolant to the air-to-liquid heat exchanger and expelling heat from the air-to-liquid heat exchanger to a facility coolant loop passing through the coolant distribution unit, and wherein the dehumidifying and re-humidifying cooling apparatus further comprises a controller for controlling an amount of dehumidifying of ingressing air to the electronics rack to control the dew point temperature of the air flowing through the electronics rack.

17. The cooled electronic system of claim 10, further comprising a modular cooling unit disposed within the electronics rack for liquid cooling at least one electronic component of the electronics rack, the modular cooling unit being cooled via facility coolant passing through a facility coolant loop coupled thereto, wherein the facility coolant loop receives facility coolant from a source and passes at least a portion thereof through the modular cooling unit, and wherein the dehumidifying and re-humidifying cooling apparatus further comprises an auxiliary liquid-to-liquid heat exchanger disposed within the electronics rack and coupled to the coolant loop and to the facility coolant loop for cooling coolant flowing through the coolant loop via facility coolant flowing through the facility coolant loop, the coolant loop further comprising a pump for adjustably pumping coolant through the coolant loop.

18. The cooled electronics system of claim 10, further comprising a modular cooling unit associated with the electronics rack for facilitating liquid cooling of at least one electronic component of the electronics rack, the modular cooling unit receiving facility coolant from a source via a facility coolant loop and expelling heat in a liquid-to-liquid heat exchanger from the at least one electronic component to the facility coolant in the facility coolant loop, wherein the coolant loop is coupled to the liquid-to-liquid heat exchanger for cooling coolant passing therethrough, the coolant loop coupling in series fluid communication the liquid-to-liquid heat exchanger, the air-to-liquid heat exchanger and at least one cold plate coupled to the at least one electronic component to be cooled by the modular cooling unit.

19. A method of facilitating cooling of an electronics rack, the method comprising:

disposing a heat exchange assembly at an air inlet side of the electronics rack, wherein the electronics rack comprises the air inlet side and an air outlet side, the air inlet side and air outlet side respectively enabling ingress and egress of air through the electronics rack, the heat exchange assembly comprising an air-to-liquid heat exchanger positioned for ingressing air to pass thereacross before passing through the electronics rack, the air-to-liquid heat exchanger being in fluid communication with a coolant loop for passing coolant therethrough, and the air-to-liquid heat exchanger with coolant passing therethrough dehumidifying ingressing air to the electronics rack to lower a dew point temperature of air flowing through the electronics rack;

collecting liquid condensate from the air-to-liquid heat exchanger's dehumidifying of ingressing air to the electronics rack;

moving the liquid condensate from the air inlet side of the electronics rack to the air outlet side thereof; and

evaporating, at the air outlet side of the electronics rack, the liquid condensate to humidify air egressing from the electronics rack.

20. The method of claim 19, further comprising determining the dew point temperature of ingressing air to the electronics rack after dehumidifying thereof by the air-to-liquid heat exchanger and automatically adjusting an amount of dehumidifying by the air-to-liquid heat exchanger if a difference between a coolest measured surface temperature within the electronics rack and the determined dew point temperature of the dehumidified ingressing air is less than a first predetermined threshold or greater than a second predetermined threshold, wherein the automatically adjusting dehumidifying comprises automatically adjusting a coolant flow rate through the air-to-liquid heat exchanger.