US9089078B2 - Liquid cooling system for a server - Google Patents

Liquid cooling system for a server Download PDF

Info

Publication number
US9089078B2
US9089078B2 US14/275,066 US201414275066A US9089078B2 US 9089078 B2 US9089078 B2 US 9089078B2 US 201414275066 A US201414275066 A US 201414275066A US 9089078 B2 US9089078 B2 US 9089078B2
Authority
US
United States
Prior art keywords
cold plate
cooling system
liquid coolant
plate
hot plate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US14/275,066
Other versions
US20140246178A1 (en
Inventor
Steven B. Branton
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Asetek AS
Original Assignee
Asetek AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=44545955&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=US9089078(B2) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Asetek AS filed Critical Asetek AS
Priority to US14/275,066 priority Critical patent/US9089078B2/en
Publication of US20140246178A1 publication Critical patent/US20140246178A1/en
Assigned to ASETEK DANMARK A/S reassignment ASETEK DANMARK A/S CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: ASETEK A/S
Priority to US14/741,498 priority patent/US9907206B2/en
Application granted granted Critical
Publication of US9089078B2 publication Critical patent/US9089078B2/en
Assigned to ASETEK A/S reassignment ASETEK A/S ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BRANTON, STEVEN B.
Priority to US15/872,524 priority patent/US10136551B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05KPRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K7/00Constructional details common to different types of electric apparatus
    • H05K7/20Modifications to facilitate cooling, ventilating, or heating
    • H05K7/20218Modifications to facilitate cooling, ventilating, or heating using a liquid coolant without phase change in electronic enclosures
    • H05K7/20254Cold plates transferring heat from heat source to coolant
    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05KPRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K7/00Constructional details common to different types of electric apparatus
    • H05K7/20Modifications to facilitate cooling, ventilating, or heating
    • H05K7/20218Modifications to facilitate cooling, ventilating, or heating using a liquid coolant without phase change in electronic enclosures
    • H05K7/20263Heat dissipaters releasing heat from coolant
    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05KPRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K7/00Constructional details common to different types of electric apparatus
    • H05K7/20Modifications to facilitate cooling, ventilating, or heating
    • H05K7/20709Modifications to facilitate cooling, ventilating, or heating for server racks or cabinets; for data centers, e.g. 19-inch computer racks
    • H05K7/20754Air circulating in closed loop within cabinets
    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05KPRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K7/00Constructional details common to different types of electric apparatus
    • H05K7/20Modifications to facilitate cooling, ventilating, or heating
    • H05K7/20709Modifications to facilitate cooling, ventilating, or heating for server racks or cabinets; for data centers, e.g. 19-inch computer racks
    • H05K7/20763Liquid cooling without phase change
    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05KPRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K7/00Constructional details common to different types of electric apparatus
    • H05K7/20Modifications to facilitate cooling, ventilating, or heating
    • H05K7/20709Modifications to facilitate cooling, ventilating, or heating for server racks or cabinets; for data centers, e.g. 19-inch computer racks
    • H05K7/20763Liquid cooling without phase change
    • H05K7/20781Liquid cooling without phase change within cabinets for removing heat from server blades

Definitions

  • the present invention is related generally to systems and methods of cooling heat generating components of a computer server or other systems that operate in an enclosed data processing environment, and computer servers and systems incorporating the cooling system.
  • Electronic systems such as, for example, computer systems include several integrated circuit (IC) devices that generate heat during operation.
  • IC integrated circuit
  • the temperature of the IC devices have to be maintained within acceptable limits. While the problem of heat removal from IC devices is an old one, this problem has increased in recent years due to greater numbers of transistors that are packed into a single IC device while reducing the physical size of the device. Increasing number of transistors compacted into a smaller area results in a greater concentration of heat that must be removed from that smaller area. Bundling multiple computer systems together, such as, for example, in a server, further aggravates the heat removal problem by increasing the amount of heat that has to be removed from a relatively small area.
  • modules In a typical computer server (“server”), multiple computer server modules (“modules”) are stacked together in a rack or a case to consolidate network resources and minimize floor space.
  • Modules which are designed for use in a server configuration are typically characterized by a motherboard comprising heat generating electronic components (such as IC devices) housed in a modular chassis or case, which in turn is mounted together with other similar modules, in a rack, blade cabinet, blade server, or other support structure.
  • multiple servers (each comprising several modules) are typically located in an enclosed space such as a server room or a data center. During operation, the electronic components in the individual modules generate heat which must be removed for effective functioning of the server.
  • FIG. 1 illustrates an prior art method used to cool multiple servers (each containing multiple modules) housed in an enclosed environment such as, for example, a server room.
  • cooling fans are used circulate ambient air from the server room through the multiple modules of a server to absorb heat therefrom.
  • cool air directed into the server room through a cold air plenum is passed through the servers to absorb heat generated by IC devices and other heat generating components therein. After absorbing the generated heat, the heated air is exhausted back into the server room. This heated air is directed through a warm air plenum to a computer room air conditioning (CRAC) system to cool the air and recirculate it back to the server room through the cold air plenum.
  • CRAC computer room air conditioning
  • the disclosed liquid cooling systems and methods are directed to an energy efficient approach of cooling one or more servers located in an enclosed environment, such as a server room.
  • a method of cooling a computer server that includes a plurality of server modules, and is positioned in an enclosed room.
  • the method includes transferring heat generated by a server module of the plurality of server modules to a hot plate of a liquid cooling system.
  • the liquid cooling system may be positioned within the server module, and the hot plate may have a surface exposed to the enclosed room.
  • the method may also include positioning a cold plate of a room-level cooling system in thermal contact with the hot plate.
  • the method may further include directing a cooling medium through the room-level cooling system to transfer heat from the hot plate to a cooling unit positioned outside the room.
  • a method of cooling a computer server including a plurality of server modules may include maintaining a flow of air within a server module of the plurality of server modules to absorb heat from one or more heat generating devices of the server module.
  • the method may also include directing the flow of air through an air-to-liquid heat exchanger of a closed loop liquid cooling system to transfer the absorbed heat to a coolant of the liquid cooling system.
  • the liquid cooling system may be positioned within the server module.
  • the method may also include directing the coolant to a hot plate of the liquid cooling system.
  • the hot plate may be positioned such that at least a heat exchange surface of the hot plate is exposed outside the server module.
  • the method may further include transferring heat from the hot plate to a location remote from the computer server using a cooling medium of a second closed loop cooling system positioned outside the server module.
  • a method of cooling a plurality of computer servers positioned in a server room may include transferring heat generated by each computer server of the plurality of computer servers to an exterior of the computer server using a closed loop liquid cooling system positioned within the computer server.
  • the method may also include thermally coupling a second closed loop cooling system to the liquid cooling system of the computer server.
  • the method may also include circulating a cooling medium through the second closed loop cooling system to transfer heat from the liquid cooling system of the computer server to a location outside the server room.
  • FIG. 1 illustrates a prior art server room cooling system
  • FIG. 2A is an illustration of an exemplary embodiment of the disclosed cooling system applied to a server module
  • FIG. 2B is an illustration of another exemplary embodiment of the disclosed cooling system applied to a server module
  • FIG. 2C is an illustration of another exemplary embodiment of the disclosed cooling system applied to a server module
  • FIG. 3 is a schematic illustrating an exemplary embodiment of the disclosed cooling system
  • FIG. 4 is an illustration of an exemplary embodiment of the disclosed cooling system applied to multiple server units
  • FIG. 5A is an illustration of an exemplary embodiment of the disclosed cooling system applied to an exemplary server unit
  • FIG. 5B is an illustration of another exemplary embodiment of the disclosed cooling system applied to an exemplary server unit
  • FIG. 6A is an illustration of an exemplary hot plate used in the disclosed cooling system.
  • FIG. 6B is an exploded view of the cold plate of FIG. 6A .
  • cooling system by way of example and not by way of limitation.
  • embodiments of the disclosed cooling systems may be applied to cool heat generating components in any application.
  • embodiments of the current disclosure may be used to cool portable computers that operate while being docked to a docking station.
  • the description enables one skilled in the art to make and use the present disclosure for cooling any electronic component within a console or a chassis.
  • FIG. 2A illustrates an exemplary individual computer server unit (or a module 10 A) having a modular chassis adapted for placement in a server rack.
  • Module 10 A includes a motherboard 12 having mounted thereon (or attached thereto, such as, for example, by using a data cable) a plurality of heat generating electronic devices 14 .
  • These electronic devices 14 may include, without limitation, any type of IC or other devices (such as, for example, CPUs, GPUs, memory, power supplies, disk drives, controllers, etc.) that are found in typical computer systems.
  • Module 10 A may also include a closed loop liquid cooling system 20 and an air cooling system 30 .
  • the air cooling system 30 may include a volume of air 32 circulated within the module 10 A by fans 26 or other air moving devices.
  • module 10 A may include air directing channels or walls 28 positioned to direct the air flow in a desired pattern within the module 10 A.
  • Air 32 circulating within the module 10 A may remove heat from, and cool, some or all of the electronic devices 14 contained within the module 10 A.
  • the liquid cooling system 20 of the module 10 A may remove the heat from the air 32 and transfer the heat to a liquid coolant (“coolant 22 ”) circulating within the liquid cooling system 20 .
  • the liquid cooling system 20 may include one or more air-to-liquid heat exchangers (HEX 16 ) for interacting with the circulating internal air 32 and transferring the heat from the air 32 to the coolant 22 .
  • the liquid cooling system 20 may also include one or more hot plates 18 . Although, for the sake of clarity, only one hot plate 18 is illustrated in FIG. 2A (and in the other figures), in general the liquid cooling system 20 may have any number of hot plates 18 .
  • the coolant 22 may absorb heat from the air 32 at HEX 16 and flow to the hot plate 18 . At the hot plate 18 , the heated coolant 22 may transfer the heat to the hot plate 18 and get cooled thereby.
  • the relatively cooler coolant 22 may then flow back to HEX 16 to absorb more heat from air 32 flowing through the HEX 16 and continue the cycle.
  • Conduits 23 may fluidly couple the one or more heat exchangers 16 to the hot plate 18 .
  • the hot plate 18 may be positioned anywhere in module 10 A, in some embodiments, the hot plate 18 may be positioned proximate to, or on, an external surface of the module 10 A. In embodiments having a plurality of hot plates 18 , these hot plates 18 may be positioned proximate the same location or at different locations. In some embodiments, all, or a majority of these plurality of hot plates 18 may be positioned proximate to, or on, an external surface of module 10 A.
  • the liquid cooling system 20 may also include pumps or other liquid moving devices (not shown) to assist in transferring the coolant 22 between HEX 16 and the hot plate 18 .
  • some configurations of the liquid cooling system 20 system may not include a pump, and instead, rely upon the expansion and contraction of the coolant 22 as it absorbs and dissipates heat to propel the coolant 22 between the HEX 16 and the hot plate 18 .
  • Any liquid such as, for example, water, alcohol, mixtures of alcohol and water, etc. may be used as coolant 22 .
  • coolant 22 is described as a liquid, in some embodiments, a phase change material may be used as the coolant 22 .
  • a coolant 22 in a liquid phase may transform to a gaseous phase after absorption of heat at HEX 16 .
  • the coolant 22 may transform back to the liquid phase after transferring the absorbed heat to the hot plate 18 .
  • valves or other known fluid control devices may be provided in the liquid cooling system 20 to control the flow of the coolant 22 therein.
  • the liquid cooling system 20 may be an open loop system instead of a closed loop system. In such an embodiment, the heated coolant 22 from the HEX 16 may be replaced with cooler coolant from outside the cooling system.
  • FIG. 2B illustrates another embodiment of a module having an air cooling system 30 and a liquid cooling system 20 .
  • module 10 B of FIG. 2B may be configured to transfer heat from air 32 circulating within the module 10 B to the coolant 22 circulating within a liquid cooling system 20 .
  • the liquid cooling system 20 of module 10 B may also directly cool one or more electronic devices 14 of the module 10 B.
  • a cold plate 26 of the liquid cooling system 10 may be placed in thermal contact (directly in contact, or in contact through a heat transfer medium, such as, for example, thermal grease or a thermal pad) with the electronic device 14 .
  • the coolant 22 of the liquid cooling system 20 may pass through the cold plate 26 to remove heat from, and thereby cool, the cold plate 26 .
  • Any type of cold plate 26 configured to transfer heat from the electronic device 14 to the coolant 22 circulating within liquid cooling system 20 may be used as the cold plate 26 .
  • the cold plate 26 may include fins, pins, or other such features to assist in transferring the heat from the cold plate 26 to the coolant 22 .
  • devices used to transfer heat from heat generating electronic devices to the coolant in co-assigned patent application Ser. Nos.
  • FIG. 2B illustrates two electronic devices 14 as being directly cooled by the liquid cooling system 20 , this is only exemplary. In general, any number of electronic devices 14 of module 10 B may be directly cooled by the liquid cooling system 20 .
  • HEX 16 may be any type of heat exchanger that is configured to transfer heat from hotter air 32 flowing outside HEX 16 to cooler coolant 22 flowing within HEX 16 .
  • HEX 16 may be a cross-flow, parallel-flow, or a counter-flow heat exchanger that is used to transfer heat from air to liquid circulating within the heat exchanger.
  • the air 32 within modules 10 A and 10 B of FIGS. 2A and 2B may be blown through the HEX 16 using one of more fans 26 positioned within the module. Although only a single set of fans 26 is illustrated FIGS. 2A and 2B , this is only exemplary.
  • fans 26 may be positioned at any location within a module to achieve a desired circulation of air within the module.
  • HEX 16 is illustrated in FIGS. 2A and 2B , any number of heat exchangers may be positioned in a module to achieve a desired temperature distribution in a module.
  • FIG. 2C illustrates an embodiment of a module 10 C including two HEXs 16 and two sets of fans 26 positioned in the module 10 C.
  • the location of the HEXs 16 and the fans 26 may be selected based on the relative amounts of heat generated by the different electronic devices 14 in the module 10 C.
  • a HEX 16 may be positioned proximate (that is, immediately upstream and/or downstream of) a device 14 that produces a relatively large amount of heat. Positioning a HEX 16 upstream of such a device 14 may more effectively cool the device 14 by cooling the air 32 used to remove heat from the device 14 .
  • a HEX 16 immediately downstream of a high heat generating device 14 may cool the air 32 heated by the device 14 , and thereby enable more effective cooling of other electronic devices 14 in the module 10 C.
  • a set of fans 26 may be positioned upstream of a HEX 16 to drive the air 32 through the HEX 16 .
  • fans 26 may be positioned downstream of a HEX 16 to pull the air 32 through the HEX 16 .
  • a module ( 10 A, 10 B, 10 C, collectively module 10 ) may be sealed to minimize the transfer of air from inside the module to outside the module. In such embodiments, free flow of air between the module 10 and the server room 100 may be prevented.
  • module 10 may not include passages and other openings that are typically provided in the chassis of a computer system to allow air to flow into and out of the computer system. In these embodiments, substantially all the air 32 within the module 10 may stay within the module 10 .
  • a perfect seal between the module 10 and the server room 100 is not a requirement, and some transfer of air between the module 10 and the server room 100 may be unavoidable due to leaks, gaps between panels of the module chassis, cracks in the panels, etc. That is, in an embodiment of the module 10 that is substantially sealed to prevent the flow of air between the server room 100 and the module 10 , the module 10 may be substantially free of openings and other passages that permit the free transfer of air between the module 10 and the server room 100 .
  • a majority of heat from the module 10 may be removed by the liquid cooling system 20 .
  • the heated air 32 in the module 10 may heat the chassis of the module 10 , and some amount of heat transfer may occur as a result of heat transfer from the chassis to the server room, and as a result of leakage of air 32 from the module 10 .
  • it is expected that a majority of heat from module 10 may be transferred through the liquid cooling system 20 .
  • Liquid cooling system 20 may transfer the heat absorbed in module 10 to a second cooling system 40 .
  • the second cooling system may be a cooling system that is associated with server room 100 or the enclosed environment within which the modules 10 are located.
  • Second cooling system 40 may circulate a thermal transfer medium 42 (any fluid, such as a liquid or a gas) therethrough to absorb heat from the liquid cooling systems 20 associated with different modules 10 , and discharge the heat remote from these modules 10 .
  • a thermal transfer medium 42 any fluid, such as a liquid or a gas
  • thermal transfer medium 42 any type of fluid, such as water, alcohol, mixtures thereof, a gas, etc.
  • a phase change material may be used as the thermal transfer medium 42 .
  • second cooling system 40 may be a closed loop cooling system.
  • the second cooling system 40 may be an open loop system. In some embodiments, as illustrated in FIG. 3 , second cooling system 40 may absorb heat from one or modules 10 positioned in the server room 100 , and discharge the heat outside the server room 100 .
  • the second cooling system 40 may consist of one or more cold plate elements 48 , a cooling device 46 disposed external to server room 100 , and conduits to transfer the thermal transfer medium 42 between the cooling device 46 and the cold plate elements 48 .
  • the thermal transfer medium 42 may be circulated between the cooling device 46 and the cold plate elements 48 of the modules 10 of several servers positioned in the server room. The circulating thermal transfer medium 42 may thus draw heat from the hot plates 18 of these modules 10 and discharge the heat external to the server room 100 .
  • pumps and/or other control devices may be provided to assist in directing the thermal transfer medium 42 through the second cooling system 40 . Transferring the heat generated by the servers outside the server room 100 avoids heating the air in the server room, and thus reduces the cooling load of the server room cooling system. It is also contemplated that the heat removed from the server room by thermal transfer medium 42 may be used to do useful work.
  • this removed heat may be used in an HVAC system to heat a building.
  • several modules 10 having a liquid cooling system 20 and an air cooling system 30 therein, may be mounted on a rack 50 positioned in the server room 100 .
  • the server room 100 may include several racks 50 with modules 10 mounted thereon.
  • a cold plate 48 associated with the second cooling system 40 may thermally couple to, and remove heat from, the hot plates 18 associated with the liquid cooling system 20 of each of these modules 10 .
  • the hot plates 18 may be positioned proximate to, or on mounted on, the chassis of the modules 10 with a surface exposed to the server room 100 .
  • a surface of the cold plates 48 may be placed in thermal contact with the exposed surface of the hot plates 18 for transfer of heat therebetween.
  • the second cooling system 40 may circulate the thermal transfer medium 42 through the cold plates 48 using one or more pumps 44 to transfer the heat from the hot plates 18 to the cooling device 46 outside the server room 100 .
  • the cooling device 46 may be any type of device (such, as a chiller, a heat exchanger, etc.) adapted to remove heat from the thermal transfer medium 42 passing therethrough.
  • each module 10 in a rack 50 may include both a liquid cooling system 20 and an air cooling system 30 . However, in some embodiments (as illustrated in FIG.
  • one or more modules 10 of a rack 50 may include only a liquid cooling system 20 .
  • these one or more modules 10 may include openings or passages that permit transfer of air between the server room 100 and the module 10 . That is, in such embodiments, the modules 10 of the rack 50 that do not include an air cooling system 40 may not be substantially sealed from the server room 100 .
  • each module 10 of a rack 50 may not be individually sealed from the server room 100 .
  • air 32 may flow between the modules 10 in a rack 50 , and the rack 50 may be substantially sealed from the server room 100 .
  • a particular flow path of the thermal transfer medium 42 is illustrated in FIG. 4 , this is only exemplary. In general, the thermal transfer medium 42 may be circulated through the server room 100 in any pattern.
  • FIG. 4 illustrates each module 10 associated with a rack 50 as having a liquid cooling system 20 therein, this is only exemplary. It is contemplated that, in some embodiments, only some of the modules 10 in a rack 50 may include a liquid cooling system 20 , and only a selected ones of these modules may thermally couple with the second cooling system 40 .
  • the rack 50 may itself generate heat.
  • the modules 10 in a rack 50 may not include separate power supplies. Instead, the power supplies may be located in the rack 50 , and the rack 50 may deliver the required power to the modules 10 mounted in the rack 50 .
  • the rack 50 may include a rack-level cooling system 51 with a hot plate 68 that mates with a cold plate 48 of the second cooling system 40 .
  • the rack-level cooling system 51 may be a closed loop liquid cooling system that circulates a liquid coolant to remove heat from the electronic devices 14 of the rack 50 .
  • Cold plates 26 of the rack-level cooling system 51 may thermally couple with and remove heat from electronic devices 14 of the rack 50 , and transfer the heat to the hot plate 68 positioned proximate (or on the chassis with a surface exposed to the server room 100 ) an external surface of the rack 50 .
  • a cold plate 48 of the second cooling system 40 may thermally couple with and remove heat from the hot plate 68 of the rack-level cooling system 51 .
  • the rack-level cooling system 51 may include multiple cold plates 58 that thermally couple with the hot plates 18 of the modules 10 .
  • the rack-level cooling system 51 may remove heat from the modules 10 , and transfer the heat to the second cooling system 40 through a hot plate 68 placed in thermal contact with the cold plate 48 of the second cooling system 40 .
  • a hot plate ( 18 , 68 ) and a cold plate ( 48 , 58 ) may be any component that enables heat transfer between a coolant and a heat exchange surface.
  • a hot plate and a cold plate may be substantially similar components that mate with each to transfer heat therebetween.
  • the other hot plates such as, hot plate 68 ) and cold plates ( 48 , 58 ) may be substantially similar in structure to hot plate 18 .
  • FIGS. 6A and 6B illustrate an exemplary embodiment of hot plate 18 that may be used to transfer heat from coolant 22 of the liquid cooling system 20 .
  • FIG. 6A shows a perspective view of the hot plate 18
  • FIG. 6A shows a perspective view of the hot plate 18
  • the hot plate 18 may include a conductive plate 72 and a cover 74 .
  • the conductive plate 72 may be made of any thermally conductive material (such as, for example, copper, aluminum, etc) and the cover 74 may be made of either a conductive or a non-conductive material.
  • the cover 74 and the conductive plate 72 may attached together to define a reservoir 76 therebetween.
  • the cover 74 may be attached to the conductive plate 72 in any manner, such as, for example, using an adhesive, solder, braze, or by another known mechanism.
  • the coolant 22 of the liquid cooling system 20 may circulate through the reservoir 76 to transfer heat from the coolant 22 to the conductive plate 72 .
  • the cover 74 may include openings for an inlet 78 a and an outlet 78 b for reservoir 76 .
  • Conduits 22 a and 22 b couple with the inlet 78 a and the outlet 78 b to direct the coolant 22 into and out of the reservoir 76 .
  • the size of the conductive plate 72 and the reservoir 76 may be selected so that the hot plate 18 can fit within the available space in module 10 while providing the necessary surface area for cooling.
  • Conductive plate 72 of hot plate 18 may include a first surface 72 a exposed to reservoir 76 and an opposing second surface 72 b .
  • First surface 72 a may include fins 73 that project from the first surface 72 a into the reservoir 76 .
  • These fins 73 may include multiple plates oriented parallel to each other.
  • These fins 73 may be adapted to absorb heat from the coolant 22 that passes through reservoir 76 .
  • the fins 73 may function to increase the area of contact of the coolant 22 to the first surface 72 a and serve to generate turbulence in the coolant 22 flowing through the reservoir 76 .
  • the fins 73 are depicted as parallel plates in FIG. 6B , the fins 73 may alternatively or additionally include other structures (such as pins, etc.).
  • Conductive plate 72 may mate with the cover 74 and form a liquid-tight seal.
  • the second surface 72 b of conductive plate 72 may be thermally coupled to a second surface of a cold plate (such as, for example, cold plates 48 and 58 ) to transfer heat from the hot plate 18 to the thermally coupled cold plate.
  • the hot plate 18 may be mounted in a module 10 such that the second surface 72 b is exposed to the server room 100 .
  • the second surface 72 b may be substantially flat while in other embodiments, second surface 72 b may include features (such as alignment features) that assist in aligning the hot plate 18 to a cold plate.
  • a thermally coupled hot plate-cold plate pair may include retention features that enable the hot plate to couple with a cold plate efficiently. These features may include mating bolt and hole pairs and or other known features.
  • cold plate 18 may include snap-on features that enable the hot plate 18 to snap on to, and thermally couple with a cold plate (such as, cold plate 58 of FIG. 5B , or cold plate 48 of FIG. 5A ) when a module 10 is slid into a rack 50 .
  • this snap-on feature may be configured to separate and allow the module 10 to be pulled out of rack 50 when a pulling force is applied.
  • the disclosed server cooling system in which a liquid cooling system 20 of a module 10 of a server rack 50 mates with and transfers heat to a second cooling system 40 of the server room 100 , enables the servers to be cooled without transferring the heat to the server room 100 Since the server room 100 is not heated, the necessity of large CRAC systems are eliminated. As discussed in the background section, the electrical power consumed to operate a CRAC system of a server room accounts for a large portion of the total server room power consumption. Although the cooling device 46 of the second cooling system 40 consumes power, this power consumption will be significantly less than that necessary to operate the CRAC system. Eliminating the need for large CRAC systems to cool the server room 100 thereby reduces power consumption associated with cooling the server room.

Abstract

A method of cooling a computer server that includes a plurality of server modules, and is positioned in an enclosed room, includes transferring heat generated by a server module of the plurality of server modules to a hot plate of a liquid cooling system. The liquid cooling system may be positioned within the server module, and the hot plate may have a surface exposed to the enclosed room. The method may also include positioning a cold plate of a room-level cooling system in thermal contact with the hot plate. The method may also include directing a cooling medium through the room-level cooling system to transfer heat from the hot plate to a cooling unit positioned outside the room.

Description

I. CROSS REFERENCE TO RELATED APPLICATIONS
This application is a continuation of U.S. application Ser. No. 14/186,397, filed on Feb. 21, 2014, which claims priority to U.S. application Ser. No. 13/215, 384, filed on Aug. 23, 2011, which claims priority to Provisional Application No. 61/377,249, filed on Aug. 26, 2010, each of which are incorporated herein by reference in their entirety.
II. TECHNICAL FIELD
The present invention is related generally to systems and methods of cooling heat generating components of a computer server or other systems that operate in an enclosed data processing environment, and computer servers and systems incorporating the cooling system.
III. BACKGROUND
Electronic systems, such as, for example, computer systems include several integrated circuit (IC) devices that generate heat during operation. For effective operation of the computer system, the temperature of the IC devices have to be maintained within acceptable limits. While the problem of heat removal from IC devices is an old one, this problem has increased in recent years due to greater numbers of transistors that are packed into a single IC device while reducing the physical size of the device. Increasing number of transistors compacted into a smaller area results in a greater concentration of heat that must be removed from that smaller area. Bundling multiple computer systems together, such as, for example, in a server, further aggravates the heat removal problem by increasing the amount of heat that has to be removed from a relatively small area.
In a typical computer server (“server”), multiple computer server modules (“modules”) are stacked together in a rack or a case to consolidate network resources and minimize floor space. Modules which are designed for use in a server configuration are typically characterized by a motherboard comprising heat generating electronic components (such as IC devices) housed in a modular chassis or case, which in turn is mounted together with other similar modules, in a rack, blade cabinet, blade server, or other support structure. In practice, multiple servers (each comprising several modules) are typically located in an enclosed space such as a server room or a data center. During operation, the electronic components in the individual modules generate heat which must be removed for effective functioning of the server. FIG. 1 illustrates an prior art method used to cool multiple servers (each containing multiple modules) housed in an enclosed environment such as, for example, a server room. In such a prior art system, cooling fans are used circulate ambient air from the server room through the multiple modules of a server to absorb heat therefrom. In the prior art system, cool air directed into the server room through a cold air plenum is passed through the servers to absorb heat generated by IC devices and other heat generating components therein. After absorbing the generated heat, the heated air is exhausted back into the server room. This heated air is directed through a warm air plenum to a computer room air conditioning (CRAC) system to cool the air and recirculate it back to the server room through the cold air plenum.
It is known that a large portion (greater than about 31%) of the energy consumption of a typical server room is used in the operation of the CRAC system, and that significant energy savings and resultant green house gas reduction can be achieved by improving the efficiency of the CRAC system. “Data Center Energy Characterization Study Site Report,” February 2001, available at http://hightech.lbl.gov/documents/DATA_CENTERS/DC_Benchmarking/Data_Center_Facility1.pdf; “Energy Consumption of Information Technology Data Centers,” and references cited therein, Iyengar et al., December 2010, available at http://www.electronics-cooling.com/2010/12/energy-consumption-of-information-technology-data-centers/. Improving the cooling efficiency of servers housed in a server room thereby enables more efficient utilization and conservation of available energy resources, and green house gas emission reduction.
The disclosed liquid cooling systems and methods are directed to an energy efficient approach of cooling one or more servers located in an enclosed environment, such as a server room.
IV. SUMMARY OF THE DISCLOSURE
In one aspect, a method of cooling a computer server that includes a plurality of server modules, and is positioned in an enclosed room, is disclosed. The method includes transferring heat generated by a server module of the plurality of server modules to a hot plate of a liquid cooling system. The liquid cooling system may be positioned within the server module, and the hot plate may have a surface exposed to the enclosed room. The method may also include positioning a cold plate of a room-level cooling system in thermal contact with the hot plate. The method may further include directing a cooling medium through the room-level cooling system to transfer heat from the hot plate to a cooling unit positioned outside the room.
In another aspect, a method of cooling a computer server including a plurality of server modules is disclosed. The method may include maintaining a flow of air within a server module of the plurality of server modules to absorb heat from one or more heat generating devices of the server module. The method may also include directing the flow of air through an air-to-liquid heat exchanger of a closed loop liquid cooling system to transfer the absorbed heat to a coolant of the liquid cooling system. The liquid cooling system may be positioned within the server module. The method may also include directing the coolant to a hot plate of the liquid cooling system. The hot plate may be positioned such that at least a heat exchange surface of the hot plate is exposed outside the server module. The method may further include transferring heat from the hot plate to a location remote from the computer server using a cooling medium of a second closed loop cooling system positioned outside the server module.
In yet another aspect, a method of cooling a plurality of computer servers positioned in a server room is disclosed. The method may include transferring heat generated by each computer server of the plurality of computer servers to an exterior of the computer server using a closed loop liquid cooling system positioned within the computer server. The method may also include thermally coupling a second closed loop cooling system to the liquid cooling system of the computer server. The method may also include circulating a cooling medium through the second closed loop cooling system to transfer heat from the liquid cooling system of the computer server to a location outside the server room.
V. BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates a prior art server room cooling system;
FIG. 2A is an illustration of an exemplary embodiment of the disclosed cooling system applied to a server module;
FIG. 2B is an illustration of another exemplary embodiment of the disclosed cooling system applied to a server module;
FIG. 2C is an illustration of another exemplary embodiment of the disclosed cooling system applied to a server module;
FIG. 3 is a schematic illustrating an exemplary embodiment of the disclosed cooling system;
FIG. 4 is an illustration of an exemplary embodiment of the disclosed cooling system applied to multiple server units;
FIG. 5A is an illustration of an exemplary embodiment of the disclosed cooling system applied to an exemplary server unit;
FIG. 5B is an illustration of another exemplary embodiment of the disclosed cooling system applied to an exemplary server unit;
FIG. 6A is an illustration of an exemplary hot plate used in the disclosed cooling system; and
FIG. 6B is an exploded view of the cold plate of FIG. 6A.
VI. DETAILED DESCRIPTION
The following detailed description illustrates the cooling system by way of example and not by way of limitation. Although the description below describes an application of a liquid cooling system to servers housed in an enclosed environment, embodiments of the disclosed cooling systems may be applied to cool heat generating components in any application. For example, embodiments of the current disclosure may be used to cool portable computers that operate while being docked to a docking station. The description enables one skilled in the art to make and use the present disclosure for cooling any electronic component within a console or a chassis.
Reference will now be made to exemplary embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. Elements or parts designated using the same reference numbers in different figures perform similar functions. Therefore, for the sake of brevity, these elements may not be described with reference to every figure. In the description that follows, if an element is not described with reference to a figure, the description of the element made with reference to another figure applies.
FIG. 2A illustrates an exemplary individual computer server unit (or a module 10A) having a modular chassis adapted for placement in a server rack. Module 10A includes a motherboard 12 having mounted thereon (or attached thereto, such as, for example, by using a data cable) a plurality of heat generating electronic devices 14. These electronic devices 14 may include, without limitation, any type of IC or other devices (such as, for example, CPUs, GPUs, memory, power supplies, disk drives, controllers, etc.) that are found in typical computer systems. Module 10A may also include a closed loop liquid cooling system 20 and an air cooling system 30. The air cooling system 30 may include a volume of air 32 circulated within the module 10A by fans 26 or other air moving devices. In some embodiments, module 10A may include air directing channels or walls 28 positioned to direct the air flow in a desired pattern within the module 10A. Air 32 circulating within the module 10A may remove heat from, and cool, some or all of the electronic devices 14 contained within the module 10A. The liquid cooling system 20 of the module 10A may remove the heat from the air 32 and transfer the heat to a liquid coolant (“coolant 22”) circulating within the liquid cooling system 20.
The liquid cooling system 20 may include one or more air-to-liquid heat exchangers (HEX 16) for interacting with the circulating internal air 32 and transferring the heat from the air 32 to the coolant 22. The liquid cooling system 20 may also include one or more hot plates 18. Although, for the sake of clarity, only one hot plate 18 is illustrated in FIG. 2A (and in the other figures), in general the liquid cooling system 20 may have any number of hot plates 18. The coolant 22 may absorb heat from the air 32 at HEX 16 and flow to the hot plate 18. At the hot plate 18, the heated coolant 22 may transfer the heat to the hot plate 18 and get cooled thereby. The relatively cooler coolant 22 may then flow back to HEX 16 to absorb more heat from air 32 flowing through the HEX 16 and continue the cycle. Conduits 23 may fluidly couple the one or more heat exchangers 16 to the hot plate 18. Although in general, the hot plate 18 may be positioned anywhere in module 10A, in some embodiments, the hot plate 18 may be positioned proximate to, or on, an external surface of the module 10A. In embodiments having a plurality of hot plates 18, these hot plates 18 may be positioned proximate the same location or at different locations. In some embodiments, all, or a majority of these plurality of hot plates 18 may be positioned proximate to, or on, an external surface of module 10A. In some embodiments, the liquid cooling system 20 may also include pumps or other liquid moving devices (not shown) to assist in transferring the coolant 22 between HEX 16 and the hot plate 18. Alternatively, some configurations of the liquid cooling system 20 system may not include a pump, and instead, rely upon the expansion and contraction of the coolant 22 as it absorbs and dissipates heat to propel the coolant 22 between the HEX 16 and the hot plate 18. Any liquid, such as, for example, water, alcohol, mixtures of alcohol and water, etc. may be used as coolant 22. Although coolant 22 is described as a liquid, in some embodiments, a phase change material may be used as the coolant 22. In these embodiments, a coolant 22 in a liquid phase may transform to a gaseous phase after absorption of heat at HEX 16. The coolant 22 may transform back to the liquid phase after transferring the absorbed heat to the hot plate 18. In some embodiments, valves or other known fluid control devices (not shown) may be provided in the liquid cooling system 20 to control the flow of the coolant 22 therein. Further, it is also contemplated that in some embodiments, the liquid cooling system 20 may be an open loop system instead of a closed loop system. In such an embodiment, the heated coolant 22 from the HEX 16 may be replaced with cooler coolant from outside the cooling system.
FIG. 2B illustrates another embodiment of a module having an air cooling system 30 and a liquid cooling system 20. Similar to module 10A of FIG. 2A, module 10B of FIG. 2B may be configured to transfer heat from air 32 circulating within the module 10B to the coolant 22 circulating within a liquid cooling system 20. In addition to cooling the air 32 within the module 10B, the liquid cooling system 20 of module 10B may also directly cool one or more electronic devices 14 of the module 10B. To directly cool an electronic device 14, a cold plate 26 of the liquid cooling system 10 may be placed in thermal contact (directly in contact, or in contact through a heat transfer medium, such as, for example, thermal grease or a thermal pad) with the electronic device 14. Because of thermal contact, heat may be transferred from the electronic device 14 to the cold plate 26. The coolant 22 of the liquid cooling system 20 may pass through the cold plate 26 to remove heat from, and thereby cool, the cold plate 26. Any type of cold plate 26 configured to transfer heat from the electronic device 14 to the coolant 22 circulating within liquid cooling system 20 may be used as the cold plate 26. The cold plate 26 may include fins, pins, or other such features to assist in transferring the heat from the cold plate 26 to the coolant 22. In some embodiments, devices used to transfer heat from heat generating electronic devices to the coolant in co-assigned patent application Ser. Nos. 10/578,578, 11/919,974, 12/826, 736, 12/914,190, and 12/914,263, with appropriate modifications, may be used as cold plate 26. These patent applications are incorporated by reference herein in their entirety. Although FIG. 2B illustrates two electronic devices 14 as being directly cooled by the liquid cooling system 20, this is only exemplary. In general, any number of electronic devices 14 of module 10B may be directly cooled by the liquid cooling system 20.
HEX 16 may be any type of heat exchanger that is configured to transfer heat from hotter air 32 flowing outside HEX 16 to cooler coolant 22 flowing within HEX 16. For instance, in some embodiments, HEX 16 may be a cross-flow, parallel-flow, or a counter-flow heat exchanger that is used to transfer heat from air to liquid circulating within the heat exchanger. The air 32 within modules 10A and 10B of FIGS. 2A and 2B, respectively, may be blown through the HEX 16 using one of more fans 26 positioned within the module. Although only a single set of fans 26 is illustrated FIGS. 2A and 2B, this is only exemplary. In general, fans 26 may be positioned at any location within a module to achieve a desired circulation of air within the module. Similarly although only one HEX 16 is illustrated in FIGS. 2A and 2B, any number of heat exchangers may be positioned in a module to achieve a desired temperature distribution in a module.
FIG. 2C illustrates an embodiment of a module 10C including two HEXs 16 and two sets of fans 26 positioned in the module 10C. In general, the location of the HEXs 16 and the fans 26 may be selected based on the relative amounts of heat generated by the different electronic devices 14 in the module 10C. For instance, in some embodiments, a HEX 16 may be positioned proximate (that is, immediately upstream and/or downstream of) a device 14 that produces a relatively large amount of heat. Positioning a HEX 16 upstream of such a device 14 may more effectively cool the device 14 by cooling the air 32 used to remove heat from the device 14. And, positioning a HEX 16 immediately downstream of a high heat generating device 14 may cool the air 32 heated by the device 14, and thereby enable more effective cooling of other electronic devices 14 in the module 10C. Typically, a set of fans 26 may be positioned upstream of a HEX 16 to drive the air 32 through the HEX 16. However, it is also contemplated that in some embodiments, fans 26 may be positioned downstream of a HEX 16 to pull the air 32 through the HEX 16.
With reference to FIG. 3, in some embodiments, a module (10A, 10B, 10C, collectively module 10) may be sealed to minimize the transfer of air from inside the module to outside the module. In such embodiments, free flow of air between the module 10 and the server room 100 may be prevented.
That is, module 10 may not include passages and other openings that are typically provided in the chassis of a computer system to allow air to flow into and out of the computer system. In these embodiments, substantially all the air 32 within the module 10 may stay within the module 10. However, it should be noted that a perfect seal between the module 10 and the server room 100 is not a requirement, and some transfer of air between the module 10 and the server room 100 may be unavoidable due to leaks, gaps between panels of the module chassis, cracks in the panels, etc. That is, in an embodiment of the module 10 that is substantially sealed to prevent the flow of air between the server room 100 and the module 10, the module 10 may be substantially free of openings and other passages that permit the free transfer of air between the module 10 and the server room 100. In such a module 10, a majority of heat from the module 10 may be removed by the liquid cooling system 20. The heated air 32 in the module 10 may heat the chassis of the module 10, and some amount of heat transfer may occur as a result of heat transfer from the chassis to the server room, and as a result of leakage of air 32 from the module 10. However, it is expected that a majority of heat from module 10 may be transferred through the liquid cooling system 20.
Liquid cooling system 20 may transfer the heat absorbed in module 10 to a second cooling system 40. The second cooling system may be a cooling system that is associated with server room 100 or the enclosed environment within which the modules 10 are located. Second cooling system 40 may circulate a thermal transfer medium 42 (any fluid, such as a liquid or a gas) therethrough to absorb heat from the liquid cooling systems 20 associated with different modules 10, and discharge the heat remote from these modules 10. Any type of fluid, such as water, alcohol, mixtures thereof, a gas, etc. may be used as thermal transfer medium 42. It is also contemplated that, in some embodiments, a phase change material may be used as the thermal transfer medium 42. In some embodiments, second cooling system 40 may be a closed loop cooling system. However, it is contemplated that in other embodiments, the second cooling system 40 may be an open loop system. In some embodiments, as illustrated in FIG. 3, second cooling system 40 may absorb heat from one or modules 10 positioned in the server room 100, and discharge the heat outside the server room 100.
The second cooling system 40 may consist of one or more cold plate elements 48, a cooling device 46 disposed external to server room 100, and conduits to transfer the thermal transfer medium 42 between the cooling device 46 and the cold plate elements 48. The thermal transfer medium 42, may be circulated between the cooling device 46 and the cold plate elements 48 of the modules 10 of several servers positioned in the server room. The circulating thermal transfer medium 42 may thus draw heat from the hot plates 18 of these modules 10 and discharge the heat external to the server room 100. In some embodiments, pumps and/or other control devices may be provided to assist in directing the thermal transfer medium 42 through the second cooling system 40. Transferring the heat generated by the servers outside the server room 100 avoids heating the air in the server room, and thus reduces the cooling load of the server room cooling system. It is also contemplated that the heat removed from the server room by thermal transfer medium 42 may be used to do useful work.
For instance, this removed heat may be used in an HVAC system to heat a building. In a server application, as illustrated in FIG. 4, several modules 10, having a liquid cooling system 20 and an air cooling system 30 therein, may be mounted on a rack 50 positioned in the server room 100. The server room 100 may include several racks 50 with modules 10 mounted thereon. A cold plate 48 associated with the second cooling system 40 may thermally couple to, and remove heat from, the hot plates 18 associated with the liquid cooling system 20 of each of these modules 10. In some embodiments, to assist in thermally coupling the cold plate 48 to the hot plates 18, the hot plates 18 may be positioned proximate to, or on mounted on, the chassis of the modules 10 with a surface exposed to the server room 100. In these embodiments, a surface of the cold plates 48 may be placed in thermal contact with the exposed surface of the hot plates 18 for transfer of heat therebetween. In some embodiments, the second cooling system 40 may circulate the thermal transfer medium 42 through the cold plates 48 using one or more pumps 44 to transfer the heat from the hot plates 18 to the cooling device 46 outside the server room 100. The cooling device 46 may be any type of device (such, as a chiller, a heat exchanger, etc.) adapted to remove heat from the thermal transfer medium 42 passing therethrough. In some embodiments, each module 10 in a rack 50 may include both a liquid cooling system 20 and an air cooling system 30. However, in some embodiments (as illustrated in FIG. 4), one or more modules 10 of a rack 50 may include only a liquid cooling system 20. In some such embodiments, these one or more modules 10 may include openings or passages that permit transfer of air between the server room 100 and the module 10. That is, in such embodiments, the modules 10 of the rack 50 that do not include an air cooling system 40 may not be substantially sealed from the server room 100.
In some embodiments (such as in blade server applications where each module 10 may not be enclosed in a separate chassis), each module 10 of a rack 50 may not be individually sealed from the server room 100. In these embodiments, air 32 may flow between the modules 10 in a rack 50, and the rack 50 may be substantially sealed from the server room 100. Although a particular flow path of the thermal transfer medium 42 is illustrated in FIG. 4, this is only exemplary. In general, the thermal transfer medium 42 may be circulated through the server room 100 in any pattern. Further, although FIG. 4 illustrates each module 10 associated with a rack 50 as having a liquid cooling system 20 therein, this is only exemplary. It is contemplated that, in some embodiments, only some of the modules 10 in a rack 50 may include a liquid cooling system 20, and only a selected ones of these modules may thermally couple with the second cooling system 40.
In some server applications, in addition to the heat generated in the modules 10, the rack 50 may itself generate heat. For instance, in some server applications, the modules 10 in a rack 50 may not include separate power supplies. Instead, the power supplies may be located in the rack 50, and the rack 50 may deliver the required power to the modules 10 mounted in the rack 50. In such embodiments, as illustrated in FIG. 5A, the rack 50 may include a rack-level cooling system 51 with a hot plate 68 that mates with a cold plate 48 of the second cooling system 40. The rack-level cooling system 51 may be a closed loop liquid cooling system that circulates a liquid coolant to remove heat from the electronic devices 14 of the rack 50. Cold plates 26 of the rack-level cooling system 51 may thermally couple with and remove heat from electronic devices 14 of the rack 50, and transfer the heat to the hot plate 68 positioned proximate (or on the chassis with a surface exposed to the server room 100) an external surface of the rack 50. A cold plate 48 of the second cooling system 40 may thermally couple with and remove heat from the hot plate 68 of the rack-level cooling system 51.
In some embodiments, as illustrated in FIG. 5B, in addition to cold plates 26 that remove heat from electronic devices 14 of the rack 50, the rack-level cooling system 51 may include multiple cold plates 58 that thermally couple with the hot plates 18 of the modules 10. In such an embodiment, the rack-level cooling system 51 may remove heat from the modules 10, and transfer the heat to the second cooling system 40 through a hot plate 68 placed in thermal contact with the cold plate 48 of the second cooling system 40.
A hot plate (18, 68) and a cold plate (48, 58) may be any component that enables heat transfer between a coolant and a heat exchange surface. In some embodiments, a hot plate and a cold plate may be substantially similar components that mate with each to transfer heat therebetween. For the sake of brevity, only hot plate 18 of liquid cooling system 20 may be described herein. The other hot plates (such as, hot plate 68) and cold plates (48, 58) may be substantially similar in structure to hot plate 18. FIGS. 6A and 6B illustrate an exemplary embodiment of hot plate 18 that may be used to transfer heat from coolant 22 of the liquid cooling system 20. FIG. 6A shows a perspective view of the hot plate 18, while FIG. 6B shows a view with the cover partially removed to show the structure within. In the description below, reference will be made to both FIGS. 6A and 6B. The hot plate 18 may include a conductive plate 72 and a cover 74. The conductive plate 72 may be made of any thermally conductive material (such as, for example, copper, aluminum, etc) and the cover 74 may be made of either a conductive or a non-conductive material. The cover 74 and the conductive plate 72 may attached together to define a reservoir 76 therebetween. The cover 74 may be attached to the conductive plate 72 in any manner, such as, for example, using an adhesive, solder, braze, or by another known mechanism. The coolant 22 of the liquid cooling system 20 may circulate through the reservoir 76 to transfer heat from the coolant 22 to the conductive plate 72. The cover 74 may include openings for an inlet 78 a and an outlet 78 b for reservoir 76. Conduits 22 a and 22 b couple with the inlet 78 a and the outlet 78 b to direct the coolant 22 into and out of the reservoir 76. The size of the conductive plate 72 and the reservoir 76 may be selected so that the hot plate 18 can fit within the available space in module 10 while providing the necessary surface area for cooling.
Conductive plate 72 of hot plate 18 may include a first surface 72 a exposed to reservoir 76 and an opposing second surface 72 b. First surface 72 a may include fins 73 that project from the first surface 72 a into the reservoir 76. These fins 73 may include multiple plates oriented parallel to each other. These fins 73 may be adapted to absorb heat from the coolant 22 that passes through reservoir 76. The fins 73 may function to increase the area of contact of the coolant 22 to the first surface 72 a and serve to generate turbulence in the coolant 22 flowing through the reservoir 76. Although the fins 73 are depicted as parallel plates in FIG. 6B, the fins 73 may alternatively or additionally include other structures (such as pins, etc.). Conductive plate 72 may mate with the cover 74 and form a liquid-tight seal. The second surface 72 b of conductive plate 72 may be thermally coupled to a second surface of a cold plate (such as, for example, cold plates 48 and 58) to transfer heat from the hot plate 18 to the thermally coupled cold plate. In some embodiments, the hot plate 18 may be mounted in a module 10 such that the second surface 72 b is exposed to the server room 100. In some embodiments, the second surface 72 b may be substantially flat while in other embodiments, second surface 72 b may include features (such as alignment features) that assist in aligning the hot plate 18 to a cold plate. In some embodiments, a thermally coupled hot plate-cold plate pair may include retention features that enable the hot plate to couple with a cold plate efficiently. These features may include mating bolt and hole pairs and or other known features. In some embodiments, cold plate 18 may include snap-on features that enable the hot plate 18 to snap on to, and thermally couple with a cold plate (such as, cold plate 58 of FIG. 5B, or cold plate 48 of FIG. 5A) when a module 10 is slid into a rack 50. In some embodiments, this snap-on feature may be configured to separate and allow the module 10 to be pulled out of rack 50 when a pulling force is applied.
The disclosed server cooling system in which a liquid cooling system 20 of a module 10 of a server rack 50 mates with and transfers heat to a second cooling system 40 of the server room 100, enables the servers to be cooled without transferring the heat to the server room 100 Since the server room 100 is not heated, the necessity of large CRAC systems are eliminated. As discussed in the background section, the electrical power consumed to operate a CRAC system of a server room accounts for a large portion of the total server room power consumption. Although the cooling device 46 of the second cooling system 40 consumes power, this power consumption will be significantly less than that necessary to operate the CRAC system. Eliminating the need for large CRAC systems to cool the server room 100 thereby reduces power consumption associated with cooling the server room. This reduction in power consumption enables more efficient utilization and conservation of available energy resources, and concomitant reduction in green house gas emissions. Since additional modules 10 can be added to a server rack 50 without breeching a liquid cooling system, the danger of liquid spillage within a server is also eliminated.
It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed cooling systems. Other embodiments will be apparent to those skilled in the art from consideration of the specification and practice of the disclosed cooling systems. It is intended that the specification and examples be considered as exemplary only, with a true scope being indicated by the following claims and their equivalents.

Claims (20)

What is claimed is:
1. A cooling system for a computer server rack for housing at least one server module, the cooling system comprising:
at least one first cold plate, wherein the first cold plate is dimensioned to thermally couple to the server module;
at least one first hot plate, wherein the first cold plate fluidly connects to the first hot plate for receiving a flow of first liquid coolant to transfer heat from the first cold plate to the first liquid coolant, and from the first liquid coolant to the first hot plate;
at least one second cold plate, wherein the second cold plate thermally couples to the first hot plate to transfer heat from the first hot plate to the second cold plate; and
at least one cooling device, wherein the second cold plate fluidly connects to the cooling device for receiving a flow of second liquid coolant to transfer heat from the second cold plate to the second liquid coolant, and from the second liquid coolant to the cooling device,
wherein at least one of the first cold plate or the second cold plate includes at least one of a plurality of fins or a plurality of pins for promoting the transfer of heat from the first cold plate to the first liquid coolant or for promoting the transfer of heat from the second cold plate to the second liquid coolant.
2. The cooling system of claim 1, wherein at least one of the first liquid coolant and the second liquid coolant is flowed through a closed loop.
3. The cooling system of claim 1, wherein at least one of the first liquid coolant and the second liquid coolant is flowed through an open loop.
4. The cooling system of claim 1, further comprising at least one pump for directing flow of at least one of the first liquid coolant and the second liquid coolant.
5. The cooling system of claim 4, wherein the cooling device fluidly connects to the second cold plate for positioning the cooling device in a location remote from the server rack.
6. The cooling system of claim 1, wherein the cooling device includes at least one of a chiller or a heat exchanger.
7. The cooling system of claim 1, wherein the server module includes at least one electronic device and the first cold plate thermally couples to the electronic device.
8. The cooling system of claim 1, wherein the server module does not thermally connect to the first cold plate.
9. The cooling system of claim 1, wherein at least one of the first hot plate or the first cold plate includes a reservoir for receiving the flow of first liquid coolant.
10. The cooling system of claim 9, wherein at least one of the first hot plate or the first cold plate includes a plurality of fins that project into the reservoir.
11. The cooling system of claim 1, wherein at least one of a second hot plate or the second cold plate includes a reservoir for receiving the flow of second liquid coolant.
12. The cooling system of claim 11, wherein at least one of the second hot plate or the second cold plate includes a plurality of fins that project into the reservoir.
13. The cooling system of claim 1, wherein at least one of the first hot plate, the first cold plate, a second hot plate, or the second cold plate is formed of at least one of copper or aluminum.
14. The cooling system of claim 1, wherein at least one of the first liquid coolant or the second liquid coolant includes at least one of water or alcohol.
15. A computer server cooling system for a computer server rack for housing a plurality of server modules, the computer server cooling system comprising:
a first liquid cooling system having:
at least one first cold plate, wherein the first cold plate is dimensioned to thermally couple to the server module, and
at least one first hot plate, wherein the first cold plate fluidly connects to the first hot plate for receiving a flow of first liquid coolant to transfer heat from the first cold plate to the first liquid coolant, and from the first liquid coolant to the first hot plate;
a second liquid cooling system having:
at least one second cold plate, wherein the second cold plate thermally couples to the first liquid cooling system to transfer heat from the first hot plate to the second cold plate, and
at least one cooling device, wherein the second cold plate fluidly connects to the cooling device for receiving a flow of second liquid coolant to transfer heat from the second cold plate to the second liquid coolant, and from the second liquid coolant to the cooling device; and
a rack cooling system having:
at least one third cold plate that thermally couples to the server module, and
at least one second hot plate that thermally couples to the second liquid cooling system to transfer heat from the second hot plate to the second liquid cooling system.
16. The computer server cooling system of claim 15, wherein the second hot plate of the rack cooling system thermally couples to the second cold plate of the second cooling system.
17. The computer server cooling system of claim 15, wherein the third cold plate fluidly connects to the second hot plate for receiving a flow of third liquid coolant to transfer heat from the third cold plate, to the third liquid coolant, and from the third liquid coolant to the second hot plate.
18. The computer server cooling system of claim 17, wherein at least one of the first hot plate, the first cold plate, the second hot plate, or the second cold plate includes a plurality of fins.
19. A cooling system for a computer server rack for housing at least one server module, the cooling system comprising:
at least one first cold plate, wherein the first cold plate is dimensioned to thermally couple to the server module;
at least one first hot plate, wherein the first cold plate is fluidly connected to the first hot plate to receive a flow of first liquid coolant to transfer heat from the first cold plate to the first liquid coolant, and wherein the first hot plate receives the flow of heated first liquid coolant from the first cold plate to transfer heat from the first liquid coolant to the first hot plate;
at least one second cold plate, wherein the second cold plate thermally couples to the first hot plate to transfer heat from the first hot plate to the second cold plate; and
at least one cooling device, wherein the second cold plate is fluidly connected to the cooling device to receive a flow of second liquid coolant to transfer heat from the second cold plate to the second liquid coolant, and wherein the cooling device receives the flow of heated second liquid coolant from the second cold plate to transfer heat from the second liquid coolant to the cooling device,
wherein at least one of the first liquid coolant or the second liquid coolant is flowed through an open loop.
20. A cooling system for a computer server rack for housing at least one server module, the cooling system comprising:
at least one first cold plate, wherein the first cold plate is dimensioned to thermally couple to the server module;
at least one first hot plate, wherein the first cold plate is fluidly connected to the first hot plate to receive a flow of first liquid coolant to transfer heat from the first cold plate to the first liquid coolant, and wherein the first hot plate receives the flow of heated first liquid coolant from the first cold plate to transfer heat from the first liquid coolant to the first hot plate;
at least one second cold plate, wherein the second cold plate thermally couples to the first hot plate to transfer heat from the first hot plate to the second cold plate; and
at least one cooling device, wherein the second cold plate is fluidly connected to the cooling device to receive a flow of second liquid coolant to transfer heat from the second cold plate to the second liquid coolant, and wherein the cooling device receives the flow of heated second liquid coolant from the second cold plate to transfer heat from the second liquid coolant to the cooling device,
wherein at least one of the first hot plate or the first cold plate includes a reservoir for receiving the flow of first liquid coolant and includes a plurality of fins that project into the reservoir.
US14/275,066 2010-08-26 2014-05-12 Liquid cooling system for a server Expired - Fee Related US9089078B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US14/275,066 US9089078B2 (en) 2010-08-26 2014-05-12 Liquid cooling system for a server
US14/741,498 US9907206B2 (en) 2010-08-26 2015-06-17 Liquid cooling system for a server
US15/872,524 US10136551B2 (en) 2010-08-26 2018-01-16 Liquid cooling system for server

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US37724910P 2010-08-26 2010-08-26
US13/215,384 US8724315B2 (en) 2010-08-26 2011-08-23 Liquid cooling system for a server
US14/186,397 US8749968B1 (en) 2010-08-26 2014-02-21 Liquid cooling system for a server
US14/275,066 US9089078B2 (en) 2010-08-26 2014-05-12 Liquid cooling system for a server

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14/186,397 Continuation US8749968B1 (en) 2010-08-26 2014-02-21 Liquid cooling system for a server

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/741,498 Continuation US9907206B2 (en) 2010-08-26 2015-06-17 Liquid cooling system for a server

Publications (2)

Publication Number Publication Date
US20140246178A1 US20140246178A1 (en) 2014-09-04
US9089078B2 true US9089078B2 (en) 2015-07-21

Family

ID=44545955

Family Applications (5)

Application Number Title Priority Date Filing Date
US13/215,384 Active 2032-05-25 US8724315B2 (en) 2010-08-26 2011-08-23 Liquid cooling system for a server
US14/186,397 Active US8749968B1 (en) 2010-08-26 2014-02-21 Liquid cooling system for a server
US14/275,066 Expired - Fee Related US9089078B2 (en) 2010-08-26 2014-05-12 Liquid cooling system for a server
US14/741,498 Active 2032-02-10 US9907206B2 (en) 2010-08-26 2015-06-17 Liquid cooling system for a server
US15/872,524 Active US10136551B2 (en) 2010-08-26 2018-01-16 Liquid cooling system for server

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US13/215,384 Active 2032-05-25 US8724315B2 (en) 2010-08-26 2011-08-23 Liquid cooling system for a server
US14/186,397 Active US8749968B1 (en) 2010-08-26 2014-02-21 Liquid cooling system for a server

Family Applications After (2)

Application Number Title Priority Date Filing Date
US14/741,498 Active 2032-02-10 US9907206B2 (en) 2010-08-26 2015-06-17 Liquid cooling system for a server
US15/872,524 Active US10136551B2 (en) 2010-08-26 2018-01-16 Liquid cooling system for server

Country Status (8)

Country Link
US (5) US8724315B2 (en)
EP (1) EP2609800B1 (en)
CN (2) CN105828574B (en)
DK (1) DK2609800T3 (en)
ES (1) ES2769605T3 (en)
HK (2) HK1187191A1 (en)
PL (1) PL2609800T3 (en)
WO (1) WO2012027319A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160378981A1 (en) * 2015-06-26 2016-12-29 Microsoft Technology Licensing, Llc Intrusion detection for submerged datacenters
US10037062B1 (en) 2017-03-17 2018-07-31 Microsoft Technology Licensing, Llc Thermal venting device with pressurized plenum
US20180270990A1 (en) * 2017-03-20 2018-09-20 International Business Machines Corporation Two-phase liquid cooled electronics
US10524395B2 (en) 2015-06-26 2019-12-31 Microsoft Technology Licensing, Llc Artificial reef datacenter
US20200051184A1 (en) * 2017-02-08 2020-02-13 Upstream Data Inc. Blockchain mine at oil or gas facility
CN111107732A (en) * 2018-10-29 2020-05-05 广达电脑股份有限公司 Method for maintaining server cabinet within predetermined temperature range and cooling system thereof
US20200191042A1 (en) * 2018-12-13 2020-06-18 General Electric Company Liquid driven thermal module and thermal management system
US10925187B1 (en) * 2019-08-30 2021-02-16 Dell Products, L.P. Remote heat exchanger arm for direct contact liquid cooling for rack mounted equipment
US11907029B2 (en) 2019-05-15 2024-02-20 Upstream Data Inc. Portable blockchain mining system and methods of use

Families Citing this family (80)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9496200B2 (en) * 2011-07-27 2016-11-15 Coolit Systems, Inc. Modular heat-transfer systems
US9943014B2 (en) 2013-03-15 2018-04-10 Coolit Systems, Inc. Manifolded heat exchangers and related systems
US8472182B2 (en) * 2010-07-28 2013-06-25 International Business Machines Corporation Apparatus and method for facilitating dissipation of heat from a liquid-cooled electronics rack
CN105828574B (en) * 2010-08-26 2018-09-21 阿塞泰克丹麦公司 Cooling system for computer server chassis
US9848509B2 (en) 2011-06-27 2017-12-19 Ebullient, Inc. Heat sink module
US9901008B2 (en) 2014-10-27 2018-02-20 Ebullient, Inc. Redundant heat sink module
US9901013B2 (en) 2011-06-27 2018-02-20 Ebullient, Inc. Method of cooling series-connected heat sink modules
US9854715B2 (en) 2011-06-27 2017-12-26 Ebullient, Inc. Flexible two-phase cooling system
US9832913B2 (en) 2011-06-27 2017-11-28 Ebullient, Inc. Method of operating a cooling apparatus to provide stable two-phase flow
US9854714B2 (en) 2011-06-27 2017-12-26 Ebullient, Inc. Method of absorbing sensible and latent heat with series-connected heat sinks
US10365667B2 (en) 2011-08-11 2019-07-30 Coolit Systems, Inc. Flow-path controllers and related systems
WO2014141162A1 (en) 2013-03-15 2014-09-18 Coolit Systems, Inc. Sensors, multiplexed communication techniques, and related systems
US9155230B2 (en) 2011-11-28 2015-10-06 Asetek Danmark A/S Cooling system for a server
US20140321056A1 (en) * 2011-12-01 2014-10-30 Nec Corporation Electronic substrate housing equipment and electric apparatus
TWI459893B (en) * 2012-01-20 2014-11-01 Delta Electronics Inc Cabinet system and air-exhausting equipment thereof
KR101906648B1 (en) 2012-02-09 2018-10-10 휴렛 팩커드 엔터프라이즈 디벨롭먼트 엘피 Heat dissipating system
WO2013137847A1 (en) * 2012-03-12 2013-09-19 Hewlett-Packard Development Company, L.P. Liquid temperature control cooling
US9631880B2 (en) 2012-04-10 2017-04-25 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Process for optimizing a heat exchanger configuration
JP6069880B2 (en) 2012-04-24 2017-02-01 富士通株式会社 Rack device, rack system, and housing structure
US9167728B2 (en) * 2012-07-18 2015-10-20 International Business Machines Corporation Information technology equipment cooling method
WO2014051604A1 (en) 2012-09-28 2014-04-03 Hewlett-Packard Development Company, L.P. Cooling assembly
JP6082479B2 (en) 2013-01-31 2017-02-15 ヒューレット パッカード エンタープライズ デベロップメント エル ピーHewlett Packard Enterprise Development LP Liquid cooling
US9049800B2 (en) * 2013-02-01 2015-06-02 Dell Products L.P. Immersion server, immersion server drawer, and rack-mountable immersion server drawer-based cabinet
US9351430B2 (en) * 2013-06-13 2016-05-24 Microsoft Technology Licensing, Llc Renewable energy based datacenter cooling
CN104423504A (en) * 2013-08-28 2015-03-18 英业达科技有限公司 Server
CN104661485A (en) * 2013-11-19 2015-05-27 艾默生网络能源有限公司 Electrical cabinet and method for improving environment in electrical cabinet
US10201116B1 (en) * 2013-12-02 2019-02-05 Amazon Technologies, Inc. Cooling system for data center rack
WO2015083256A1 (en) * 2013-12-04 2015-06-11 富士通株式会社 Cooling device employing mixed working fluid, and cooling device of electronic device
EP3185663A1 (en) * 2014-08-18 2017-06-28 Murakumo Corporation System, information processing device and rack
WO2016053273A1 (en) * 2014-09-30 2016-04-07 Hewlett Packard Enterprise Development Lp Modular cooling
US20160120059A1 (en) 2014-10-27 2016-04-28 Ebullient, Llc Two-phase cooling system
US9852963B2 (en) 2014-10-27 2017-12-26 Ebullient, Inc. Microprocessor assembly adapted for fluid cooling
US10184699B2 (en) 2014-10-27 2019-01-22 Ebullient, Inc. Fluid distribution unit for two-phase cooling system
CN104602486A (en) * 2014-12-22 2015-05-06 曙光信息产业(北京)有限公司 Liquid-cooled server
CN104615220A (en) * 2014-12-25 2015-05-13 曙光信息产业(北京)有限公司 Cooling system and server system
US9832912B2 (en) 2015-05-07 2017-11-28 Dhk Storage, Llc Computer server heat regulation utilizing integrated precision air flow
US9795065B2 (en) 2015-12-21 2017-10-17 Dell Products, L.P. Integrated air-spring for hydraulic force damping of a rigid liquid cooling subsystem
US10146231B2 (en) 2015-12-21 2018-12-04 Dell Products, L.P. Liquid flow control based upon energy balance and fan speed for controlling exhaust air temperature
US9839164B2 (en) 2015-12-21 2017-12-05 Dell Products, L.P. Rack information handling system having modular liquid distribution (MLD) conduits
US10206312B2 (en) 2015-12-21 2019-02-12 Dell Products, L.P. Liquid cooled rack information handling system having storage drive carrier for leak containment and vibration mitigation
US10156873B2 (en) * 2015-12-21 2018-12-18 Dell Products, L.P. Information handling system having fluid manifold with embedded heat exchanger system
US10064314B2 (en) 2015-12-21 2018-08-28 Dell Products, L.P. Runtime service of liquid cooled servers operating under positive hydraulic pressure without impacting component performance
US9622388B1 (en) * 2016-02-10 2017-04-11 Ciena Corporation Multi-directional fans in an electronic chassis supporting extended range temperature operation
US9723762B1 (en) * 2016-03-15 2017-08-01 Amazon Technologies, Inc. Free cooling in high humidity environments
US9961806B2 (en) * 2016-05-19 2018-05-01 Power Distribution Systems Development LLC Systems and methods for transformer cooling by vertical airflow
CN106091758B (en) * 2016-05-31 2018-04-13 北京百度网讯科技有限公司 Heat recovery system for data center
US11249522B2 (en) * 2016-06-30 2022-02-15 Intel Corporation Heat transfer apparatus for a computer environment
DE102016218200A1 (en) * 2016-09-22 2018-03-22 Siemens Healthcare Gmbh Redundant cooling system for a magnetic resonance tomograph
US10390462B2 (en) * 2017-02-16 2019-08-20 Dell Products, Lp Server chassis with independent orthogonal airflow layout
US10108233B1 (en) * 2017-04-06 2018-10-23 Johann Wischnesky Computer cooling assembly
US10191521B2 (en) * 2017-05-25 2019-01-29 Coolanyp, LLC Hub-link liquid cooling system
JP6888469B2 (en) * 2017-08-04 2021-06-16 富士通株式会社 Information processing device
US10785895B2 (en) * 2017-10-04 2020-09-22 Google Llc Managing a data center
US10888013B2 (en) 2017-10-04 2021-01-05 Google Llc Managing a data center
US11452243B2 (en) 2017-10-12 2022-09-20 Coolit Systems, Inc. Cooling system, controllers and methods
CN109757061B (en) * 2017-11-03 2021-06-11 阿里巴巴集团控股有限公司 Cooling cabinet and cooling system
CN109757060B (en) 2017-11-03 2020-11-24 阿里巴巴集团控股有限公司 Cooling device
US10681846B2 (en) 2018-04-19 2020-06-09 Google Llc Cooling electronic devices in a data center
US10645847B2 (en) * 2018-04-20 2020-05-05 Google Llc Cooling electronic devices in a data center
US11240932B1 (en) * 2018-07-27 2022-02-01 Waymo Llc Cold plate
US11467637B2 (en) 2018-07-31 2022-10-11 Wuxi Kalannipu Thermal Management Technology Co., Ltd. Modular computer cooling system
GB2576032B (en) * 2018-08-02 2021-04-21 Provost Fellows Found Scholars & Other Members Board College Holy & Und Liquid cooled server module
US10966352B2 (en) 2018-09-24 2021-03-30 Google Llc Cooling electronic devices in a data center
US10548240B1 (en) 2019-01-11 2020-01-28 Google Llc Cooling electronic devices in a data center
US11662037B2 (en) * 2019-01-18 2023-05-30 Coolit Systems, Inc. Fluid flow control valve for fluid flow systems, and methods
US11163291B2 (en) * 2019-02-08 2021-11-02 Dell Products L.P. System and method of determining coolant leaks within information handling systems
US11473860B2 (en) 2019-04-25 2022-10-18 Coolit Systems, Inc. Cooling module with leak detector and related systems
US11490546B2 (en) * 2019-05-21 2022-11-01 Iceotope Group Limited Cooling system for electronic modules
FR3099814B1 (en) * 2019-08-07 2022-05-13 Tresorio Installation and process for heat recovery
US11089715B2 (en) * 2019-09-17 2021-08-10 Baidu Usa Llc Cooling chassis design for server liquid cooling of electronic racks of a data center
US11212943B2 (en) * 2020-02-21 2021-12-28 Nvidia Corporation Universal pluggable datacenter cooling system
WO2021229365A1 (en) 2020-05-11 2021-11-18 Coolit Systems, Inc. Liquid pumping units, and related systems and methods
US20210368656A1 (en) * 2020-05-20 2021-11-25 Nvidia Corporation Intelligent control and distribution of a liquid in a data center
US20220322581A1 (en) * 2020-08-24 2022-10-06 Nvidia Corporation Intelligent adaptable fins for cooling datacenter devices
US11956931B2 (en) * 2021-02-18 2024-04-09 Nvidia Corporation Intelligent and dynamic cold plate for datacenter cooling systems
TWI784614B (en) * 2021-07-07 2022-11-21 訊凱國際股份有限公司 Server device and carrying case
US11785741B2 (en) * 2021-07-20 2023-10-10 Dell Products L.P. System and method for cooling a computing device
TWI793757B (en) * 2021-09-09 2023-02-21 緯創資通股份有限公司 Immersion cooling system and cooling device
US20230180444A1 (en) * 2021-12-06 2023-06-08 Nvidia Corporation Adjustable fluid coupling in datacenter cooling systems
CN115066168B (en) * 2022-08-19 2022-11-01 南通华锐软件技术有限公司 Computer room server rack cooling system

Citations (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030128525A1 (en) 2002-01-04 2003-07-10 Berry William E. Computer system which locks a server unit subassembly in a selected position in a support frame
US20040095721A1 (en) 2002-11-20 2004-05-20 International Business Machines Corporation Frame level partial cooling boost for drawer and/or node level processors
US6763880B1 (en) 2003-06-26 2004-07-20 Evserv Tech Corporation Liquid cooled radiation module for servers
US6796372B2 (en) 2001-06-12 2004-09-28 Liebert Corporation Single or dual buss thermal transfer system
US6807056B2 (en) 2002-09-24 2004-10-19 Hitachi, Ltd. Electronic equipment
US6819563B1 (en) 2003-07-02 2004-11-16 International Business Machines Corporation Method and system for cooling electronics racks using pre-cooled air
US6896612B1 (en) 2004-01-26 2005-05-24 Sun Microsystems, Inc. Self-cooled electronic equipment enclosure with failure tolerant cooling system and method of operation
US20050128705A1 (en) 2003-12-16 2005-06-16 International Business Machines Corporation Composite cold plate assembly
US7012807B2 (en) 2003-09-30 2006-03-14 International Business Machines Corporation Thermal dissipation assembly and fabrication method for electronics drawer of a multiple-drawer electronics rack
US20060187638A1 (en) 2005-02-24 2006-08-24 Vinson Wade D System and method for liquid cooling of an electronic device
US7277282B2 (en) * 2004-12-27 2007-10-02 Intel Corporation Integrated circuit cooling system including heat pipes and external heat sink
US20070297136A1 (en) 2006-06-23 2007-12-27 Sun Micosystems, Inc. Modular liquid cooling of electronic components while preserving data center integrity
US7318322B2 (en) 2003-02-14 2008-01-15 Hitachi, Ltd. Liquid cooling system for a rack-mount server system
US20080029250A1 (en) 2006-06-01 2008-02-07 Andrew Carlson Warm Water Cooling
US20080068793A1 (en) 2006-09-19 2008-03-20 Fujitsu Limited Electronic equipment and rack apparatus
US7372698B1 (en) * 2006-12-21 2008-05-13 Isothermal Systems Research, Inc. Electronics equipment heat exchanger system
US7420804B2 (en) 2004-06-30 2008-09-02 Intel Corporation Liquid cooling system including hot-swappable components
US7438124B2 (en) 2005-10-04 2008-10-21 Delphi Technologies, Inc. Evaporative cooling system for a data-communications cabinet
US20090027856A1 (en) 2007-07-26 2009-01-29 Mccoy Scott Blade cooling system using wet and dry heat sinks
US20090056910A1 (en) 2007-08-30 2009-03-05 Paul Mallia Fluid cooled cabinet for electronic equipment
US20090080151A1 (en) 2007-09-25 2009-03-26 Sven Kalms Heat transfer system
US20090086434A1 (en) 2007-09-30 2009-04-02 Marc Hodes Recirculating Gas Rack Cooling Architecture
US7525207B2 (en) 2007-02-26 2009-04-28 Google Inc. Water-based data center
US20090126910A1 (en) 2007-11-19 2009-05-21 International Businiess Machines Corporation Apparatus and method for facilitating servicing of a liquid-cooled electronics rack
US20090126909A1 (en) 2007-11-19 2009-05-21 International Business Machines Corporation System and method for facilitating cooling of a liquid-cooled electronics rack
US20090154096A1 (en) 2007-12-17 2009-06-18 International Business Machines Corporation Apparatus and method for facilitating cooling of an electronics system
US20090161312A1 (en) 2006-02-16 2009-06-25 Liebert Corporation Liquid cooling systems for server applications
US7593227B2 (en) 2004-09-30 2009-09-22 International Business Machines Corporation Isolation valve and coolant connect/disconnect assemblies and methods of fabrication for interfacing a liquid cooled electronics subsystem and an electronics housing
US7599184B2 (en) 2006-02-16 2009-10-06 Cooligy Inc. Liquid cooling loops for server applications
US20090262495A1 (en) 2008-04-16 2009-10-22 Julius Neudorfer High efficiency heat removal system for rack mounted computer equipment
US20090284924A1 (en) 2008-05-15 2009-11-19 Sun Microsystems, Inc. Thermal transfer technique using heat pipes with integral rack rails
US20100032140A1 (en) 2008-08-06 2010-02-11 Sun Microsystems, Inc. Liquid cooled rack with optimized liquid flow path driven by electronic cooling demand
US20100085708A1 (en) 2008-10-07 2010-04-08 Liebert Corporation High-efficiency, fluid-cooled ups converter
WO2010054786A1 (en) 2008-11-14 2010-05-20 Knürr AG Method for cooling-air regulation in equipment cabinets and sensor arrangement
US7957132B2 (en) 2007-04-16 2011-06-07 Fried Stephen S Efficiently cool data centers and electronic enclosures using loop heat pipes
US8077463B2 (en) * 2009-05-27 2011-12-13 Hon Hai Precision Industry Co., Ltd. Heat dissipating system
US8094453B2 (en) 2009-09-30 2012-01-10 International Business Machines Corporation Compliant conduction rail assembly and method facilitating cooling of an electronics structure
US20120106071A1 (en) 2010-11-02 2012-05-03 International Business Machines Corporation Fluid cooling system and associated fitting assembly for electronic component
US8274787B2 (en) 2008-05-21 2012-09-25 Asetek A/S Thermal interposer liquid cooling system
US8427831B2 (en) 2010-09-02 2013-04-23 Hon Hai Precision Industry Co., Ltd. Server system with heat dissipation apparatus
US8437129B2 (en) 2010-11-23 2013-05-07 Inventec Corporation Server cabinet
US8441789B2 (en) 2010-10-29 2013-05-14 Industrial Technology Research Institute Data center module
US8493738B2 (en) 2011-05-06 2013-07-23 International Business Machines Corporation Cooled electronic system with thermal spreaders coupling electronics cards to cold rails

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6506111B2 (en) * 2001-05-16 2003-01-14 Sanmina-Sci Corporation Cooling airflow distribution device
US6981543B2 (en) * 2001-09-20 2006-01-03 Intel Corporation Modular capillary pumped loop cooling system
US6828675B2 (en) * 2001-09-26 2004-12-07 Modine Manufacturing Company Modular cooling system and thermal bus for high power electronics cabinets
DE20308158U1 (en) 2003-03-07 2003-07-31 Rittal Gmbh & Co Kg Liquid cooling system for cooling electronic units has liquid cooling units connected via branch points to common central liquid cooling system integrated into rack or cabinet
US7203063B2 (en) * 2004-05-21 2007-04-10 Hewlett-Packard Development Company, L.P. Small form factor liquid loop cooling system
CN1652678A (en) * 2005-02-23 2005-08-10 大连大学 Non-noise electronic classroom system
US9496200B2 (en) * 2011-07-27 2016-11-15 Coolit Systems, Inc. Modular heat-transfer systems
WO2009131810A2 (en) 2008-04-21 2009-10-29 Hardcore Computer, Inc. A case and rack system for liquid submersion cooling of electronic devices connected in an array
US7639499B1 (en) 2008-07-07 2009-12-29 International Business Machines Corporation Liquid cooling apparatus and method for facilitating cooling of an electronics system
US7944694B2 (en) 2008-10-23 2011-05-17 International Business Machines Corporation Liquid cooling apparatus and method for cooling blades of an electronic system chassis
US20110056675A1 (en) 2009-09-09 2011-03-10 International Business Machines Corporation Apparatus and method for adjusting coolant flow resistance through liquid-cooled electronics rack(s)
CN105828574B (en) * 2010-08-26 2018-09-21 阿塞泰克丹麦公司 Cooling system for computer server chassis
US9155230B2 (en) * 2011-11-28 2015-10-06 Asetek Danmark A/S Cooling system for a server

Patent Citations (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6796372B2 (en) 2001-06-12 2004-09-28 Liebert Corporation Single or dual buss thermal transfer system
US20030128525A1 (en) 2002-01-04 2003-07-10 Berry William E. Computer system which locks a server unit subassembly in a selected position in a support frame
US6807056B2 (en) 2002-09-24 2004-10-19 Hitachi, Ltd. Electronic equipment
US20040095721A1 (en) 2002-11-20 2004-05-20 International Business Machines Corporation Frame level partial cooling boost for drawer and/or node level processors
US7318322B2 (en) 2003-02-14 2008-01-15 Hitachi, Ltd. Liquid cooling system for a rack-mount server system
US6763880B1 (en) 2003-06-26 2004-07-20 Evserv Tech Corporation Liquid cooled radiation module for servers
US6819563B1 (en) 2003-07-02 2004-11-16 International Business Machines Corporation Method and system for cooling electronics racks using pre-cooled air
US7012807B2 (en) 2003-09-30 2006-03-14 International Business Machines Corporation Thermal dissipation assembly and fabrication method for electronics drawer of a multiple-drawer electronics rack
US20050128705A1 (en) 2003-12-16 2005-06-16 International Business Machines Corporation Composite cold plate assembly
US6896612B1 (en) 2004-01-26 2005-05-24 Sun Microsystems, Inc. Self-cooled electronic equipment enclosure with failure tolerant cooling system and method of operation
US7420804B2 (en) 2004-06-30 2008-09-02 Intel Corporation Liquid cooling system including hot-swappable components
US7593227B2 (en) 2004-09-30 2009-09-22 International Business Machines Corporation Isolation valve and coolant connect/disconnect assemblies and methods of fabrication for interfacing a liquid cooled electronics subsystem and an electronics housing
US7277282B2 (en) * 2004-12-27 2007-10-02 Intel Corporation Integrated circuit cooling system including heat pipes and external heat sink
US20060187638A1 (en) 2005-02-24 2006-08-24 Vinson Wade D System and method for liquid cooling of an electronic device
US7438124B2 (en) 2005-10-04 2008-10-21 Delphi Technologies, Inc. Evaporative cooling system for a data-communications cabinet
US8289710B2 (en) 2006-02-16 2012-10-16 Liebert Corporation Liquid cooling systems for server applications
US7599184B2 (en) 2006-02-16 2009-10-06 Cooligy Inc. Liquid cooling loops for server applications
US20090161312A1 (en) 2006-02-16 2009-06-25 Liebert Corporation Liquid cooling systems for server applications
US20080029250A1 (en) 2006-06-01 2008-02-07 Andrew Carlson Warm Water Cooling
US20070297136A1 (en) 2006-06-23 2007-12-27 Sun Micosystems, Inc. Modular liquid cooling of electronic components while preserving data center integrity
US20080068793A1 (en) 2006-09-19 2008-03-20 Fujitsu Limited Electronic equipment and rack apparatus
US7372698B1 (en) * 2006-12-21 2008-05-13 Isothermal Systems Research, Inc. Electronics equipment heat exchanger system
US7525207B2 (en) 2007-02-26 2009-04-28 Google Inc. Water-based data center
US7957132B2 (en) 2007-04-16 2011-06-07 Fried Stephen S Efficiently cool data centers and electronic enclosures using loop heat pipes
US20090027856A1 (en) 2007-07-26 2009-01-29 Mccoy Scott Blade cooling system using wet and dry heat sinks
US20090056910A1 (en) 2007-08-30 2009-03-05 Paul Mallia Fluid cooled cabinet for electronic equipment
US20090080151A1 (en) 2007-09-25 2009-03-26 Sven Kalms Heat transfer system
US20090086434A1 (en) 2007-09-30 2009-04-02 Marc Hodes Recirculating Gas Rack Cooling Architecture
US20090126910A1 (en) 2007-11-19 2009-05-21 International Businiess Machines Corporation Apparatus and method for facilitating servicing of a liquid-cooled electronics rack
US20090126909A1 (en) 2007-11-19 2009-05-21 International Business Machines Corporation System and method for facilitating cooling of a liquid-cooled electronics rack
US7757506B2 (en) 2007-11-19 2010-07-20 International Business Machines Corporation System and method for facilitating cooling of a liquid-cooled electronics rack
US20090154096A1 (en) 2007-12-17 2009-06-18 International Business Machines Corporation Apparatus and method for facilitating cooling of an electronics system
US20090262495A1 (en) 2008-04-16 2009-10-22 Julius Neudorfer High efficiency heat removal system for rack mounted computer equipment
US20090284924A1 (en) 2008-05-15 2009-11-19 Sun Microsystems, Inc. Thermal transfer technique using heat pipes with integral rack rails
US8274787B2 (en) 2008-05-21 2012-09-25 Asetek A/S Thermal interposer liquid cooling system
US20100032140A1 (en) 2008-08-06 2010-02-11 Sun Microsystems, Inc. Liquid cooled rack with optimized liquid flow path driven by electronic cooling demand
US20100085708A1 (en) 2008-10-07 2010-04-08 Liebert Corporation High-efficiency, fluid-cooled ups converter
WO2010054786A1 (en) 2008-11-14 2010-05-20 Knürr AG Method for cooling-air regulation in equipment cabinets and sensor arrangement
US8077463B2 (en) * 2009-05-27 2011-12-13 Hon Hai Precision Industry Co., Ltd. Heat dissipating system
US8094453B2 (en) 2009-09-30 2012-01-10 International Business Machines Corporation Compliant conduction rail assembly and method facilitating cooling of an electronics structure
US8427831B2 (en) 2010-09-02 2013-04-23 Hon Hai Precision Industry Co., Ltd. Server system with heat dissipation apparatus
US8441789B2 (en) 2010-10-29 2013-05-14 Industrial Technology Research Institute Data center module
US20120106071A1 (en) 2010-11-02 2012-05-03 International Business Machines Corporation Fluid cooling system and associated fitting assembly for electronic component
US8437129B2 (en) 2010-11-23 2013-05-07 Inventec Corporation Server cabinet
US8493738B2 (en) 2011-05-06 2013-07-23 International Business Machines Corporation Cooled electronic system with thermal spreaders coupling electronics cards to cold rails

Non-Patent Citations (8)

* Cited by examiner, † Cited by third party
Title
Declaration of Himanshu Pokharna, Ph.D., in Inter Partes Review Case No. 2014-01172, dated Jul. 16, 2014, (71 pages).
HP Modular Cooling System: Technology Overview and Application Brief, © 2006 Hewlett-Packard Development Company, L.P., (13 pages).
International Search Report and Written Opinion for International Application No. PCT/US2011/048735 dated Dec. 2, 2011, 12 pages.
Notice of Allowance from U.S. Appl. No. 14/186,397, mailed Apr. 3, 2014, (7 pages).
Patterson, Michael K et al., The State of Data Center Cooling, A Review of Current Air and Liquid Cooling Solutions, Intel Corporation, Mar. 2008, (12 pages).
Petition for Inter Partes Review of U.S Patent No. 8,749,968, filed Jul. 16, 2014, (61 pages).
Random House Webster's College Dictionary, Random House, Inc., New York, 2000, p. 230, (3 pages).
U.S. Appl. No. 61/377,249, filed Aug. 26, 2010, (23 pages).

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9913409B2 (en) * 2015-06-26 2018-03-06 Microsoft Technology Licensing, Llc Intrusion detection for submerged datacenters
US10524395B2 (en) 2015-06-26 2019-12-31 Microsoft Technology Licensing, Llc Artificial reef datacenter
US20160378981A1 (en) * 2015-06-26 2016-12-29 Microsoft Technology Licensing, Llc Intrusion detection for submerged datacenters
US11574372B2 (en) * 2017-02-08 2023-02-07 Upstream Data Inc. Blockchain mine at oil or gas facility
US20200051184A1 (en) * 2017-02-08 2020-02-13 Upstream Data Inc. Blockchain mine at oil or gas facility
US20240078616A1 (en) * 2017-02-08 2024-03-07 Upstream Data Inc. Blockchain mine at oil or gas facility
US10037062B1 (en) 2017-03-17 2018-07-31 Microsoft Technology Licensing, Llc Thermal venting device with pressurized plenum
US20180270990A1 (en) * 2017-03-20 2018-09-20 International Business Machines Corporation Two-phase liquid cooled electronics
US10244655B2 (en) * 2017-03-20 2019-03-26 International Business Machines Corporation Two-phase liquid cooled electronics
US10499543B2 (en) * 2017-03-20 2019-12-03 International Bustness Machines Corporation Two-phase liquid cooled electronics
US10701832B2 (en) 2017-03-20 2020-06-30 International Business Machines Corporation Two-phase liquid cooled electronics
CN111107732A (en) * 2018-10-29 2020-05-05 广达电脑股份有限公司 Method for maintaining server cabinet within predetermined temperature range and cooling system thereof
US11147191B2 (en) * 2018-10-29 2021-10-12 Quanta Computer Inc. Liquid cooling with outdoor chiller rack system
CN111107732B (en) * 2018-10-29 2022-10-04 广达电脑股份有限公司 Method for maintaining server cabinet within predetermined temperature range and cooling system thereof
US10746084B2 (en) * 2018-12-13 2020-08-18 General Electric Company Liquid driven thermal module and thermal management system
US20200191042A1 (en) * 2018-12-13 2020-06-18 General Electric Company Liquid driven thermal module and thermal management system
US11907029B2 (en) 2019-05-15 2024-02-20 Upstream Data Inc. Portable blockchain mining system and methods of use
US10925187B1 (en) * 2019-08-30 2021-02-16 Dell Products, L.P. Remote heat exchanger arm for direct contact liquid cooling for rack mounted equipment

Also Published As

Publication number Publication date
EP2609800A1 (en) 2013-07-03
US8749968B1 (en) 2014-06-10
US20180160566A1 (en) 2018-06-07
HK1222973A1 (en) 2017-07-14
ES2769605T3 (en) 2020-06-26
HK1187191A1 (en) 2014-03-28
US9907206B2 (en) 2018-02-27
US20140168889A1 (en) 2014-06-19
US8724315B2 (en) 2014-05-13
US20140246178A1 (en) 2014-09-04
WO2012027319A1 (en) 2012-03-01
CN105828574A (en) 2016-08-03
CN103168509B (en) 2016-03-23
DK2609800T3 (en) 2020-02-24
PL2609800T3 (en) 2020-05-18
US10136551B2 (en) 2018-11-20
CN103168509A (en) 2013-06-19
US20110303394A1 (en) 2011-12-15
CN105828574B (en) 2018-09-21
EP2609800B1 (en) 2019-11-20
US20150319883A1 (en) 2015-11-05
WO2012027319A8 (en) 2012-05-18

Similar Documents

Publication Publication Date Title
US10136551B2 (en) Liquid cooling system for server
US10212857B2 (en) Cooling system for a server
CN110446396B (en) Liquid cooling system for data center
US8929080B2 (en) Immersion-cooling of selected electronic component(s) mounted to printed circuit board
US8760863B2 (en) Multi-rack assembly with shared cooling apparatus
US9185830B2 (en) Thermoelectric-enhanced, liquid-based cooling of a multi-component electronic system
US8514575B2 (en) Multimodal cooling apparatus for an electronic system
US9132519B2 (en) Directly connected heat exchanger tube section and coolant-cooled structure
US8913384B2 (en) Thermal transfer structures coupling electronics card(s) to coolant-cooled structure(s)
US8937810B2 (en) Electronic assembly with detachable coolant manifold and coolant-cooled electronic module

Legal Events

Date Code Title Description
AS Assignment

Owner name: ASETEK DANMARK A/S, DENMARK

Free format text: CHANGE OF NAME;ASSIGNOR:ASETEK A/S;REEL/FRAME:033748/0097

Effective date: 20130122

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: ASETEK A/S, DENMARK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BRANTON, STEVEN B.;REEL/FRAME:044580/0159

Effective date: 20110816

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20230721