WO2015156817A1

WO2015156817A1 - Liquid coolant supply

Info

Publication number: WO2015156817A1
Application number: PCT/US2014/033756
Authority: WO
Inventors: John Franz; Tahir Cader; Cullen E Bash; Niru Kumari; Sarah Anthony; Sergio Escobar-Vargas; Siamak Tavallaei
Original assignee: Hewlett-Packard Development Company, L. P.
Priority date: 2014-04-11
Filing date: 2014-04-11
Publication date: 2015-10-15
Also published as: EP3130209A1; EP3130209B1; CN106165556B; US20170017277A1; TWI560541B; CN106165556A; US20190227606A1; EP3130209A4; TW201546602A

Abstract

Apparatuses associated with liquid coolant supply are disclosed. One example apparatus is a computing cartridge which includes a first electronic device and a liquid-cooled cold plate. The computing cartridge also includes a first thermal couple between the first electronic device and the cold plate. The computing cartridge also includes an inlet fluid connector. The inlet fluid connector may supply a liquid coolant to the cold plate. The computing cartridge also includes an outlet fluid connector. The outlet fluid connector may facilitate return of the coolant from the cold plate

Description

LIQUID COOLANT SUPPLY

BACKGROUND

[00013 Cooling electronics in data centers often constrains the amount of processing that can be achieved in the data center, This is because devices may he damaged if they overheat. Thus, heat is typically siphoned away from electronic devices via a combination of air conditioning, fans, and heat sinks. This may create a tradeoff because as processing increases and more power is used, more cooling may be needed:.

BRIEF DESCRIPTION OF THE DRAWINGS

[00023 The present application may be more fully appreciated in connection with the following detailed description taken in conjunction with the accompanying drawings.

[00033 ¾ illustrates an example computing cartridge associated with liquid coolant supply,

[0004] Fig. 2 illustrates another example computing cartridge associated with liquid coolant supply.

[Q0OSJ FIG. 3 illustrates an example chassis associated with liquid coolant supply.

[0006| FIG. 4 illustrates another example chassis associated with liquid cooiant supply,

[00073 FIG. 5 illustrates another example chassis associated with liquid cooiant supply.

[00083 PSG- 6 illustrates an example rack system associated with liquid cooiant supply. DETAILED DESCRIPTION

[00093 Apparatuses associated with liquid coolant suppiy are described, in various examples, processors and other heat generating components on a computing cartridge may be connected via a thermal couple to a liquid cooled cold plate. The cold plate may be Inlaid with channels through which a liquid coolant may fiow to facilitate heat transfer away from the heat generating components. The cartridge may aiso include fluid connectors to supply liquid cooiant to the cold piate and to return heated cooiant from the cold p!ate. Additionally, to incorporate liquid cooling into cartridges, chassis in which the cartridges are sealed may aiso be configured with fluid connectors and corresponding fluid supply and return manifolds. To ensure suppiy of liquid cooiant to chassis that facilitate suppiy of liquid coolant to its cartridges, a rack that facilitates supply of liquid coolant to the chassis is also disclosed. Fluid connectors described above may operate via blind mating, and may be hot plug capable to allow manipulation of a cartridge while other cartridges are operating.

[00103 It is appreciated that, in the following description, numerous specific details are set forth to provide a thorough understanding of the examples. However, it is appreciated that the examples may be practiced without limitation to these specific details. In other instances, well-known methods and structures may not be described in detail to avoid unnecessarily obscuring the description of the examples. Aiso, the examples ma be used in combination with each other.

[0011] Figure 1 illustrates an example computing cartridge 100 associated with liquid cooiant supply. As illustrated, cartridge 100 is a top-loading computing cartridge that fits into a siot configured to receive cartridge 100 from above. The slot may reside within a chassis. Aiternative configurations that allow cartridge 100 to be inserted into a chassis and/or into a rack from other directions (e.g., the front) may also be possible.

£00 23 Cartridge 100 Includes a liquid cooled cold plate 110. Cartridge 100 also includes a first electronic device 120. First electronic device may be, for example, a processor, a graphical processing unit, memory (e.g., DRAM), systems on chip i&OC).. system in package (SIP), and so forth. Cartridge 100 also includes a first thermal couple 130 between first electronic device 120 and cold plate 1 10. Thermal couple 130 may be, for example, a physical contact between first electronic device 120 and cold plate 1 10, thermal paste, a heat sink, and so forth. In Figure 1 , a single coid plate 1 10 is illustrated essentially on top of first electronic device 120 such that first electronic device 120 is sandwiched between cold plate 110 and a plane of cartridge 100 to which first electronic device 120 is electronically attached. Other configurations are also possible, for example, where cartridge 100 has two cold plates that sandwich first electronic device 120.

[0013J Cartridge 100 also includes an inlet fluid connector 140. Inlet fluid connector 140 may be hot-plug capable. Conventionally, a connector is considered hot plug capable if initiating or breaking a connection does not cause a disruption to other system components. Inlet fluid connector 140 may also be configured to operate via a blind mate. As used herein, a blind mate connector is a connector that automatically aligns itself to a corresponding connector when connection between the blind mate connecto and the corresponding connector is initiated. Blind mate connectors may be used when it is difficult to feel or see that connectors are properly aligned. Thus, when cartridge 100 is inserted into a slot adapted to house cartridge 100, inlet fluid connector may automatically align itself with a corresponding blind mate fluid connector in the slot to ensure an effective connection between these two connectors. Inlet fluid connector 140 may facilitate supply of a liquid coolant to the cold plate 1 10. The liquid coolant may be, for example, water, dielectric fluid, refrigerant, and so forth.

[00143 Cartridge 100 also includes an outlet fluid connector 150. Outlet fluid connector ma also be hot-plug capable and/or configured to operate via a blind mate. Outlet fluid connector 150 may facilitate return of the liquid coolant from the cold plate. In this example, inlet fluid connector 140 is attached to cold plate 110 at a first corner, and outlet fluid connector 150 is attached to cold plate 110 at a second corner, the first and second corners being diagonally opposite one another o cold plate 110. However, other configurations of inlet fluid connector 140 and outlet fluid connector 150 relative to one another on cold plate 110 are possible.

[0015] In this example, liquid coolant may flow from inlet fluid connector 140 to outlet fluid connector 150 through cold plate 1 10. Here, flow paths 180 illustrate one possible path of liquid coolant flow through cold plate 10. Other flow paths are possible, and may depend on the placement of inlet fluid connector 140 and outlet fluid connector 150 reiative to one another. By way of illustration, in figure 100, inlet fluid connector 140 and outlet fluid connector 150 are illustrated as being at diagonally opposite corners of cold plate 10, In this example, flow paths 180 illustrate that liquid coolant generally flows up and to the left within cold plate 10 as illustrated. However, different flow paths may be appropriate if inlet fluid connector 140 and outlet fluid connector 150 reside in the same comer of cold plate 1 0 (e.g., the lower right corner of cold plate 110), at horizontally or vertically opposite corners of cold plate 110, or at other locations on cold plate 110.

[0016] Additionally, as illustrated, flow paths 160 are intended to show a general path a liquid coolant may take through cold plate 110 for the configuration of inlet fluid connector 140 and outlet fluid connector 150 as illustrated in this example. Thus, though fluid channels may be embedded within cold plate 110 along illustrated flow paths 160, alternative fluid channels may also be embedded. For example, though flow paths 160 are shown as going around first electronic device 120, it may be possible to achieve improved heat transfer from first electronic device 120 to the liquid coolant if fluid channels are embedded within cold plate 110 over first electronic device 120 and/or first thermal couple 130, Further, flow path 160 may be achieved via a hollow cavity within cold plate 1 10 through which liquid coolant flows, rather than channels embedded within cold plate 110. The viability a hollow cavity may depend on the relative positions of inlet fluid connector 140 and outlet connector 150 to one another on cold plate 110.

[00173 Cartridge 100 also includes latches 199 to facilitate securing cartridge 100 to a chassis in which cartridge 100 resides. Cartridge 100 also includes electronic connectors 197 which may connect to corresponding electronic connectors within the chassis. Electronic connectors 197 may facilitate communication between electronic devices residing on cartridge 100 (e.g., first electronic device 120} and other devices externa! to cartridge 100. These may include other devices within the chassis within which cartridge 100 resides, other devices within a rack within which cartridge 100 resides, other devices connected to a network (e.g., the lnternet)to which cartridge 100 is connected, and so forth. Cartridge 100 also includes an interface 198 which may display information regarding the status (e.g., on, off, health information) of components (e.g., first electronic device 120) of cartridge 100. Interface 198 may also include, for example, buttons (e.g., power on, power off) to control operation of components of cartridge 100. Cartridge 100 may also include additional components including circuits, connectors, chipsets, and so forth (not shown) to support functionality of first electronic device 120, and/or other components on electronic device 120,

[0018| Using liquid coolants to coo! electronic devices may allow more electronic devices to operate within a single cartridge, chassis, and/or rack. By way of illustration, air cooling a rack using some conventional techniques may use 100 cubic feet per minute (CFM) of air to cool 1 kilowatt (kW) of power consumed by the rack. Thus, a rack consuming 80 kW may require 8000 CFM of air to cool the rack. If a data center can deliver 800-1000 CFM of air flow across the approximate area that the space of a rack takes up, the space of 6-7 racks may be required to cool a 60 kW rack using only air cooling. If only one eighth of the space in a data center is usable for racks, air cooling may be space inefficient, thereby increasing the costs of building a data center. On the other hand, using liquid coolants may reduce the amount of power that is siphoned off via air cooling to as little as 20% to 30% or lower. Thus for the 80 kW rack reduced to 20% air cooling, on!y 1200 CFM of air may be necessary, thereby saving data center space.

J0019J This level of cooling via liquid cooling may be achieved because, for example, cooling electronic devices using water may achieve a thermal resistanc of 0.1 centigrade/watt. Thus, even a cartridge outputting up to 250 watts of power may onl increase water temperature 25 degrees, which may even allow room temperature or above (e.g., 30" centigrade) fluids to be used as liquid coolants. In fact, temperature rise of the water may foe even lower because power consumption, and thereiore temperature rise, may be spread out over face the cartridge, which may cause heat to transfer to water flowing along different flow paths 160 across cartridge 100.

[0020J f gure 2 illustrates an example computing cartridge 200 associated with liquid coolant supply. Cartridge 200 includes several elements similar to those described with reference to cartridge 100 (Figure 1 above). For example, Cartridge 200 includes a first electronic device 220 attached via a thermal couple 230 to a cold plate 210. An inlet fluid connector 240 may supply liquid coolant to cold plate 210, and an outlet fluid connector 250 may facilitate return of the liquid coolant to cold plate 210. The liquid coolant may flow through cold plate 210 along flow paths 260. Cartridge 200 also includes latches 299, electronic connectors 297, and an interface 298, Cartridge 200 also includes additional elements.

[0021] Cartridge 200 also includes several additional electronic devices including second electronic device 222, third electronic device 224, and fourth electronic device 226, These electronic devices are attached to cold plate 210 via thermal couples 232, 234, and 236 respectively. In one example, electronic devices 220, 222, 224, and 226 may be a set of electronic devices configured to optimize performance of a specific application. By way of illustration, if cartridge 200 is designed to serve as a web server, first electronic device 220 may serve as a data store (e.g., hard disk, solid state drive) on which web content is stored, and electronic devices 222, 224, and 228 may be processors thai receive and/or respond to incoming requests for system resources.

[0022 Cartridge 200 also includes an air-cooled electronic device 270. In one example, air cooled electronic device 270 may consume less power than electronic devices (e.g., 220, 222, 224, 226) which are cooled via cold plate 210.

[00233 Figure 3 illustrates an example chassis 300 associated with liquid coolant supply. Chassis 300 includes several slots 310, 312, 314 configured to receive top-loading computing cartridges. Though a chassis configured to receive top-loading computing cartridges is illustrated, a chassis may be configured to receive cartridges from other directions. The top-loading computing cartridges may be, for example, cartridges 100 and/or 200 described above in the descriptions of Figures 1 and 2 respectively. Slot 310 includes a supply fluid connector 325. Supply fiuid connector 325 may mate with a first fiuid connector on a top-loading computing cartridge (e.g., cartridge 100, cartridge 200). Supply fluid connector 325 may be attached to, for example, chassis 300 or to a backplane of chassis 300. Slot 310 also Includes a return fluid connector 320. Return fluid connector 320 may mate with a second fluid connector on the top-loading computing cartridge. Return fluid connector 320 may be attached to, for example, chassis 300 or to a backplane of chassis 300. Slots 312 and 314, and other slots (not shown), ma also have supply fiuid connectors and return fluid connectors (not shown) that facilitate providing liquid coolant to cartridges inserted within their respective slots. In one example, the first fluid connector, the second fluid connector, supply fluid connector 325, and return fluid connector 320 may be blind mate fluid connectors that facilitate hot-plug installment of the top-loading computing cartridge (e.g. , cartridge 100, cartridge 200),

[0024] Chassis 300 also includes a chassis supply manifold 335 to facilitate supply of liquid coolant to suppiy fluid connectors (e.g., supply fluid connector 325). Chassis 300 also includes a chassis return manifold 330 to facilitate return of liquid coolant from return fluid connectors (e.g., return fluid connector 320).

£00253 *ⁿ Figu e 3, supply fluid connector 325 and return fluid connector 320 are illustrated as connecting to fluid connectors on cartridges (e.g., cartridge 100, cartridge 200) that are at diagonall opposite corners of the cartridge. However, as described above, this is not the only possible configuration of fluid connectors on a cartridge. Consequently, supply fluid connector 325 and return fluid connector 320 may reside at different locations within slot 310, depending on where fiuid connectors on cartridges designed to fit within slot 310 reside. Similarly, the locations and/or paths of chassis supply manifold 335 and chassis return manifold 330 may also depend on cartridge design,

[00263 Chassis 300 also includes a movable mounting 380, Movable mounting 360 may allow chassis 300 to sit at a retracted position inside a rack structure and at an extend position granting access to the set of siots. In one example, the mountings may operate similarly to rails used in, for example, a kitchen drawer. However; other mountings are possible. Chassis 300 aiso includes an extending supply hose 345. Extending supply hose 345 may ensure connection of chassis supply manifold 335 to a rack supply manifold associated with the rack structure at both the retracted position and the extended position. Chassis 300 also includes an extending return hose 340, Extending return hose 340 may ensure connection of chassis return manifold 330 to a rack return manifold associated with the rack structure at both the retracted position and the extended position. In one example, extending supply hose 345 and extending return hose 340 may have accordion ioop structures.

[00273 Chassis 300 also includes a fan 350. Fan 350 may air cool an electronic device on a top-loading computing cartridge (e.g., cartridge 100, cartridge 200) within a slot (e.g., slot 310). In addition to slots (e.g., 310, 312, 314) that house cartridges, chassis 300 also includes a module bay 399, Module bay 399 may serve as a bay for a power distribution unit, a switch, and/or other components depending on the configuration of chassis 300 and/or cartridges residing within chassis 300. A power distribution unit may distribute power to cartridges in their respective siots white the cartridges are operating. A switch may route communications between cartridges within chassis 300, between a cartridge within chassis 300 and cartridges externa! to chassis 300 (e.g., other cartridges within a rack within which chassis 300 resides), between a cartridge within 300 and a computer over a network (e.g., the Internet, a local area network, a virtual private network), and so forth.

[0028] Figur 4 and Figure 5 illustrate further examples of a chassis (400, 500) associated with liquid coolant supply. Specifically, Figures 4 and 5 illustrate how an extending supply hoses (440, 540) and movable mountings (430, 530) may interact to maintain respective connections between supply and return manifolds within the chassis (400, 500) and a rack supply manifold (490, 590) and a rack return manifold (492, 592) associated with a rack (499, 599). £0020] Thus, Figure 4 illustrates a top-down view of a chassis 400 seated at a retracted position within a rack structure 499. Chassis 400 includes several siots 410 in which cartridges (e.g., cartridge 100, cartridge 200) may be seated- The cartridges may be inserted into the slots 410 from above. Chassis 400 also inciudes a module bay 420 in which other devices may be stored (e.g., a switch). Alternative configurations of chassis 400 may a!so be possible with different numbers, sizes, and/or positions of cartridge slots 410 and module bay(s) 420.

[00303 Chassis 400 also includes movable mountings 430. In this example, chassis 400 and mountings 430 are illustrated at a retracted position. At the retracted position, access to slots 410 and bay 420 may be difficult if several chassis are arranged on top of one another within rack structure 499. Thus, mountings for 430 may allow the chassis to extend out from rack structure 499 (e.g. , at a position illustrated in figure 5), This may allow easier access to the slots 410 allowing, for example, cartridges to be removed, inserted, or otherwise manipulated (e.g., for maintenance purposes).

[003 3 Chassis 400 may also have fluid supply and return manifolds (not shown) that facilitate transfer of liquid coolant to and from devices inserted into slots 410 and/or bay 420. To ensure connection of the chassis supply manifold to a rack supply manifold 490, and the chassis return manifold to a rack return manifold 492, chassis 400 may also have extendable hoses 440 to connect the respective manifolds. In one example, at the retracted position of chassis 400 within rack structure 499, the extendable hoses 440 may essentially resid within the structure of chassis 400. In some circumstances however, it may be appropriate for the hoses 440 to sit outside of chassis 400. Chassis 400 also includes several fans 450 which may serve to air cooi electrical components (e.g., on cartridges within slots 410).

[00323 Figure 5 illustrates an example chassis 500. Chassis 500 includes several components similar to those described with reference to chassis 400 (Figure 4 above). For example, chassis 500, which sits within a rack structure 599, inciudes several slots 510, a bay 520, and several fans 550. Chassis 500 also includes movable mountings 530, which are shown as being in an extended position allowing access to slots 5 0 and bay 520. Because chassis 500 at the extended position is farther away from rack supply manifold 590 and from rack return manifold 592, extendable hoses 540 extend to maintain respective connection between fluid supply and return manifolds within chassis 500 and rack supply manifoid 590 and rack supply manifoid 592.

[00333 Because the supply (and return) of liquid coolant is facilitated by extendable hoses 540, cartridges within slots 510 may be able to continue receiving cooling even though other cartridges are being manipulated (e.g., inserted, removed, serviced).

[0034 Figure 6 illustrates an example rack system 800 associated with liquid coolant supply. Rack system 800 includes an enclosure having first wail 810 and a second wall 820, Within the enclosure of rack system 800 may be one or more chassis 690. Chassis 690 may include several slots 699 in which computing cartridges may reside. The cartridges may be similar to cartridges 100 and 200 (described above in Figures 1 and 2 respectively). Thus the cartridges may have electronic devices which are cooled by li uid cooling techniques. To ensure liquid coolant transfer to and from a cartridge sitting within slot 699, chassis 690 may transfer liquid coolant along chassis supply and return manifolds (not shown). Chassis 6Θ0 may be seated on movable mountings 830» which may allow chassis 690 to sit retracted within rack structure 600 or extended out from rack structure 600, allowing access to slots (e.g., slot 699) within chassis 690.

[00353 Rack system 600 includes a fluid supply manifold 640 to facilitate supply of a liquid coolant to chassis 890. Similarly, rack system 600 includes a fluid return manifold 650 to facilitate return of the liquid coolant from the chassis. In one example, fluid supply manifold 840 and fluid return manifold 850 may permit unobstructed air flow to the chassis. Further, fluid supply manifold 640 and fluid return manifold 850 may be held separate from a signal line (not shown) that provides signal to the chassis (e.g., Ethernet) and/or a power line (not shown) that provides power to the chassis. In this example, fluid supply manifold 640 and fluid return manifold 850 may be affixed to first wail 610, However, different configurations may be appropriate.

[00363 Because chassis 690 may sit retracted within rack structure 600 and extended out from rack structure 600, rack system 600 also includes fluid supply and return hoses 695 to maintain respective connections between chassis supply and return manifolds within chassis 690, and supply manifold 640 and return manifold 650, Supply manifold 640 and return manifoid 650 may also be attached to plumbing (e.g., pipes, hoses) in a data center within which rack structure 600 resides.

[00373 It is appreciated that the previous description of the disclosed examples is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these examples will be reads iy apparent to those skilled in the art, and the generic principles defined herein may be applied to other examples without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the examples shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

WHAT iS CLAIMED IS:

1. A computing cartridge, comprising:

a first electronic device;

a liquid-cooled cold plate;

a first thermal couple between the first electronic device and the cold plate; an inlet fluid connector to facilitate supply of a liquid coolant to the cold plate; and

an outlet fluid connector to facilitate return of the liquid coolant from the cold plate.

2. The computing cartridge of claim 1 , comprising:

a second electronic device; and

a second thermal couple between the second electronic device and the cold plate.

3. The computing cartridge of claim 1. comprising an air cooled electronic device.

4. The computing cartridge of claim 1 , where the iniet fluid connector is a hot-plug capabie blind mate connector, and where the outlet fluid connector is a hot- plug capable blind mate connector.

5. The computing cartridge of claim 1 , where the liquid coolant flows through fluid channels within the cold plate, and where the channels connect the inlet fluid connector and the outlet fluid connector.

8. The computing cartridge of claim 1 , where the first electronic device is a member of a set of electronic devices on the computing cartridge, and where the set of electronic devices optimize performance of a specific application.

7, The computing cartridge of claim 1 , where the computing cartridge is a top-loading computing cartridge,

8, A chassis, comprising;

a set of slots configured to receive computing cartridges, where a slot comprises:

a supply fluid connector that mates with a first fluid connector on a computing cartridge; and

a return fluid connector that mates with a second fluid connector on the computing cartridge;

a movable mounting allowing the chassis to sit at a retracted position inside a rack structure and at an extended position granting access to the set of siots;

a chassis supply manifoid to facliitate supply of a liquid coolant to the suppiy fluid connector;

a chassis return manifold to facilitate return of the liquid coolant from the return fluid connector;

an extending supply hose to ensure connection, at both the retracted position and the extended position, of the chassis supply manifold to a rack suppiy manifold associated with the rack structure; and

an extending return hose to ensure connection, at both the retracted position and the extended position, of the chassis return manifoid to a rack return manifold associated with the rack structure.

9, The chassis of claim 8, where the extending supply hose has an accordion loop structure and where the extending return hose has an accordion loop structure.

10. The chassis of claim 8, where the supply fluid connector is attached to one of the chassis and a backplane of the chassis, and where the return fluid connector is attached to one of the chassis and the backplane of the chassis.

11. The chassis of claim 8, comprising a fan to air cool an electronic device on trie computing cartridge.

12. The chassis of claim 8» where the first fluid connector, the second fluid connector, the supply fluid connector, and the return fluid connector are blind mate fluid connectors that facilitate hot-plug installment of the computing cartridge.

13. A rack system, comprising:

an enclosure having first wall and a second wall;

a fluid supply manifold to facilitate supply of a liquid coolant to a chassis mounted between the first wall and the second wall; and

a fluid return manifold to facilitate return of the liquid; coolant from the chassis: where the fluid supply manifold and the fluid return manifold permit unobstructed air fiow to the chassis, and where the fluid supply manifoid and the fluid return manifold are held separate from one or more of. a signal Sine providing signal to the chassis, and a power line providing power to the chassis.

14. The rack system of claim 13, where the chassis is movabty mounted within the enclosure,

15. The rack system of ciaim 3, where the fluid supply manifold and the fluid return manifold are affixed to the first waii.