WO2014130891A1 - Liquid cooled modular data center - Google Patents

Liquid cooled modular data center Download PDF

Info

Publication number
WO2014130891A1
WO2014130891A1 PCT/US2014/017835 US2014017835W WO2014130891A1 WO 2014130891 A1 WO2014130891 A1 WO 2014130891A1 US 2014017835 W US2014017835 W US 2014017835W WO 2014130891 A1 WO2014130891 A1 WO 2014130891A1
Authority
WO
WIPO (PCT)
Prior art keywords
tanks
data processing
shipping container
coolant
data center
Prior art date
Application number
PCT/US2014/017835
Other languages
French (fr)
Inventor
Christiaan Scott Best
Original Assignee
Green Revolution Cooling, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Green Revolution Cooling, Inc. filed Critical Green Revolution Cooling, Inc.
Priority to EP14754702.0A priority Critical patent/EP2959357A4/en
Publication of WO2014130891A1 publication Critical patent/WO2014130891A1/en

Links

Classifications

    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05KPRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K7/00Constructional details common to different types of electric apparatus
    • H05K7/20Modifications to facilitate cooling, ventilating, or heating
    • H05K7/20709Modifications to facilitate cooling, ventilating, or heating for server racks or cabinets; for data centers, e.g. 19-inch computer racks
    • H05K7/20763Liquid cooling without phase change
    • H05K7/2079Liquid cooling without phase change within rooms for removing heat from cabinets

Definitions

  • This application concerns data processing centers housed in shipping containers.
  • Data centers are normally housed in conventional building structures and use air conditioning systems to remove heal generated by electronic components (chips, hard drives, cards, etc).
  • the term "data center” loosely refers to a physical location housing one o more data processing modules.
  • data processing module generally refers to one or more computing devices running software configured to receive requests, typically over a network
  • a data processing module may include one or more servers connected to a network and running software configured to receive requests from other computing devices on the network, which may include other servers, and desktop and mobile computing devices, including cellular phones.
  • Such data processing modules typically include one or more processors, memory, input/output connections to a network and other electronic components, and may include specialized computing devices such as blade servers, network routers, data acquisition equi ment disc drive arrays, and other devices commonly associated with data centers,
  • shipment container refers to a commercially available shipping container that is used to transport goods on ships, trains and trucks, and which may be of a standardized size and configuration.
  • rack refers one or more servers mounted on mounting members.
  • tank refers to a container with or without a lid, containing a liquid coolant into which one or more data processing modules may be installed.
  • an ' • independently operable device means capable of usefully functioning without regard to an operational status of an adjacent device.
  • an "independently operable data processin module” means a data processing module that is capable of usefully functioning to provide data processing services and. without regard to an operational status of an adjacent data processing module. Operation of independently operable data processing modules can be influenced (e.g., heated) by one or more adjacent data processing modules, hut as used herein, an independently operable data processing module generally functions regardless of whether an adjacent data, processing module operates or is operable.
  • liquid coolant may be any sufficiently non- conductive liquid such that electrical components (e.g., a motherboard, a memory board, and other electrical or electronic components designed for use in air) continue to reliably function while submerged without significant modification.
  • a suitable liquid coolant is a dielectric liquid coolant, including without limitation vegetable oil, mineral oil, transformer oil, or any liquid coolant have similar features (e.g., a non-flammable, non-toxic liquid with dielectric strength better than or nearly as comparable as air.
  • fluid means either liquid or a gas
  • cooling fluid means a gas or liquid coolant typically used for heat-rejection or cooling purposes.
  • a liquid coolant is a subset of the universe of cooling fluids, but a cooling fluid may be a dielectric or non -dielectric liquid or gas, such as, for example, a conventional air conditioning refrigerant
  • the present invention provides novel apparatus, systems, and methods for a modular data center including a shipping container having a floor ant! an overlay secured on top of the floor, wherein the modular data center includes one or more tanks, each tank defining a certain volume and being configured for receiving a dielectric liquid eoolant and for receiving one or more data processing modules for cooling by the liquid coolant, wherein the one or more tanks are secured in a fixed position above the overlay within the shipping container, and wherein the overla is configured to create a liquid tight barrier defining at least the certain volume of one of the tanks, so that if the coolant escapes one- of the one or more tanks, the overlay contains the escaped coolant within the shipping container.
  • a module dat center includes a shipping container having a floor and includes an overlay secured on top of the floor of the shipping container, wherein the overla is sealed to walls of the shipping container to create a liquid tight barrier.
  • One or more tanks are included defining an open interior volume. Each tank lias a coolant inlet for receiving a dielectric liquid coolant within the open interior volume and a coolant outlet for allowing the dielectric liquid coolant to flow from the open interior volume, the eoolant. inlet and the coolant outlet being tluidly coupled to each other.
  • the one or more tanks are secured in a fixed position within the shipping container.
  • One or more mounting members are positioned within the interior volume of each of the one or more tanks and configured to mountably receive a plurality of independently operable data processing modules in a vertical orientation withi the interior volume of the tank, wherein each independently operable data processing module is a rack-mountab!e data processing module suitable for independently .mounting vertically in the tank on the one or more mounting, members and for independently removing and replacing the rack-mountable data processing module without effecting the position or operational status of other data processing modules, '
  • the one or more tanks are configured for containing the dielectric liquid coolant within the interior volume such that, when a plurality of rack-mountable data processing modules are mountably received, therein, at least a portion of each data processing module being mountabty received is submerged within the dielectric liquid coolant for cooling each respective data processing module when the one or more tanks are sufficiently full of the dielectric liquid coolant.
  • the modular data center includes a cooling system fluidly coupled to the coolant inlet and the coolant outlet of the one or more tanks for transferring heat from the data processing modules in the one or more tanks, wherein the cooling system includes at least one heat exchanger.
  • the modular data center includes at least one pump for pumping the liquid coolant from the coolant outlet of the tank to the heat exchanger;
  • temperature measurement devices and includes at least one controller for controlling the cooling system.
  • the one or more tanks may have respective, removable lids.
  • the one or more tanks are mounted within the shipping container to form one or more rows adj cent an aisle.
  • the at least one heat exchanger is mounted outside the one or more tanks, and the liquid coolan is cooled by pumping it out of the one or more tanks through, the heat exchanger, and back into the one or more tanks.
  • At least one heat exchanger may be installed inside the one or more tanks, wherein heat is removed from the liquid coolant by secondary liquid, cooling circuit and wherein the secondary liquid circuit coolant flows through the at least one heat exchanger and to the outside of the modular data center for releasing heat to the ambient environment.
  • the modular data center further includes a secondary cooling apparatus thermally coupled to the heat exchanger for exchanging heat with the heat exchanger and releasing the exchanged heat to the ambient environment,
  • the shipping container meets the International Organization for Standardization container manufacturing standards.
  • the modular data center includes a lift system for removing ones of the data processing modules from the one or more tanks, wherein the lift system includes transport rails inside the shipping container, a traveling bridge movahly mounted on the transport rails, a trolley raovahly mounted on the traveling bridge, and a hoist having a lilting attachment configured to he attached to a dat processing module.
  • the hoist Is configured to move within the shipping container via the trolley and the traveling bridge in order to access the one or more data processing modules, so that the hoist is configured to raise, lower and transport ones of the one or more data processing modules from liquid coolant of ones of the tanks,
  • the transport rails are mounted to the shipping container
  • the transport rails are mounted to respective walls of the shipping container.
  • the transport rails are mounted to a top of the shipping container
  • the transport rails are mounted to posts within .the shipping container.
  • FIG. 1 A illustrates an embodiment of an exemplary apparatus for cooling one or more independently operable data processing .modules in a. modular data center.
  • FIG, IB illustrates one embodiment of an exemplary system for efficiently cooling a plurality of independently operable data processing modules
  • FIG. 1C il lustrates an alternative embodiment of an exemplary system for efficiently cooling a plurality of independently operable data processing modules
  • FIG. 2 illustrates a cross-sectional front view of a modular data center.
  • F IG, 3 illustrates a left side view of an exemplary tank
  • FIG. 4 illustrates a lift system, for removing data processing modules from, one or more tanks,
  • FIG. 5 illustrates a cross section view of an embodiment of a lift, system for removing data processing modules from one or more tanks.
  • Embodiments of the present invention include a recognition thai building a new or expanding an existing data cente is often time consuming, complex, and. costly due to at least the following factors;
  • Embodiments of the present invention may include integrating one or more liquid cooled data processing modules into a shipping container and may provide the following attributes:
  • FIG.1 A depicts an exemplary, liquid cooled modular data center, for operating one or more independently operable data processing modules containing heat-generating electronic components arranged in one or more tanks.
  • the modular data center includes a shipping container 1 1.0 having a bottom 112 and a top 1 14.
  • Standard ISO shipping containers are 10, 20, or 40 ft. in length.
  • Shipping container 1 10 has a back wail 132, opposing side walls 127 and 128, and a frotit opening 134, wherein front opening 134 is normally provided with a door 120.
  • each tank 122 Inside shipping container 1 10, a plurality of tanks 122 are provided, each tank
  • tanks 122 containing vertically mounted, independently removable and replaceable data, processing modules. As shown in IG. 1 A, tanks 122 are arranged in two banks adjacent an aisle 124, The tanks may be arranged otherwise. For example, a single bank of tanks 122 ma be installed in the center of shipping container 1 10 with ai sles on either side of tanks 122. Or a single bank of tanks 122 may be installed against a wall of shipping container 1 10, for example.
  • FIG. 2 a front plan cross section view of the modular data center is presented, according to an embodiment of the present invention. As depicted in
  • tank 1.22 are arranged in a single bank in the center of sh ipping container 1 10 with aisles 224 and 225 on either side of tanks 122, although thi Is just one of other possible arrangements, as previously stated.
  • Overlay 210 which may be sheet metal, is provided on lop of floor 1 18 of shipping container 1 J and is sealed at least io side walls 127 and 128 and back wall 132 to create a liquid tight barrier to hold liquid coolant in the event of a leak from tank 122 or from lines of the cooling system carrying the liquid coolant as hereinafter described.
  • Other materials may be provided for overlay 210, such as plastic or other suitable material and overla 210 may also be sealed to front 134 of shipping container 1 10.
  • a front lip 1 0 is provided at the threshold of front opening 134, which requires a user to step over Hp 190 when entering shipping container 1 10»
  • Lip 1 0 is preferabl sealed in removable fashion, to walls 1.27 and 128 and overlay 210, such that, the seal provided by lip 1.90 is sufficient to keep any spilled liquid coolant from coming out of container 1 10 via front opening 134.
  • the top edge of lip 190 is a sufficient height above overla 210 such thai the volume defined by the exposed surface area of overlay 210 and height of top edge of lip 1 0 is at least 1 10% of the volume of liquid coolant, in one iatik 12.2.
  • Lip 190 is of a suitable material for sealing, in one or more embodiments, lip 190 is substantially rigid metal or plastic, .tor example, wherein lip 190 seals in a removable fashion so that removal enables rolling tanks 122, pumping modules 135 and other equipment, in and out of container 1 1.0.
  • Lip 190 may alternati vely include soft material such as a deformable foam or plastic thai deforms when a heavy object rolls over it but pops back, into place afterwards, such as a Build ⁇ a ⁇ Berm barrier, which is commercially available by Pig.
  • the seal by lip 1 0 where hp 1 0 interfaces walls 127 and 1 8 and overlay 210 may be maintained at least partly by pressure of lip 190 against walls 127 and 128 and overlay 21.0 and may be facilitated also by a gasket against the surface of lip 190 that faces walls 127 and 128 and overlay 210,
  • the seal may be also or alternatively enhanced by a sealing compound, such as a tri!e rubber, for example,
  • edges of overlay 210 may be turned up and joined, such as by welding, adhesive, gaskets, etc., wherein the turned up and joined edges of overlay 210 provide sides for the container, so that overlay 210, including its sides, provides a liquid tight container.
  • sides may be provided at edges of overlay 210 (i.e., edges at walls 127, 128 and 132 and at front 135) in any suitable manner, which may include berm-iype sides, so that overlay 210, including its sides, provides a liquid tight container.
  • the edges or sides of overlay 210 are not necessarily sealed to container 1 10, although they may be.
  • Shipping container i 10 comprises at least one beam 1 16 integrated into the bottom 1 12 and a floor 1 18 installed on top of the at least one beam 1 16.
  • Floor 1 18 is typically a woode floor, such as 28 mm plywood, for example, to which fasteners may be secured and that is disposed above bottom 1 12 and supported by the at least one beam 1 16.
  • floor 1 18 may include other materials such as plastic or metal.
  • One or more data processing modules in one or more tanks 122 containing liquid coolant are installed on top of overlay 210.
  • Tanks 122 are secured so they are fixed in position within container 1 30, which may be by attaching fasteners (e.g., bolted) through overlay 210 and floor 1 18, into beam ⁇ .16, which is integrated into bottom 1 .12 of shipping container 11.0. Penetrations through overlay 210 are sealed, such that liquid cannot leak through. In some eases, a metal inser 2.12 may be put in place between the beam and tanks 122.
  • Tanks 122 may also be secured by other means to overlay 210, such as by welding or adhesive, for example.
  • beam 1 .16 runs essentially from one sidewal! 127 to the other side-wall 128 and has an ' ⁇ ' shaped cross-section profile, which is obtained by two rails on each end facing sidewalk 1,27 and 128, where the end rails are connected to a mil. in the middle, as shown.
  • Floor 1 18 is supported by a plurality of such beams 1 16 in the depiction of FIG. 2, although only one such beam 1 16 is visible in the figure.
  • Beam 1 16 may have other configurations, including n on- 1 shaped profiles. Rather than providing beams 1 16 running from one side wall to the other, one or more beams 1 16 may he provided running lengthwise, that is, from front 134 to back 132.
  • a front lip 190 is provided at the threshold of front opening 134, which requires a user to step over lip 190 when entering shipping
  • Lip 190 is preferably sealed in removable fashion to walls 127 and 128 and overlay 210, such that the seal provided by lip 190 is sufficient to keep any spilled liquid coolant from coming out of container 1 10 via front opening 134.
  • the top edge of lip 190 is a sufficient height above overlay 210 such thai the volume defined by the exposed surface area of overlay 210 and height of top edge of lip 190 is at least 1 10% of the volume of liquid coolant in one tank 122.
  • Tank 122 may optionally have a hinged or removable Hd ⁇ shown open in FIG. 3) or an open top.
  • Tank 122 may be fabricated of steel, a sufficiently strong plastic that is compatible with the liquid coolant used as a cooling medium, or other suitable material
  • Tank 122 may face upward with an open top to form an open, interior volume.
  • Tank 122 may contain a plurality of independently operable data processing modules 310 mounted vertically and independently removable and. replaceable from tank 122. Each data processing module 310 is
  • the independently operable data processing modules 310 may be mounted in an array arranged horizontally and immersed at least partially in liquid coolant.
  • shipping container 1 1 may include a cooling system 185 for transferring heat from data processing modules 310.
  • the liquid coolant heated by data processing modules 310 is ffuid!y coupled through suitable piping or lines to a pump 130, which pumps the heated liquid coolant through suitable piping or lines to a remotely or disially located heat exchanger 1 0 associated with a heat-rejection or cooling apparatus 150.
  • the disially located heat exchanger 140 rejects the heat from the incoming heated liquid coolant and fluidly " couples the cooled liquid coolant through a return fluid line or piping 170 back into the tank 122.
  • the liquid coolant completes a fluid circuit through the data processing modules: 310 in the tank 1.22, pump 130, heat exchanger 140, and back into the tank 122.
  • the heat rejected, from the heated liquid coolant through the heat exchanger 140 may then be selectively used by alternative heat rejection or cooling apparatus .150 to dissipate, recover, or beneficially use the rejected heat depending on the different environmental conditions or data processing modules 310 operating conditions t which the system is subject.
  • FIG. 1C an embodiment of an alternative cooling system 1 5 is illustrated for cooling data processing modules 3 10.
  • heated liquid, coolant does not flow outside the tank .122. Instead, one fluid circuit 260 of the flowing liquid coolant is completely internal to the tank 122.
  • a thermal coupling device 280 such as a heat exchanger, is mounted wit in the tank 122 within the fluid circuit through the data processing modules 310, so that at least a portion of the heated liquid coolant flow exiting the data processing m ules flows through the thermal coupling device 280. Cooled liquid coolant exits the coupling device 280 and at least a portion of the cooled dielectric coolant circulates in the internal fluid circuit 260 hack through the data processing modules 310,
  • Cooling systems 185 (FIG. IB) and 1 5 (FIG. 1 C) include a computer controller 180 with suitable novel applications software for implementing the methods of the present invention.
  • controller 180 is included in co-pending international published patent application WO 2 1001951 ? which is incorporated by reference, as stated herein above.
  • cooling apparatus 150 which provides an evaporative final heat exchanger 152 and a motor 153 driven fan 154 for forcing air flow through final heat exchanger 152, is located sufficiently far away from tanks 122 to enable adequate heat dissipation at exchanger 152 to cool the heated liquid in loop 175.
  • the resulting heat may be vented to the ambient outside environment.
  • the resulting beat may be beneficially used, as described in co-pending PCX patent, application WO 2013022805.
  • the cooled liquid is then recirculated through the return pipe in loop 175 to cool the liquid coolant in loop 170 which, in turn, cools the data processing modules 310 in tanks 122.
  • cooling apparatus 150 is mounted on the exterior top of container 110. ' This is advantageous because it allows deploying the data center contained by shipping container 110 as a single "block,” which is faster. With cooling tower 150 physically attached to container 1 30, structural support is provided by container 1 10, eliminating the need to pour concrete supports for cooling towers,
  • cooling apparatus ISO is shown, more than one may be provided in various embodiments of the present invention.
  • one cooling apparatus 150 may be provided for each bank of tanks 122, Further, cooling loops 175 may be arranged. and each cooling apparatus 150 may be sized, so that a plurality of cooling apparatus 150 may provide backup cooling for one other.
  • each pump module 135 may include primary and secondary pumps 130 (and associated pump motors) connected to filter 160 and liquid coolant heat exchanger 140 of at least one bank of tanks 122 via fluid circuit 170 such that primary and secondar pumps 130 may function independently of one another for backu purposes, with electrically isolated pump 130 motors.
  • primary pum 130 motor is controlled b variable speed controller 180 for regulating temperature of coolant loop 170 by varying liquid coolant flow
  • secondary pump 130 motor is fixed-speed and controlled by on-off control
  • a module 135 for evaporative cooling apparatus 150 which includes a controller for controlling a pump motor in loop 175, which may be on-off control or variable speed control, according to one or more embodiments, and includes a controller for fan 154 motor 153, which may be like controller 180 of Figure I B, for example, but for regulating tan 154 speed of evaporative cooling apparatus 150 in order to control temperature of loop 175 b varying air flow over evaporative final heat exchanger 152.
  • a pump, motor controller and cooling water loop may also be provided, to run water over the exterior of beat exchanger 152 for additional cooling.
  • cooling tower 150 is integrated with container 1 10, as shown in Figure 1 A
  • liquid coolant of loo 170 may be run directly io beat exchanger 152 of cooling tower 150 in a closed loop, rather than providing separate loo 175
  • a pump and cooling water loop may be provided to run water over the exterior of heat exchanger 152 durin hot periods in addition to the air drawn through exchanger 152 by fan 154, while during cold periods the water is not needed, because air through exchanger 152 provides sufficient cooling. This dramatically reduces the amount of water used for cooling.
  • Controllers 180 may be interfaced via a network with a master controller for which a single dashboard is pro vided, according to one or more embodiments of the present invention, which is for displaying and controlling water flow in one or more loops 175 through one or more cooling towers .1 SO, fan power for air flow across the one or more heat exchangers of 152 one or more cooling towers 150, and liquid coolant flow in one or more loops 170 for tanks 122.
  • the master controller optimizes all elements for minimum power consumption of the system while maintaining sufficient cooling.
  • the network controller performs diagnostic testing of each element separately for functionality and reports the functionality back, to a single user. This single management point makes the system more reliable and more efficient, since the master controller can obtain maximum efficiency for all components.
  • Insulation is provided for exterior walls 127, 128 and 132 of container 110, as well as for doors 120, according to one or more embodiments of the present in vention.
  • the insulation may include a spray on coating added to the inside or outside of container J 10 and may include dirt piled on top 114, possibly with grass growing on the surface, since dirt and grass provide excellent insulation. This reduces the amount of solar heating to container 110 during the summer, making it easier for people to work therein and service the data processing modules 310 and other equipment.
  • the lower ambient temperature also makes the power distribution equipment more reliable. Additional safety equipment ma include a non-slip floor, an emergency exit, motion detection and other security.
  • a. lift system 500 is provided in container 1 0 for removing data processing modules 310 from one or more tanks 122, in one or more embodiments of the present invention.
  • transport rails 520 A and B are mounted fixedly to side walls 127 and 128, with traveling bridge 524 spanning transport rails 520A and B on rollers (not shown), so that traveling bridge 524 is configured lor moving the length of transport rails 520 A and B, which may be the length of container 1 30 from front 134 to back 132 or ma be the width from side wall
  • Trol ley 528 is configured to roll along the length of tra veling bridge 524, Le., from one transport rail 520 A to the other 520B, with hoist 530 suspended from trolley 528, Hoist 530 has a cable and hook configured to be attached to data processing module 310 so that hoist 530 can raise and lower data processing module 310 from tank 122, which is filled with liquid, coolant.
  • trolley 528 When hoist 530 has raised a data processing module 310 out of tank 122, trolley 528 can roll along traveling bridge 524 and traveling bridge 524 can roll along transport rails 520A and B to move the data processing modules .310 to a different location. Thus, a user may position hoist 530 over a data processing module and pick the data, processing module out of the liquid coolant to perform data processing module maintenance, for example.
  • FIG. 4 a lift system 400 provided in container i 10 for removing data processing modules 310 from one or more tanks 122 is depicted, according to one or more embodiments of the present invention, wherein hoist beams 410 are rigidly fixed to and supported by posts 440, which may stand upon overlay 210 (FIG. 2) and may be fixed thereto or to floor 1 18 (FIG. 2) or beam 1 16 (FIG.
  • Transport rails 420A and B are mounted fixedly to hoist beams 41 OA and B, with a traveling bridge 424 spanning transport rails 420 A and B on rollers (not shown), so that traveling bridge 424 is configured for moving the length of transport rails 420A and B, which, may be the length of container 1 10 from front 1.34 to back 132 or may be the width from side wall 127 to side wall 1.28, depending on the orientation of lift system 400 within container 1. 10.
  • transport rails 420A and B may alternately be mounted directly on posts 440 without hoist beams 41 OA. and B.jTroHey 428 is configured to roll along the length of traveling bridge 424, i.e.
  • Hoist 430 has a cable and book configured to be attached to data processing module 310 so that hoist 430 can raise and lower data processing .module 310 from tank 122, which is filled with liquid coolant.
  • trolley 428 can roll along traveling bridge 424 and traveling bridge 424 can roil along transport rails 420A and B to move the data processing modules 31 to a different location.
  • a user may position hoist 430 over a data processing module and pick the data processing module out of the liquid coolant to perform data processing module maintenance, for example.
  • a gantry crane configuration is provided for bit system 400, wherein posts 440 are not fixed to the container, but rather include rollers, with transport rails 420A and B extending less than, the entire length or width of container 1 10,
  • posts 440 roll from front 134 to back 132 or from side wall 127 to side wall 128, depending on orientation of lift system 400 within container 110,
  • the terms comprises, comprising, or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Further, no element described herein is required, for the practice of the invention unless expressly described as essentia! or critical.

Abstract

A modular data center includes a shipping container having a floor and an overlay secured on top of the floor. The modular data center includes one or more tanks, each tank defining a certain volume and being configured for receiving a dielectric liquid coolant and for receiving one or more data processing modules for cooling by the liquid coolant. The one or more tanks are secured in a fixed position above the overlay within the shipping container. The overlay is configured to create a liquid tight barrier defining at least the certain volume of one of the tanks, so that if the coolant escapes one of the one or more tanks, the overlay contains the escaped coolant within the shipping container.

Description

LIQUID COOLED MODULAR DATA CENTER
CROSS-REFERENCES TO RELAT ED APPLICATIONS
[00011 This application claims priority pursuant to 35 U.S.C. 1 1 to U.S. provisional application serial no. 61/850,730 entitled METHODS FOR MOUN TING A CARNO!ET RACK IN ISO CONTAINER filed on February 22, 2013.
[0002] This application is related to co-pending international published patent application WO 2010019517 entitled LIQUID SUBMERGED, HORIZONTAL
COMPUTER SERVER RACK AND SYS TEMS ANT) METHODS OF COOLING SUCH A SER VER RACK which was published on Februar 18, 201 , U.S. published patent application 201 10132579 Al entitled LIQUID SUBMERGED, HORIZONTAL
COMPUTER SERVER RACK AND SYSTEMS AND METHODS OF COOLING SUCH A SERVER. RACK which was published on June 9, 2 1 1, international published patent application WO 2013022805 entitled HARD DRIVE COOLING FOR FLUID
SUBMERSION COOLING SYSTEMS which was published on February 1.4, 2013, and IIS. patent application Ser. No. 14/237,100 entitled HART) DRIVE COOLING FOR FLUID SUBMERSIO COOLING which was filed on February 4, 2014, all of which are incorporated herein by reference for all purposes.
FIELD OF INVENTION
[0003] This application concerns data processing centers housed in shipping containers.
BACKGROUND
[0004] Data centers are normally housed in conventional building structures and use air conditioning systems to remove heal generated by electronic components (chips, hard drives, cards, etc). The term "data center" loosely refers to a physical location housing one o more data processing modules.
[0005] The term "data processing module" generally refers to one or more computing devices running software configured to receive requests, typically over a network, A data processing module may include one or more servers connected to a network and running software configured to receive requests from other computing devices on the network, which may include other servers, and desktop and mobile computing devices, including cellular phones. Such data processing modules typically include one or more processors, memory, input/output connections to a network and other electronic components, and may include specialized computing devices such as blade servers, network routers, data acquisition equi ment disc drive arrays, and other devices commonly associated with data centers,
[0006] As used herein the term "shipping container" refers to a commercially available shipping container that is used to transport goods on ships, trains and trucks, and which may be of a standardized size and configuration.
[0007] As used herein the term "rack" refers one or more servers mounted on mounting members.
[0008] As used herein the term "tank" refers to a container with or without a lid, containing a liquid coolant into which one or more data processing modules may be installed.
[0009] As used herein, an 'independently operable" device means capable of usefully functioning without regard to an operational status of an adjacent device. As used herein, an "independently operable data processin module" means a data processing module that is capable of usefully functioning to provide data processing services and. without regard to an operational status of an adjacent data processing module. Operation of independently operable data processing modules can be influenced (e.g., heated) by one or more adjacent data processing modules, hut as used herein, an independently operable data processing module generally functions regardless of whether an adjacent data, processing module operates or is operable.
[0010] As used herein, the term "liquid coolant" may be any sufficiently non- conductive liquid such that electrical components (e.g., a motherboard, a memory board, and other electrical or electronic components designed for use in air) continue to reliably function while submerged without significant modification. A suitable liquid coolant is a dielectric liquid coolant, including without limitation vegetable oil, mineral oil, transformer oil, or any liquid coolant have similar features (e.g., a non-flammable, non-toxic liquid with dielectric strength better than or nearly as comparable as air. 0 1 1 ] As used herein, "fluid" means either liquid or a gas, and "cooling fluid" means a gas or liquid coolant typically used for heat-rejection or cooling purposes. As used herein, a liquid coolant is a subset of the universe of cooling fluids, but a cooling fluid may be a dielectric or non -dielectric liquid or gas, such as, for example, a conventional air conditioning refrigerant
SUMMARY OF INVENTIO
[0012] Briefly, the present invention provides novel apparatus, systems, and methods for a modular data center including a shipping container having a floor ant! an overlay secured on top of the floor, wherein the modular data center includes one or more tanks, each tank defining a certain volume and being configured for receiving a dielectric liquid eoolant and for receiving one or more data processing modules for cooling by the liquid coolant, wherein the one or more tanks are secured in a fixed position above the overlay within the shipping container, and wherein the overla is configured to create a liquid tight barrier defining at least the certain volume of one of the tanks, so that if the coolant escapes one- of the one or more tanks, the overlay contains the escaped coolant within the shipping container.
[0013] hi another aspect, a module dat center includes a shipping container having a floor and includes an overlay secured on top of the floor of the shipping container, wherein the overla is sealed to walls of the shipping container to create a liquid tight barrier. One or more tanks are included defining an open interior volume. Each tank lias a coolant inlet for receiving a dielectric liquid coolant within the open interior volume and a coolant outlet for allowing the dielectric liquid coolant to flow from the open interior volume, the eoolant. inlet and the coolant outlet being tluidly coupled to each other. The one or more tanks are secured in a fixed position within the shipping container. One or more mounting members are positioned within the interior volume of each of the one or more tanks and configured to mountably receive a plurality of independently operable data processing modules in a vertical orientation withi the interior volume of the tank, wherein each independently operable data processing module is a rack-mountab!e data processing module suitable for independently .mounting vertically in the tank on the one or more mounting, members and for independently removing and replacing the rack-mountable data processing module without effecting the position or operational status of other data processing modules, 'The one or more tanks are configured for containing the dielectric liquid coolant within the interior volume such that, when a plurality of rack-mountable data processing modules are mountably received, therein, at least a portion of each data processing module being mountabty received is submerged within the dielectric liquid coolant for cooling each respective data processing module when the one or more tanks are sufficiently full of the dielectric liquid coolant.
[00143 hi another aspect, the modular data center includes a cooling system fluidly coupled to the coolant inlet and the coolant outlet of the one or more tanks for transferring heat from the data processing modules in the one or more tanks, wherein the cooling system includes at least one heat exchanger. The modular data center includes at least one pump for pumping the liquid coolant from the coolant outlet of the tank to the heat exchanger;
temperature measurement devices and includes at least one controller for controlling the cooling system.
[00153 in a further aspect, the one or more tanks may have respective, removable lids.
[0016] i another aspect, the one or more tanks are mounted within the shipping container to form one or more rows adj cent an aisle.
[00.17] hi another aspect, the at least one heat exchanger is mounted outside the one or more tanks, and the liquid coolan is cooled by pumping it out of the one or more tanks through, the heat exchanger, and back into the one or more tanks.
[0018] In another aspect, at least one heat exchanger may be installed inside the one or more tanks, wherein heat is removed from the liquid coolant by secondary liquid, cooling circuit and wherein the secondary liquid circuit coolant flows through the at least one heat exchanger and to the outside of the modular data center for releasing heat to the ambient environment. [001 ] In another aspect, the modular data center further includes a secondary cooling apparatus thermally coupled to the heat exchanger for exchanging heat with the heat exchanger and releasing the exchanged heat to the ambient environment,
[0020] In one aspect, the shipping container meets the International Organization for Standardization container manufacturing standards.
[00211 In another aspect, the modular data center includes a lift system for removing ones of the data processing modules from the one or more tanks, wherein the lift system includes transport rails inside the shipping container, a traveling bridge movahly mounted on the transport rails, a trolley raovahly mounted on the traveling bridge, and a hoist having a lilting attachment configured to he attached to a dat processing module. The hoist Is configured to move within the shipping container via the trolley and the traveling bridge in order to access the one or more data processing modules, so that the hoist is configured to raise, lower and transport ones of the one or more data processing modules from liquid coolant of ones of the tanks,
[0022] in one aspect, the transport rails are mounted to the shipping container
[0023] In one aspect, the transport rails are mounted to respective walls of the shipping container.
[0024] In one aspect, the transport rails are mounted to a top of the shipping container,
[0025] In. one aspect, the transport rails are mounted to posts within .the shipping container.
BRIEF DESCRIPTION OF THE DRAWINGS
[0026] For a more complete understanding of one or more embodiments of the present invention and the advantages thereof, reference is now made to the following descriptions taken in conjunction with the accompanying drawings, in. which: [002?] FIG. 1 A illustrates an embodiment of an exemplary apparatus for cooling one or more independently operable data processing .modules in a. modular data center.
[0028] FIG, IB. illustrates one embodiment of an exemplary system for efficiently cooling a plurality of independently operable data processing modules;
[00.29] FIG. 1C il lustrates an alternative embodiment of an exemplary system for efficiently cooling a plurality of independently operable data processing modules;
[0030] FIG. 2 illustrates a cross-sectional front view of a modular data center.
[003.1 ] F IG, 3 illustrates a left side view of an exemplary tank
[0032] FIG. 4 illustrates a lift system, for removing data processing modules from, one or more tanks,
[0033] FIG. 5 illustrates a cross section view of an embodiment of a lift, system for removing data processing modules from one or more tanks.
DETAILED DESCRIPTION
[0034] it requires a substantial amount of space to house data centers in. conventional buildings. Also, this kind of housing is not portable and is expensive, as energy costs and power dissipation continue to increase. Air cooling of a data center is also space intensive, because the efficiency of cooling is affected by the proximity of electronic components.
[0035] Embodiments of the present invention include a recognition thai building a new or expanding an existing data cente is often time consuming, complex, and. costly due to at least the following factors;
* Cost of data center construction
* Compliance with local budding codes
• Design customized user
• Installation customized to data center design and existing site (physical site and
legacy systems)
o * Installation personnel learning curve
[0036] Embodiments of the present invention may include integrating one or more liquid cooled data processing modules into a shipping container and may provide the following attributes:
* Effective, efficient and low-cost cooling for cooling electronic components in, for example, servers
* A single engineering firm responsible for the design
* Manufacture of data center on an assembly line, improving economies of scale
* Ability for the shipping container to be shipped to a central location for retrofit
[0037] The following describe apparatus, systems, and methods for integrating one or more liquid cooled data processing modules into a shipping container.
[0038] FIG.1 A depicts an exemplary, liquid cooled modular data center, for operating one or more independently operable data processing modules containing heat-generating electronic components arranged in one or more tanks. The modular data center includes a shipping container 1 1.0 having a bottom 112 and a top 1 14. Standard ISO shipping containers are 10, 20, or 40 ft. in length. Shipping container 1 10 has a back wail 132, opposing side walls 127 and 128, and a frotit opening 134, wherein front opening 134 is normally provided with a door 120.
[0039 j Inside shipping container 1 10, a plurality of tanks 122 are provided, each tank
122 containing vertically mounted, independently removable and replaceable data, processing modules. As shown in IG. 1 A, tanks 122 are arranged in two banks adjacent an aisle 124, The tanks may be arranged otherwise. For example, a single bank of tanks 122 ma be installed in the center of shipping container 1 10 with ai sles on either side of tanks 122. Or a single bank of tanks 122 may be installed against a wall of shipping container 1 10, for example.
[ 0040] Referring now to PIG. 2, a front plan cross section view of the modular data center is presented, according to an embodiment of the present invention. As depicted in
FIG, 2, tank 1.22 are arranged in a single bank in the center of sh ipping container 1 10 with aisles 224 and 225 on either side of tanks 122, although thi Is just one of other possible arrangements, as previously stated. Overlay 210, which may be sheet metal, is provided on lop of floor 1 18 of shipping container 1 J and is sealed at least io side walls 127 and 128 and back wall 132 to create a liquid tight barrier to hold liquid coolant in the event of a leak from tank 122 or from lines of the cooling system carrying the liquid coolant as hereinafter described. Other materials may be provided for overlay 210, such as plastic or other suitable material and overla 210 may also be sealed to front 134 of shipping container 1 10.
[0041] According to one or more embodiments of the present invention, a front lip 1 0 is provided at the threshold of front opening 134, which requires a user to step over Hp 190 when entering shipping container 1 10» Lip 1 0 is preferabl sealed in removable fashion, to walls 1.27 and 128 and overlay 210, such that, the seal provided by lip 1.90 is sufficient to keep any spilled liquid coolant from coming out of container 1 10 via front opening 134. The top edge of lip 190 is a sufficient height above overla 210 such thai the volume defined by the exposed surface area of overlay 210 and height of top edge of lip 1 0 is at least 1 10% of the volume of liquid coolant, in one iatik 12.2.
[ 0042] Lip 190 is of a suitable material for sealing, in one or more embodiments, lip 190 is substantially rigid metal or plastic, .tor example, wherein lip 190 seals in a removable fashion so that removal enables rolling tanks 122, pumping modules 135 and other equipment, in and out of container 1 1.0. Lip 190 may alternati vely include soft material such as a deformable foam or plastic thai deforms when a heavy object rolls over it but pops back, into place afterwards, such as a Build~a~Berm barrier, which is commercially available by Pig. C'Buiid-a-Berm" and "Pig" are trademarks of New Pendulum Corp.) The seal by lip 1 0 where hp 1 0 interfaces walls 127 and 1 8 and overlay 210 may be maintained at least partly by pressure of lip 190 against walls 127 and 128 and overlay 21.0 and may be facilitated also by a gasket against the surface of lip 190 that faces walls 127 and 128 and overlay 210, The seal may be also or alternatively enhanced by a sealing compound, such as a tri!e rubber, for example,
[0043] In one or more embodiments, edges of overlay 210 (i.e., edges at walls 127, 128 and 132 and at front 135} may be turned up and joined, such as by welding, adhesive, gaskets, etc., wherein the turned up and joined edges of overlay 210 provide sides for the container, so that overlay 210, including its sides, provides a liquid tight container.. More generally, sides may be provided at edges of overlay 210 (i.e., edges at walls 127, 128 and 132 and at front 135) in any suitable manner, which may include berm-iype sides, so that overlay 210, including its sides, provides a liquid tight container. In this case, the edges or sides of overlay 210 are not necessarily sealed to container 1 10, although they may be.
[0044] Shipping container i 10 comprises at least one beam 1 16 integrated into the bottom 1 12 and a floor 1 18 installed on top of the at least one beam 1 16. Floor 1 18 is typically a woode floor, such as 28 mm plywood, for example, to which fasteners may be secured and that is disposed above bottom 1 12 and supported by the at least one beam 1 16. Alternatively, floor 1 18 may include other materials such as plastic or metal.
[0045] One or more data processing modules in one or more tanks 122 containing liquid coolant are installed on top of overlay 210. Tanks 122 are secured so they are fixed in position within container 1 30, which may be by attaching fasteners (e.g., bolted) through overlay 210 and floor 1 18, into beam Ϊ .16, which is integrated into bottom 1 .12 of shipping container 11.0. Penetrations through overlay 210 are sealed, such that liquid cannot leak through. In some eases, a metal inser 2.12 may be put in place between the beam and tanks 122. Tanks 122 may also be secured by other means to overlay 210, such as by welding or adhesive, for example.
[0046] In the embodiment depicted in PIG. 2, beam 1 .16 runs essentially from one sidewal! 127 to the other side-wall 128 and has an 'Τ' shaped cross-section profile, which is obtained by two rails on each end facing sidewalk 1,27 and 128, where the end rails are connected to a mil. in the middle, as shown. Floor 1 18 is supported by a plurality of such beams 1 16 in the depiction of FIG. 2, although only one such beam 1 16 is visible in the figure. Beam 1 16 may have other configurations, including n on- 1 shaped profiles. Rather than providing beams 1 16 running from one side wall to the other, one or more beams 1 16 may he provided running lengthwise, that is, from front 134 to back 132.
[0047] Referring now to FIG. 1 A in connection with FIG. 2, according to one or more embodiments of the present invention, a front lip 190 is provided at the threshold of front opening 134, which requires a user to step over lip 190 when entering shipping
container 1 1 . Lip 190 is preferably sealed in removable fashion to walls 127 and 128 and overlay 210, such that the seal provided by lip 190 is sufficient to keep any spilled liquid coolant from coming out of container 1 10 via front opening 134. The top edge of lip 190 is a sufficient height above overlay 210 such thai the volume defined by the exposed surface area of overlay 210 and height of top edge of lip 190 is at least 1 10% of the volume of liquid coolant in one tank 122.
[0048] Referring now to FIG. 3, a side view of tank 122 is depicted. Tank 122 may optionally have a hinged or removable Hd {shown open in FIG. 3) or an open top. Tank 122 ma be fabricated of steel, a sufficiently strong plastic that is compatible with the liquid coolant used as a cooling medium, or other suitable material Tank 122 may face upward with an open top to form an open, interior volume. Tank 122 may contain a plurality of independently operable data processing modules 310 mounted vertically and independently removable and. replaceable from tank 122. Each data processing module 310 is
independently removable and replaceable without affecting the position or operation of other data processing modules. The independently operable data processing modules 310 may be mounted in an array arranged horizontally and immersed at least partially in liquid coolant.
[0049] Referring now to FIG. IB, shipping container 1 1 may include a cooling system 185 for transferring heat from data processing modules 310. The liquid coolant heated by data processing modules 310 is ffuid!y coupled through suitable piping or lines to a pump 130, which pumps the heated liquid coolant through suitable piping or lines to a remotely or disially located heat exchanger 1 0 associated with a heat-rejection or cooling apparatus 150. The disially located heat exchanger 140 rejects the heat from the incoming heated liquid coolant and fluidly" couples the cooled liquid coolant through a return fluid line or piping 170 back into the tank 122. Thus, at least portion, of the liquid coolant completes a fluid circuit through the data processing modules: 310 in the tank 1.22, pump 130, heat exchanger 140, and back into the tank 122. The heat rejected, from the heated liquid coolant through the heat exchanger 140 may then be selectively used by alternative heat rejection or cooling apparatus .150 to dissipate, recover, or beneficially use the rejected heat depending on the different environmental conditions or data processing modules 310 operating conditions t which the system is subject.
[ 0050] Referring now to FIG. 1C, an embodiment of an alternative cooling system 1 5 is illustrated for cooling data processing modules 3 10. Unlike the cooling system 185, heated liquid, coolant does not flow outside the tank .122. Instead, one fluid circuit 260 of the flowing liquid coolant is completely internal to the tank 122. A thermal coupling device 280, such as a heat exchanger, is mounted wit in the tank 122 within the fluid circuit through the data processing modules 310, so that at least a portion of the heated liquid coolant flow exiting the data processing m ules flows through the thermal coupling device 280. Cooled liquid coolant exits the coupling device 280 and at least a portion of the cooled dielectric coolant circulates in the internal fluid circuit 260 hack through the data processing modules 310,
[0051 ] Cooling systems 185 (FIG. IB) and 1 5 (FIG. 1 C) include a computer controller 180 with suitable novel applications software for implementing the methods of the present invention. A detailed description of controller 180 is included in co-pending international published patent application WO 2 1001951 ? which is incorporated by reference, as stated herein above.
[0052] Referring now to Figures I A and IB, cooling apparatus 150, which provides an evaporative final heat exchanger 152 and a motor 153 driven fan 154 for forcing air flow through final heat exchanger 152, is located sufficiently far away from tanks 122 to enable adequate heat dissipation at exchanger 152 to cool the heated liquid in loop 175. The resulting heat may be vented to the ambient outside environment. Alternately, the resulting beat may be beneficially used, as described in co-pending PCX patent, application WO 2013022805. The cooled liquid is then recirculated through the return pipe in loop 175 to cool the liquid coolant in loop 170 which, in turn, cools the data processing modules 310 in tanks 122. (Heat exchanger 152, fan 154 and motor 153 are shown schematically, are not to scale and may be arranged differently than s hown .) In one or more embodimen ts of the present invention, cooling apparatus 150 is mounted on the exterior top of container 110. 'This is advantageous because it allows deploying the data center contained by shipping container 110 as a single "block," which is faster. With cooling tower 150 physically attached to container 1 30, structural support is provided by container 1 10, eliminating the need to pour concrete supports for cooling towers,
[0053] Although one cooling apparatus ISO is shown, more than one may be provided in various embodiments of the present invention. For example, one cooling apparatus 150 may be provided for each bank of tanks 122, Further, cooling loops 175 may be arranged. and each cooling apparatus 150 may be sized, so that a plurality of cooling apparatus 150 may provide backup cooling for one other.
[0054] As shown in Figure 1 A, a module 135, which may include at least elements as shown in Figure I B, for example, is provided for tanks 122, according to one or more embodimenis of the present invention. That is, according to one or more embodiments, each pump module 135 may include primary and secondary pumps 130 (and associated pump motors) connected to filter 160 and liquid coolant heat exchanger 140 of at least one bank of tanks 122 via fluid circuit 170 such that primary and secondar pumps 130 may function independently of one another for backu purposes, with electrically isolated pump 130 motors. According to one or more embodiments, primary pum 130 motor is controlled b variable speed controller 180 for regulating temperature of coolant loop 170 by varying liquid coolant flow, whereas secondary pump 130 motor is fixed-speed and controlled by on-off control,
[0055] Also provided is a module 135 for evaporative cooling apparatus 150 according to one or more embodiments of the present invention, which includes a controller for controlling a pump motor in loop 175, which may be on-off control or variable speed control, according to one or more embodiments, and includes a controller for fan 154 motor 153, which may be like controller 180 of Figure I B, for example, but for regulating tan 154 speed of evaporative cooling apparatus 150 in order to control temperature of loop 175 b varying air flow over evaporative final heat exchanger 152. A pump, motor controller and cooling water loop may also be provided, to run water over the exterior of beat exchanger 152 for additional cooling.
[0056] According to one or more embodiments of the present invention, where cooling tower 150 is integrated with container 1 10, as shown in Figure 1 A, for example, liquid coolant of loo 170 may be run directly io beat exchanger 152 of cooling tower 150 in a closed loop, rather than providing separate loo 175, A pump and cooling water loop may be provided to run water over the exterior of heat exchanger 152 durin hot periods in addition to the air drawn through exchanger 152 by fan 154, while during cold periods the water is not needed, because air through exchanger 152 provides sufficient cooling. This dramatically reduces the amount of water used for cooling. [0057 ] Controllers 180 may be interfaced via a network with a master controller for which a single dashboard is pro vided, according to one or more embodiments of the present invention, which is for displaying and controlling water flow in one or more loops 175 through one or more cooling towers .1 SO, fan power for air flow across the one or more heat exchangers of 152 one or more cooling towers 150, and liquid coolant flow in one or more loops 170 for tanks 122. Preferably, the master controller optimizes all elements for minimum power consumption of the system while maintaining sufficient cooling. The network controller performs diagnostic testing of each element separately for functionality and reports the functionality back, to a single user. This single management point makes the system more reliable and more efficient, since the master controller can obtain maximum efficiency for all components.
[0058 j Insulation is provided for exterior walls 127, 128 and 132 of container 110, as well as for doors 120, according to one or more embodiments of the present in vention. The insulation may include a spray on coating added to the inside or outside of container J 10 and may include dirt piled on top 114, possibly with grass growing on the surface, since dirt and grass provide excellent insulation. This reduces the amount of solar heating to container 110 during the summer, making it easier for people to work therein and service the data processing modules 310 and other equipment. The lower ambient temperature also makes the power distribution equipment more reliable. Additional safety equipment ma include a non-slip floor, an emergency exit, motion detection and other security.
[0059] Referring now to FIG. 5 in conjunction with FIG. 1 A, a. lift system 500 is provided in container 1 0 for removing data processing modules 310 from one or more tanks 122, in one or more embodiments of the present invention. In this embodiment, transport rails 520 A and B are mounted fixedly to side walls 127 and 128, with traveling bridge 524 spanning transport rails 520A and B on rollers (not shown), so that traveling bridge 524 is configured lor moving the length of transport rails 520 A and B, which may be the length of container 1 30 from front 134 to back 132 or ma be the width from side wall
127 to side wall 128, depending on orientation of lift system 500 within container 1 10. (It should be understood that transport rails 520A and B may alternately be mounted in other ways within container 1 10, such as directly to top 3 14, for example. )Trol ley 528 is configured to roll along the length of tra veling bridge 524, Le., from one transport rail 520 A to the other 520B, with hoist 530 suspended from trolley 528, Hoist 530 has a cable and hook configured to be attached to data processing module 310 so that hoist 530 can raise and lower data processing module 310 from tank 122, which is filled with liquid, coolant. When hoist 530 has raised a data processing module 310 out of tank 122, trolley 528 can roll along traveling bridge 524 and traveling bridge 524 can roll along transport rails 520A and B to move the data processing modules .310 to a different location. Thus, a user may position hoist 530 over a data processing module and pick the data, processing module out of the liquid coolant to perform data processing module maintenance, for example.
[0060] Referring now to FIG. 4 in conjunction with FIG. 1 A, a lift system 400 provided in container i 10 for removing data processing modules 310 from one or more tanks 122 is depicted, according to one or more embodiments of the present invention, wherein hoist beams 410 are rigidly fixed to and supported by posts 440, which may stand upon overlay 210 (FIG. 2) and may be fixed thereto or to floor 1 18 (FIG. 2) or beam 1 16 (FIG. 2), Transport rails 420A and B are mounted fixedly to hoist beams 41 OA and B, with a traveling bridge 424 spanning transport rails 420 A and B on rollers (not shown), so that traveling bridge 424 is configured for moving the length of transport rails 420A and B, which, may be the length of container 1 10 from front 1.34 to back 132 or may be the width from side wall 127 to side wall 1.28, depending on the orientation of lift system 400 within container 1. 10. (It should be understood that transport rails 420A and B may alternately be mounted directly on posts 440 without hoist beams 41 OA. and B.jTroHey 428 is configured to roll along the length of traveling bridge 424, i.e. , from one transport rail 420A to the other 42013, with hoist 430 suspended from trolley 428, Hoist 430 has a cable and book configured to be attached to data processing module 310 so that hoist 430 can raise and lower data processing .module 310 from tank 122, which is filled with liquid coolant. When hoist 430 has raised a data processing module 310 out of tank 122, trolley 428 can roll along traveling bridge 424 and traveling bridge 424 can roil along transport rails 420A and B to move the data processing modules 31 to a different location. Thus, a user may position hoist 430 over a data processing module and pick the data processing module out of the liquid coolant to perform data processing module maintenance, for example.
[0061 [ in one or more alternative embodiments, a gantry crane configuration is provided for bit system 400, wherein posts 440 are not fixed to the container, but rather include rollers, with transport rails 420A and B extending less than, the entire length or width of container 1 10, Thus, according to one such gantry crane configuration, posts 440 roll from front 134 to back 132 or from side wall 127 to side wall 128, depending on orientation of lift system 400 within container 110,
[0062] As used .herein, the terms comprises, comprising, or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Further, no element described herein is required, for the practice of the invention unless expressly described as essentia! or critical.
[0063] As used herein, the terras "or" is intended to cover a non-exclusive inclusion. That is, "or" includes both meanings of both "or" and "and/or."
[0064] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearl indicates otherwise.
[0065] The corresponding structures, materials, acts, and equivalents of .all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function k combination with other claimed elements as specifically claimed.
[0066] It should be appreciated that, the particular implementations shown and described herein are illustrative of the invention and are not intended to otherwise limit the scope of the present invention in any way. Other variations are within the scope of the following claims. Those skilled in the art having read this disclosure will recognize that changes and modifications may b made to the embodiments without departing from the scope of the present invention.
[0067] While this specification contains many specifics, these should not be construed as limitations on the scope of the invention or of what can be claimed, but rather as descriptions of features specific to particular implementations of the invention. Certain features that are described in this specification in the context of separate implementations can also be implemented in combination in a single implementation. Conversely, various features that are described in the context of a single Implementation can also be
implemented in multiple implementations separately or in any suitable sub combination. Moreover, although features can be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed, combination can be directed to a subcombination or variation of a subcombination,
[0068 J Similarly, while operations are depicted in the drawings in a particular order, this should not 'he understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all. illustrated operations be performed, to achieve desirable results, in certain circumstances, multitasking and parallel processing can be advantageous. Moreover, the separation of various system components in the
implementations described above should not be understood as requiring such separation in all implementations, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
[0069] The flowchart and block diagrams in the drawings illustrate the architecture, functionality, and opera tion of possible implementations of systems, methods and program products, according to various embodiments of the present invention.
[0070] Benefits, other advantages, and solutions to problems have been described above with regard t specific embodiments. However, the benefits, advantages, solutions to problems, and any elements) that may cause any benefit; advantage, or solution to occur or become more pronounced are not to be construed as critical, required, or essential features or elements of any or all the claims.

Claims

WHAT IS CLAIMED IS:
! , A modular data center comprising:
a. shipping container having a floor;
an overlay secured on top of the floor of the shipping container, wherein the overlay is sealed to walls of the shipping container to create a liquid tight barrier;
one or more tanks defining an open interior volume and having a coolant inlet for receiving a. dielectric liquid coolant within the open interior volume and. having a coolant outlet for allowing the dielectric liquid coolant to flow from the open interior volume, the coolant inlet and the coolant outlet being fiuidl coupled to each other, wherein the one or more tanks are secured in a .fixed position within Ore shipping container;
one or more mounting members positioned within the interior volume of each of the one or more tanks and configured to mountably receive a plurality of independently operable data processing modules in a vertical orientation within the interior volume of the tank., wherei each independently operable data processing module is a rack-mountab e data processing module suitable for independently mounting vertically in. the tank on the one or more mounting members and for independently removing and replacing the rack-mountable data processing module without effecting the position, or operational status of other data processing modules; and
wherein the one or more tanks are configured for containing the dielectric liquid coolant within the interior volume such that, when a plurality of rack-mountable data processing modules are mountably received therein, at least a portion of each data processing module being mountably received is submerged within the dielectric liquid coolant for cooling each respective data processing module when the one or more tanks are sufficiently full of the dielectric liquid coolant.
2. The modular data center of claim 1 , further comprising;
a cooling system fiuidly coupled- to the coolant inle and. the coolant outlet of the one o more tanks for transferring heat from the data processing modules in the one or more tanks, wherein the cooling system comprises;
at least one heat exchanger;
at least one pum for pumping the .liquid coolant from the coolant outlet of the tank, to the beat exchanger; temperature measurement devices; and
at least one controller for controlling the cooling system,
3. The modular data center of claim 1 , wherein the one or more tanks has a removable lid.
4. The modular data center of claim 1 , wherein the one or more tanks are mounted within the shipping container to form one or more rows adjacent an aisle,
5. The modular data center of claim 3, wherein the at least one heat exchanger is mounted outside the one or more tanks, and the liquid coolant is cooled by pumping it out of the one or more tanks through the eat exchanger, and back into the one or more tanks.
6. The modular data center of claim 5, further comprising a secondary cooling apparatus thermally coupled to the heat exchanger for exchanging heat with the heat exchanger and releasing the exchanged heat to the ambient environment
7. The modular data center of claim 3, wherein the at least one heat ex changer is installed inside the one or .more tanks, and the heat is removed from the liquid coolant by a secondary liquid cooling circuit, wherein the secondary liquid circuit coolant flows through the at least one heat exchanger and to the outside of the modular data center releasing heat to the ambient environment,
8. "l te modular data center of claim 1 , wherein, the shipping container meets the International Organization for Standardization container manufacturing standards.
9. The modular data center of claim 1 , further comprising a lift system for removing ones of the data processing modules from the one or more tanks, the lift system comprising:
transport rails inside the shipping container;
a traveling bridge movably mounted on the transport rails;
a trolley movably mounted on the traveling bridge; and
a hoist having a lifting attachment configured to be attached to a data processing module, wherein the hoist is configured to move within the shipping container via the trolley and the traveling bridge in order to access the one or more data processing modules, so that the hoist is configured to raise, lower and transporl ones of the one or more data processing modules from liquid coolant of ones of the tanks,
10. The modular data center of 10, wherein the transport rails are mounted to the shipping container,
1 1. The modular data center of 1 1 , wherein the transport rails are mounted to respective walls of the shipping container,
12. The modular data, center of claim 1 1 , wherein the transport rails are mounted, to a top of the shipping container.
13. The modular data center of 10, wherein the transport rails are mounted to posts within the shipping container,
14. A modular data center comprises a shipping container having a floor and an overlay secured on top of the floor, wherein, the modular data center includes one or more tanks, each tank defining a certain volume and being configured for receiving a dielectric liquid coolant and for receiving one or more data processing modules for cooling by the liquid coolant, wherein the one or more tanks are secured in a fixed position above the overlay within the shipping container, and wherein the overlay is configured to create a liquid, tight barrier defining at least the certain volume of one of the tanks, so thai if the coolant escapes one of the one or more tanks, the overlay contains the escaped coolant within the shipping container,.
PCT/US2014/017835 2013-02-22 2014-02-21 Liquid cooled modular data center WO2014130891A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP14754702.0A EP2959357A4 (en) 2013-02-22 2014-02-21 Liquid cooled modular data center

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201361850730P 2013-02-22 2013-02-22
US61/850,730 2013-02-22

Publications (1)

Publication Number Publication Date
WO2014130891A1 true WO2014130891A1 (en) 2014-08-28

Family

ID=51391872

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2014/017835 WO2014130891A1 (en) 2013-02-22 2014-02-21 Liquid cooled modular data center

Country Status (2)

Country Link
EP (1) EP2959357A4 (en)
WO (1) WO2014130891A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9622376B2 (en) 2015-05-04 2017-04-11 Dell Products, L.P. Methodology for electronic equipment to self-identify submersion in mineral oil
EP3279765A4 (en) * 2015-03-30 2018-12-05 Exascaler Inc. Electronic-device cooling system
EP3318954A4 (en) * 2015-07-02 2019-03-06 Exascaler Inc. Liquid immersion cooling device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7413394B2 (en) * 2001-07-02 2008-08-19 Transol Corporation Low headroom telescoping bridge crane system
US20090229194A1 (en) * 2008-03-11 2009-09-17 Advanced Shielding Technologies Europe S.I. Portable modular data center
US7686175B2 (en) * 2004-09-03 2010-03-30 Mhe Technologies, Inc. Container crane
US20110132579A1 (en) * 2008-08-11 2011-06-09 Green Revolution Cooling, Inc. Liquid Submerged, Horizontal Computer Server Rack and Systems and Method of Cooling such a Server Rack
US8310829B2 (en) * 2008-05-05 2012-11-13 Carrier Corporation Integrated computer equipment container and cooling unit

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8320125B1 (en) * 2007-06-29 2012-11-27 Exaflop Llc Modular data center cooling
CA2807297C (en) * 2010-08-05 2015-12-01 St Reproductive Technologies Llc Shipping containers and methods of transporting livestock
CN102063166A (en) * 2010-11-17 2011-05-18 华为技术有限公司 Container type data center

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7413394B2 (en) * 2001-07-02 2008-08-19 Transol Corporation Low headroom telescoping bridge crane system
US7686175B2 (en) * 2004-09-03 2010-03-30 Mhe Technologies, Inc. Container crane
US20090229194A1 (en) * 2008-03-11 2009-09-17 Advanced Shielding Technologies Europe S.I. Portable modular data center
US8310829B2 (en) * 2008-05-05 2012-11-13 Carrier Corporation Integrated computer equipment container and cooling unit
US20110132579A1 (en) * 2008-08-11 2011-06-09 Green Revolution Cooling, Inc. Liquid Submerged, Horizontal Computer Server Rack and Systems and Method of Cooling such a Server Rack

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2959357A4 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3279765A4 (en) * 2015-03-30 2018-12-05 Exascaler Inc. Electronic-device cooling system
US9622376B2 (en) 2015-05-04 2017-04-11 Dell Products, L.P. Methodology for electronic equipment to self-identify submersion in mineral oil
EP3318954A4 (en) * 2015-07-02 2019-03-06 Exascaler Inc. Liquid immersion cooling device
US10401924B2 (en) 2015-07-02 2019-09-03 Exascaler Inc. Liquid immersion cooling system

Also Published As

Publication number Publication date
EP2959357A1 (en) 2015-12-30
EP2959357A4 (en) 2016-10-12

Similar Documents

Publication Publication Date Title
US20140301037A1 (en) Liquid coolant-submersible node
US20140307384A1 (en) Integrated computing module with power and liquid cooling components
EP3384364B1 (en) Fluid cooling system and method for electronics equipment
US10624242B2 (en) System and method of packaging computing resources for space and fire-resistance
US8988879B2 (en) Modular data center cooling
US9119326B2 (en) System and methods for cooling electronic equipment
US8456840B1 (en) Modular data center cooling
US7278273B1 (en) Modular data center
US10716236B2 (en) Cooling a data center
US20080291626A1 (en) Method and apparatus for cooling electronic equipment
EP2959357A1 (en) Liquid cooled modular data center
EP3731611A1 (en) Immersion cooling system
EP2413061B1 (en) Water heater
CN205961661U (en) Data process system and cooling system
RU2692569C1 (en) Immersion cooling system of server equipment
CN104833028B (en) Data center's air-conditioning cold-supplying energy-saving system and its implementation
US11297738B2 (en) Data center cooling system
CN113056150A (en) Server cabinet and server heat dissipation method
CN202769845U (en) Cold air supplying equipment
US20230295940A1 (en) Modular integrated system modules
EP4120434A1 (en) A device and method for controlling flooding of at least part of an energy storage space
CN210274936U (en) Self-contained data center refrigerating device
Baird et al. Large-scale repository design
CN207644932U (en) A kind of repeat fills cold passive pellet type cold chain heat insulation box
CN216204424U (en) Automatic intelligent refrigerating station of ice rink

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14754702

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2014754702

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2014754702

Country of ref document: EP