US20210378148A1 - Liquid immersion cooling tank as a high density aggregated server chassis for modular blades - Google Patents

Liquid immersion cooling tank as a high density aggregated server chassis for modular blades Download PDF

Info

Publication number
US20210378148A1
US20210378148A1 US16/889,023 US202016889023A US2021378148A1 US 20210378148 A1 US20210378148 A1 US 20210378148A1 US 202016889023 A US202016889023 A US 202016889023A US 2021378148 A1 US2021378148 A1 US 2021378148A1
Authority
US
United States
Prior art keywords
blade
modular
blades
cooling tank
liquid immersion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US16/889,023
Inventor
Robert CV Chen
Calvin CHU
Dennis Dantog Ignacio
Shankar Kesavan
Vincent Quan Hoang
Arvind Bhargava
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US16/889,023 priority Critical patent/US20210378148A1/en
Priority to US17/473,932 priority patent/US11304340B2/en
Publication of US20210378148A1 publication Critical patent/US20210378148A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05KPRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K7/00Constructional details common to different types of electric apparatus
    • H05K7/20Modifications to facilitate cooling, ventilating, or heating
    • H05K7/20709Modifications to facilitate cooling, ventilating, or heating for server racks or cabinets; for data centers, e.g. 19-inch computer racks
    • H05K7/20763Liquid cooling without phase change
    • H05K7/20772Liquid cooling without phase change within server blades for removing heat from heat source
    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05KPRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K7/00Constructional details common to different types of electric apparatus
    • H05K7/20Modifications to facilitate cooling, ventilating, or heating
    • H05K7/20709Modifications to facilitate cooling, ventilating, or heating for server racks or cabinets; for data centers, e.g. 19-inch computer racks
    • H05K7/20763Liquid cooling without phase change
    • H05K7/20781Liquid cooling without phase change within cabinets for removing heat from server blades
    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05KPRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K7/00Constructional details common to different types of electric apparatus
    • H05K7/20Modifications to facilitate cooling, ventilating, or heating
    • H05K7/20218Modifications to facilitate cooling, ventilating, or heating using a liquid coolant without phase change in electronic enclosures
    • H05K7/20236Modifications to facilitate cooling, ventilating, or heating using a liquid coolant without phase change in electronic enclosures by immersion
    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05KPRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K7/00Constructional details common to different types of electric apparatus
    • H05K7/20Modifications to facilitate cooling, ventilating, or heating
    • H05K7/20218Modifications to facilitate cooling, ventilating, or heating using a liquid coolant without phase change in electronic enclosures
    • H05K7/20272Accessories for moving fluid, for expanding fluid, for connecting fluid conduits, for distributing fluid, for removing gas or for preventing leakage, e.g. pumps, tanks or manifolds

Definitions

  • immersion cooling simplifies data center operations.
  • Conventional systems keep coolant inside a rack at a temperature safe for technical staff though higher temperatures are safe for electronic components and equipment.
  • Conventional coolants are made from synthetic stock used in domestic applications and cosmetics.
  • Immersion cooling systems also help reduce the number of service events by improving server reliability. Servers immersed in coolant are protected from dust and other air-pollutants, along with moisture and oxygen, hence corrosion. What is more, the absence of server fans eliminates vibrations and reseat errors.
  • Single servers are disaggregated into dedicated modular blades of same and similar functions to optimize a heat transfer and fluid dynamics in the liquid cooling tank by immersing the modular blades into a heat flow from hottest bottom components to cooler top components immersed therein.
  • the liquid immersion cooling tank further acts as the server chassis complete with power distribution, data and control buses and precludes the need for air cooling fans and aggregated processor, power distribution, data and control buses and support architectures.
  • the liquid immersion cooling tank aggregates the modular blades into a server chassis of dedicated functions.
  • a disclosed computer cooling system comprises a liquid immersion cooling tank configured as a disaggregated server chassis comprising an integrated power bus, an integrated control bus and an integrated data bus.
  • the system and integrated buses are configured to receive and service a plurality of modular blades resembling a beekeeper's box of vertical and spaced operation, insertion and extraction.
  • the system also includes a plurality of modular blades disaggregating and dedicating similar and same functions comprising at least one management blade, interfaces and peripherals blade, storage blade, CPU blade and at least one GPU blade, wherein each blade configures hottest operating components lowest in a heat flow via transverse mounted brackets and vented ends.
  • the system further includes a blade extraction mechanism comprising movable winches for manipulating the plurality of modular blades from a top side of the heat flow and a hydraulic lift for pushing each modular blade from a bottom of the heat flow out of the liquid immersion cooling tank.
  • Additional GPU and Storage modular blades are added to the disclosed system for scaling-out processing and storage needs, respectively.
  • a disclosed method for cooling a computer system includes configuring a liquid immersion cooling tank as a server chassis comprising an integrated bus for receiving and servicing a plurality of modular blades resembling a beekeeper's box of vertical and spaced operation, insertion and extraction.
  • the method also includes configuring a plurality of modular blades comprising disaggregated server components configured with respective with respective hottest operating components lowest in a heat flow in the liquid immersion cooling tank via transverse mounted brackets and vented lower ends.
  • the method additionally includes extracting one of the plurality of modular blades via a blade extraction mechanism simultaneously from a top side of the heat flow and from a bottom side of the heat flow out of the liquid immersion cooling tank.
  • the method further includes a heat flowing in the system from a coolest and a lowest point to a hotter and a highest point in the liquid immersion cooling tank and in each of the plurality of modular blades.
  • the liquid cooling immersion tank defines an access opening adjacent the highest point of the heat flow.
  • the method yet includes manipulating the modular blades from a top side of the heat flow via a modular blade extraction mechanism of movable winches.
  • the method includes pushing each modular blade from a bottom of the heat flow out of the liquid immersion cooling tank via a modular blade extraction mechanism of a hydraulic lift.
  • FIG. 1 depicts the liquid immersion cooling tank as a high density server chassis for modular blades in accordance with an embodiment of the present disclosure.
  • FIG. 2 depicts types of high density modular blades with integrated control, data and power buses in accordance with an embodiment of the present disclosure.
  • FIG. 3 depicts an expanded view of the liquid immersion cooling tank as a high density server chassis for modular blades with fluid circulation in accordance with an embodiment of the present disclosure.
  • FIG. 4 depicts a high speed backplane for control and data buses for signaling and communication between modular blades in accordance with an embodiment of the present disclosure.
  • FIG. 5 depicts block diagram components of a software defined network architecture with a layering technologies approach in accordance with an embodiment of the present disclosure.
  • FIG. 6 depicts a top view and end views of a single server with transverse brackets in accordance with an embodiment of the present disclosure.
  • FIG. 7 depicts a block diagram view of a partially disaggregated longitudinal processor server layout in accordance with an embodiment of the present disclosure.
  • FIG. 8 depicts a block diagram view of a partially disaggregated transverse processor server layout in accordance with an embodiment of the present disclosure.
  • FIG. 9 depicts a block diagram view of another partially disaggregated transverse server layout in accordance with an embodiment of the present disclosure.
  • FIG. 10 depicts a serviceability and modular blade extraction mechanism for the liquid immersion cooling tank as a high density server chassis in accordance with an embodiment of the present disclosure.
  • FIG. 11 depicts a flow diagram of a method of cooling the liquid immersion cooling tank as a high density server chassis in accordance with an embodiment of the present disclosure.
  • FIG. 12 depicts another flow diagram of a method of cooling the liquid immersion cooling tank as a high density server chassis in accordance with an embodiment of the present disclosure.
  • server chassis refers to a physical structure that is used to house or physically assemble servers in various different form factors.
  • the server chassis makes it possible to put multiple servers and other storage and peripheral equipment in a single physical body.
  • aggregated,’ and ‘disaggregated,’ refer respectively to components operating on a single substrate and on multiple substrates of varying percentages of same and similar component types.
  • an aggregated single server blade composes a processor, memory, management, power distribution, control and data buses.
  • a disaggregated modular blade comprises several processors and some support components for a partially disaggregated modular blade to all processors and no support components for a completely disaggregated modular blade.
  • a CPU modular blade for example, comprises all CPU components and very little support components if any.
  • another CPU modular blade for example comprises several co-processor CPUs and some support components.
  • a GPU modular blade, a Storage modular blade, a management modular blade, an accelerator modular blade, etc are dedicated to a particular function in the effective liquid immersion cooling tank as a server chasses to varying degrees based on heat transfer and fluid dynamics for thermal management thereof.
  • module blade refers to a disaggregated substrate for dedicating similar and same functions including but not limited to CPU (central processing unit), GPU (graphics processing unit), FPU (floating point processing unit), DSP (digital signal processor), Media processor, ASIC (application specific integrated circuit) processor, PSU (power supply unit), Storage, Interfaces, and Management as explained and detailed throughout the present disclosure.
  • Transverse is used throughout the present disclosure to describe components which are lengthwise situated side by side relative to a lengthwise side of a modular blade. In other words, transverse components are lengthwise parallel to a lateral dimension of the modular blade.
  • backplane refers to a group of electrical connectors in parallel with each other wherein each pin of each connector is linked to the same relative pin of all the other connectors. Therefore and accordingly, the phrase ‘tank as a chassis,’ is defined as each disaggregated modular blade having individual power needs supplied by an external Power Distribution Unit (PDU) that is either attached or built-in the cooling tank. Thus, there is no need for PSU (power supply units) and a removal of respective fans.
  • PDU Power Distribution Unit
  • module blade refers to the modular blades dedicated to specific functions such as GPU, CPU, Storage, Interface, Management and etc.
  • FIG. 1 depicts the liquid immersion cooling tank as a high density server chassis for modular blades in accordance with an embodiment of the present disclosure.
  • the depiction includes the cooling tank 5 , the cooling fluid 10 , the modular class blades 20 and the lid of the cooling tank 15 .
  • the lid 15 is shown hinged on a lengthwise side but may also hinge from any edge and not be hinged at all.
  • the lid may be metallic or a transparent material allowing visual inspection of the cooling tank.
  • the modular class blades 20 extend into the cooling fluid 10 and are therefore not depicted below a level of the cooling fluid 10 for depiction purposes. Also, the modular blades are covered and immersed completely in operation and not visible above the level of the cooling fluid 10 depicted.
  • FIG. 2 depicts types of high density modular blades with integrated control, data and power buses in accordance with an embodiment of the present disclosure.
  • the depiction includes the power bus 30 , the data bus 35 , the control bus 40 , the accelerator blade 45 , the central processing blade 50 , the storage blade 55 , the management blade 60 and the interfaces blade 65 disposed in the cooling tank (not shown).
  • the modular blades are shown outside of the cooling tank chassis but are immersed completely therein in operation.
  • the respective modular blades are shown in block diagram form but in built-out installation include components which are hereafter detailed and described.
  • FIG. 3 depicts an expanded view of the liquid immersion cooling tank as a high density server chassis for modular blades with fluid circulation in accordance with an embodiment of the present disclosure.
  • the depiction includes the immersion tank 5 , the graphics accelerator blades 45 , the central processing blade 50 , the storage blade 55 , the interface blade 65 and the management blades 60 , the fluid pump 75 , and the heat exchanger 80 .
  • the external power distribution 85 sits adjacent the cooling tank and supplies electrical power to each blade on a backplane or a power line.
  • the fluid pump 75 circulates the cooling fluid in the cooling tank through the heat exchanger 80 .
  • the cooling fluid 10 will circulate in the cooling tank 5 without the fluid and without the heat exchanger under physical properties of heat transfer and fluid dynamics. However, the fluid pump and the heat exchanger accelerate the heat transfer and fluid dynamics in a more time efficient manner.
  • the open server approach modularizes each blade for dedicated functions.
  • the central processing blade runs any Linux distribution.
  • the dedicated management blade enables administration, security and monitoring.
  • FIG. 4 depicts a high speed backplane for control and data buses for signaling and communication between modular blades in accordance with an embodiment of the present disclosure.
  • the depiction includes the cooling tank interior view of the GPU blade 45 , the CPU blade 50 , the storage blade 55 , the interface blade 65 and the management blade 60 .
  • a perspective view of a modular class blade 20 is included with a data bus 35 and a control bus 40 at an edge connector of the modular blade 20 .
  • the high speed connector cabling 90 supports the high speed backplane 90 in distributing power, data and control for signaling and communication modular blade to modular blade through the tank backplane and to peripherals and external digital hardware.
  • FIG. 5 depicts block diagram components of a software defined network architecture with a layering technologies approach in accordance with an embodiment of the present disclosure.
  • the depiction includes the control layer 95 , the data layer 100 , the application layer 105 , the SDN (software defined network) controller 110 , the SDN 120 , the SDN approach to layering of technologies 125 , the Northbound APIs (application programming interfaces) 130 and the Southbound APIs 135 .
  • FIG. 6 depicts a top view and end views of a single server with transverse brackets in accordance with an embodiment of the present disclosure.
  • the depiction includes the side panel removed 200 , the top end 215 , the bottom end 210 , the transverse mounted brackets 220 and the bottom end vents 215 .
  • Brackets are transverse mounted to not obstruct cooling liquid flow.
  • the chassis side panel exposes a lower third of the aggregated single server to provide optimal liquid contact for heat transfer and cooling. Medical grade metals are used throughout the system for optimal performance. Components are disposed on the aggregated single server with highest operating temperatures located at the lowest end of the chassis for optimal heat flow, optimal fluid dynamics and optimal heat transfer.
  • the bottom end 210 is vented for efficient liquid flow.
  • FIG. 7 depicts a block diagram view of a partially disaggregated longitudinal processor server layout in accordance with an embodiment of the present disclosure.
  • a GPU modular blade is a customized electronic circuit board mounted in a lightweight but strong chassis for installing and connecting a maximum number of Graphics Processing Unit (GPU) cards for immersion cooling. It will have provisions for power and current PCIE connectivity. It will have harnesses to secure GPU cards in place to prevent any movement while immersed in coolant liquid.
  • An implementation includes the processor units 235 which are GPU or CPU (central processing units) or FPU (floating point processing unit) or DSP (digital signal processor) or a Media processor or an ASIC processor depending on an aggregated or disaggregated implementation.
  • the PSU (power supply unit) 240 , the non-volatile solid state drive 245 , the PSU breakout board 250 and a subsequent processing unit 255 which is a CPU (central processing unit) or a subsequent GPU (graphics processing unit) or FPU or DSP or Media processor or an ASIC processor depending on an aggregated or disaggregated implementation.
  • a subsequent processing unit 255 which is a CPU (central processing unit) or a subsequent GPU (graphics processing unit) or FPU or DSP or Media processor or an ASIC processor depending on an aggregated or disaggregated implementation.
  • Embodiments of the disclosure include a modular blade configuration where the processing units 235 and 255 are respectively part of a co-processor CPU implementation or a co-processor GPU implementation or co-processor FPU or a DSP co-processor or Media co-processor or an ASIC co-processor implementation.
  • the processing unit 255 is located proximal the top and the processing units 235 are proximal a bottom of the aggregated single server
  • FIG. 8 depicts a block diagram view of a partially disaggregated transverse processor server layout in accordance with an embodiment of the present disclosure.
  • the CPU blade is a customized electronic board mounted in a lightweight but strong chassis for installing one or more CPUs and main memory. It will have industry specifications for CPU sockets and Dual In-line Memory Module sockets.
  • the Central Processing Blade is effectively a motherboard with external connections for PCIE and other peripherals such as network interfaces.
  • the Central Processing Blade is where the system's Operating System will be installed.
  • the depiction further includes the transverse mounted processor unit 235 which are GPU or CPU or FPU or DSP or Media processor or an ASIC processor depending on an aggregated or disaggregated implementation.
  • the PSU (power supply unit) 240 , the non-volatile solid state drive 245 , the PSU breakout board 250 and the subsequent processing unit 255 which is a GPU or a CPU or FPU or DSP or Media processor or ASIC processor depending on an aggregated or disaggregated implementation.
  • the subsequent processing unit 255 is located proximal the bottom and the transverse mounted processing units 235 are proximal a top thereof. The transverse orientation enables a top to bottom heat transfer and fluid dynamic for efficient cooling proximal a top thereof.
  • Embodiments of the disclosure include a modular blade configuration where the processing units 235 and 255 are respectively part of a co-processor CPU implementation or a co-processor GPU implementation or a FPU co-processor implementation or a DSP co-processor implementation or Media co-processor or ASIC co-processor.
  • an aggregated single server blade composes a processor, memory, management, power distribution, control and data buses.
  • a disaggregated modular CPU blade comprises several processors and some support components or comprises all processors and no support components. Therefore a CPU modular blade, for example, comprises all CPU components and very little support components if any.
  • another CPU modular blade for example, comprises several co-processor CPUs and some support components immersed in the liquid cooling tank as a server chassis to varying degrees based on heat transfer and fluid dynamics for thermal management thereof.
  • FIG. 9 depicts a block diagram view of another partially disaggregated transverse processor layout in accordance with an embodiment of the present disclosure.
  • the storage blade is a customized electronic board mounted in a lightweight but strong chassis for installing various types of Solid-State Drives (SSD) such as 2.5 inch Flash Drives and M.2 SSDs. It will effectively be a JBOF unit—Just a Bunch of Flash, with high-speed connections for minimal latency.
  • the depiction further includes the transverse mounted processor units 235 which are GPU or CPU or FPU or DSP or Media processor or ASIC processor depending on an aggregated or disaggregated implementation.
  • the PSU (power supply unit) 240 , the non-volatile solid state drive 245 , the PSU breakout board 250 and the subsequent processing unit 255 which is a CPU or a GPU or FPU or DSP or Media processor or ASIC processor depending on an aggregated or disaggregated implementation.
  • the subsequent processing unit 255 is located proximal the bottom and the transverse mounted processing units 235 are proximal a top of the single server. The transverse orientation enables a top to bottom heat transfer and fluid dynamic for efficient cooling proximal a bottom thereof.
  • Embodiments of the disclosure include a modular blade configuration where the processing units 235 and 255 are respectively part of a co-processor CPU implementation or a co-processor GPU implementation or FPU co-processor implementation or a DSP co-processor implementation or a Media co-processor or an ASIC co-processor.
  • FIG. 10 depicts a serviceability and modular blade extraction mechanism for the liquid immersion cooling tank as a high density server chassis in accordance with an embodiment of the present disclosure.
  • the interfaces blade is a customized electronic board mounted in a lightweight but strong chassis with multiple Network Interfaces (10 GB-Ethernet, 100 GB-Ethernet, 1000 GB-Ethernet, Optical, FiberChannel, and more. It will also have various Peripheral interfaces—PCIE, USB, Thunderbolt, Serial, Bluetooth, etc.
  • the depiction further includes the liquid immersion cooling tank 5 , the modular blades 20 , the hydraulic lift for pushing each modular class blade 20 out of the tank 5 , the blade extraction mechanism 310 with movable winches for manipulating the modular class blades 20 .
  • the depiction also includes the winches 320 , the maintenance platform 330 for drainage and access to components and the blade extraction boom 340 . Heavy duty locking casters are used for mobility and tank maintenance.
  • FIG. 11 depicts a flow diagram of a method of cooling the liquid immersion cooling tank as a high density server chassis in accordance with an embodiment of the present disclosure.
  • the method includes configuring 400 a liquid immersion cooling tank as a server chassis comprising an integrated bus for receiving and servicing a plurality of modular blades resembling a beekeeper's box of vertical and spaced operation, insertion and extraction.
  • the method also includes configuring 410 a plurality of modular blades dedicating disaggregated server components of similar functions with respective hottest operating components lowest in a heat flow in the liquid immersion cooling tank via transverse mounted brackets and vented lower ends.
  • the method further includes extracting 420 one of the plurality of modular blades via a blade extraction mechanism simultaneously from a top side of the heat flow and from a bottom side of the heat flow out of the liquid immersion cooling tank.
  • FIG. 12 depicts another flow diagram of a method of cooling the liquid immersion cooling tank as a high density server chassis in accordance with an embodiment of the present disclosure.
  • the method includes a heat flowing 430 in the system from a coolest and a lowest point to a hotter and a highest point in the liquid immersion cooling tank and in each of the plurality of modular blades.
  • the liquid cooling immersion tank defines an access opening adjacent the highest point of the heat flow.
  • the method also includes disaggregating 440 an aggregated server's functions into the plurality of modular blades by a dedicated same and similar function including processing, storing data and instructions, interfacing and managing administration, security and monitoring.
  • the method additionally includes manipulating 450 the modular blades from a top side of the heat flow via a modular blade extraction mechanism and pushing each modular blade from a bottom of the heat flow out of the liquid immersion cooling tank via a modular blade extraction mechanism of a hydraulic lift.
  • the disclosure disaggregates single aggregated servers into dedicated blades for GPUs, Central Processing units or FPUs, Storage, etc. for cooling tank immersion heat transfer via ambient and dynamic fluid dynamics.
  • the liquid immersion cooling tank aggregates the modular blades into a server chassis of dedicated functions
  • a modular GPU Blade is a customized electronic circuit board mounted in a lightweight but strong chassis for installing and connecting a maximum number of Graphics Processing Unit (GPU) cards for immersion cooling. It has provisions for power and current PCIE connectivity. It has harnesses to secure GPU cards in place to prevent any movement while immersed in the coolant liquid.
  • GPU Graphics Processing Unit
  • a modular Central Processing Blade is a customized electronic board mounted in a lightweight but strong chassis for installing one or more CPUs and main memory. It has industry specifications for CPU sockets and Dual In-line Memory Module sockets.
  • the Central Processing Blade is effectively a motherboard with external connections for PCIE and other peripherals such as network interfaces.
  • the Central Processing Blade is where the system's Operating System is installed.
  • a Floating Point processor is specially designed to carry out operations on floating-point numbers. Operations include addition, subtraction, multiplication, division, and square root. FPUs can also perform various transcendental functions such as exponential or trigonometric calculations, with varying accuracy so embodiments compute these functions in software. In aggregated servers, one or more FPUs are integrated as execution units within the central processing unit; however, many embedded processors do not have hardware support for floating-point operations while they increasingly have them as standard, at least 32-bit ones.
  • a Digital Signal Processor is used for measuring, filtering and/or compress digital or analog signals.
  • the signal processing means analysis and manipulation of signal. This processing can be done via computer or Application Specific Integrated Circuits (ASIC), Field Programmable Gate Array (FPGA) or Digital Signal Processor (DSP) to obtain the clear signal.
  • ASIC Application Specific Integrated Circuits
  • FPGA Field Programmable Gate Array
  • DSP Digital Signal Processor
  • the DSP processors are used in an oscilloscope, barcode scanners, mobile phones, printers, etc. These processors are fast and use for real-time applications.
  • a media processor is designed or created to deal with image, video and audio data in real-time.
  • the voice user interface and professional audio are the applications of the audio processor.
  • Some of the media processors are TN2302AP IP, IN2602 AP IP, DM3730, DM3725, DM37385, DM388, TMS320DM6467, TMS320DM6431, etc.
  • An ASIC processor (application-specific integrated circuits) are built for specific applications. These processors are small in size and consume low power. The design cost of ASIC is high and this is the main disadvantage.
  • the application-specific integrated circuit chips are used in satellites, modems, computers, etc. Some of the top ASICs manufacturer companies are Ams AG. Listed Company, Bitfury. Private Company, XMOS Semiconductor Private Company, Analogix Semiconductor Private Company, EDAptive Computing Private Company, Lumen Radio Private Company, Integrated Device Technology, Hookit. Private Company, etc.
  • a modular Storage Blade is a customized electronic board mounted in a lightweight but strong chassis for installing various types of Solid-State Drives (SSD) such as 2.5 inch Flash Drives and M.2 SSDs. It is effectively be a JBOF unit—Just a Bunch of Flash, with high-speed connections for minimal latency.
  • SSD Solid-State Drives
  • a modular Interfaces Blade is a customized electronic board mounted in a lightweight but strong chassis with multiple Network Interfaces (10 GB-Ethernet, 100 GB-Ethernet, 1000 GB-Ethernet, Optical, FiberChannel, and more. It has various Peripheral interfaces—PCIE, USB, Thunderbolt, Serial, Bluetooth, etc.
  • Each blade has individual power needs supplied by an external Power Distribution Unit (PDU) that is either attached or built-in the tank. Thus, there is no need for PSUs and the removal or disabling of respective fans.
  • the modular blades include at least one management blade, interfaces and peripherals blade, storage blade, Central Processing blade and one or more GPU blades. Additional GPU and Storage blades are easily added to the system for scaling-out processing and storage needs, respectively.
  • disaggregated processors are grouped on dedicated modular blades to optimize heat transfer and fluid dynamics in the liquid cooling tank by immersing the modular blades into a heat flow from hottest bottom components to cooler top components immersed therein.
  • the cooling tank further acts as the server chassis complete with power distribution, data and control buses and precludes the need for air cooling fans and aggregated processor and support architectures.
  • the liquid immersion cooling tank aggregates the modular blades into a server chassis of dedicated functions The disclosure therefore fills a need heretofore unmet in the cooling space for high density servers.

Abstract

The disclosed computer cooling system includes a liquid immersion cooling tank configured as a server chassis with an integrated power bus, control bus and data bus. The server chassis tank receives and services a plurality of modular blades including disaggregated single server components dedicated to similar functions and resembling a beekeeper's box of vertical and spaced operation, insertion and extraction. The modular blades include at least one management blade, interfaces and peripherals blade, storage blade, CPU blade and one or more GPU blades and other processors. Each blade configures hottest operating components lowest in a heat flow via transverse mounted brackets and vented ends. A blade extraction mechanism includes movable winches for manipulating the plurality of modular blades from a top side of the heat flow and a hydraulic lift for pushing each modular blade from a bottom of the heat flow out of the liquid immersion cooling tank.

Description

    BACKGROUND OF THE INVENTION
  • The first thing one notices walking into an immersion-cooled data center is the virtual silence. The high-pitched whirring of server fans and air handlers found in air-cooled sites are replace with the subtle hum of fluid pumps. Next, one realizes that the data center is not freezing cold. With immersion cooling, air conditioning is only needed for technician comfort. Air-cooled data centers are cold and noisy without the compute density of comparable immersion-cooled space.
  • Furthermore, immersion cooling simplifies data center operations. Conventional systems keep coolant inside a rack at a temperature safe for technical staff though higher temperatures are safe for electronic components and equipment. Conventional coolants are made from synthetic stock used in domestic applications and cosmetics.
  • In contrast to densely packed racks, there is no need to handle heavy IT equipment high in vertical racks or low to the ground when installing or retrieving servers. Also, the virtually silent environment eliminates the need for technical staff to wear hearing protection. Along with health considerations, immersion cooling also permits technical staff to communicate more easily to troubleshoot and resolve issues right at the rack.
  • Immersion cooling systems also help reduce the number of service events by improving server reliability. Servers immersed in coolant are protected from dust and other air-pollutants, along with moisture and oxygen, hence corrosion. What is more, the absence of server fans eliminates vibrations and reseat errors.
  • Cooling a data center never used to be so hard. But IT and data center professionals have watched the thermal design power (TDP) of chips rise almost 50% in the last decade, generating more heat and using more power than ever before. Rack density has grown. Hot GPUs (graphics processor units) are becoming the weapon of choice for tackling high-performance computing requirements.
  • SUMMARY OF THE INVENTION
  • Single servers are disaggregated into dedicated modular blades of same and similar functions to optimize a heat transfer and fluid dynamics in the liquid cooling tank by immersing the modular blades into a heat flow from hottest bottom components to cooler top components immersed therein. The liquid immersion cooling tank further acts as the server chassis complete with power distribution, data and control buses and precludes the need for air cooling fans and aggregated processor, power distribution, data and control buses and support architectures. In other words, the liquid immersion cooling tank aggregates the modular blades into a server chassis of dedicated functions.
  • A disclosed computer cooling system comprises a liquid immersion cooling tank configured as a disaggregated server chassis comprising an integrated power bus, an integrated control bus and an integrated data bus. The system and integrated buses are configured to receive and service a plurality of modular blades resembling a beekeeper's box of vertical and spaced operation, insertion and extraction. The system also includes a plurality of modular blades disaggregating and dedicating similar and same functions comprising at least one management blade, interfaces and peripherals blade, storage blade, CPU blade and at least one GPU blade, wherein each blade configures hottest operating components lowest in a heat flow via transverse mounted brackets and vented ends.
  • The system further includes a blade extraction mechanism comprising movable winches for manipulating the plurality of modular blades from a top side of the heat flow and a hydraulic lift for pushing each modular blade from a bottom of the heat flow out of the liquid immersion cooling tank. Heat flows in the system from a coolest and a lowest point to a hotter and a highest point in the liquid immersion cooling tank and in each of the plurality of modular blades and wherein the liquid immersion cooling tank defines an access opening adjacent the highest point of the heat flow. Additional GPU and Storage modular blades are added to the disclosed system for scaling-out processing and storage needs, respectively.
  • A disclosed method for cooling a computer system includes configuring a liquid immersion cooling tank as a server chassis comprising an integrated bus for receiving and servicing a plurality of modular blades resembling a beekeeper's box of vertical and spaced operation, insertion and extraction. The method also includes configuring a plurality of modular blades comprising disaggregated server components configured with respective with respective hottest operating components lowest in a heat flow in the liquid immersion cooling tank via transverse mounted brackets and vented lower ends. The method additionally includes extracting one of the plurality of modular blades via a blade extraction mechanism simultaneously from a top side of the heat flow and from a bottom side of the heat flow out of the liquid immersion cooling tank. The method further includes a heat flowing in the system from a coolest and a lowest point to a hotter and a highest point in the liquid immersion cooling tank and in each of the plurality of modular blades. The liquid cooling immersion tank defines an access opening adjacent the highest point of the heat flow. The method yet includes manipulating the modular blades from a top side of the heat flow via a modular blade extraction mechanism of movable winches. The method includes pushing each modular blade from a bottom of the heat flow out of the liquid immersion cooling tank via a modular blade extraction mechanism of a hydraulic lift.
  • Other aspects and advantages of embodiments of the disclosure will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, illustrated by way of example of the principles of the disclosure.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 depicts the liquid immersion cooling tank as a high density server chassis for modular blades in accordance with an embodiment of the present disclosure.
  • FIG. 2 depicts types of high density modular blades with integrated control, data and power buses in accordance with an embodiment of the present disclosure.
  • FIG. 3 depicts an expanded view of the liquid immersion cooling tank as a high density server chassis for modular blades with fluid circulation in accordance with an embodiment of the present disclosure.
  • FIG. 4 depicts a high speed backplane for control and data buses for signaling and communication between modular blades in accordance with an embodiment of the present disclosure.
  • FIG. 5 depicts block diagram components of a software defined network architecture with a layering technologies approach in accordance with an embodiment of the present disclosure.
  • FIG. 6 depicts a top view and end views of a single server with transverse brackets in accordance with an embodiment of the present disclosure.
  • FIG. 7 depicts a block diagram view of a partially disaggregated longitudinal processor server layout in accordance with an embodiment of the present disclosure.
  • FIG. 8 depicts a block diagram view of a partially disaggregated transverse processor server layout in accordance with an embodiment of the present disclosure.
  • FIG. 9 depicts a block diagram view of another partially disaggregated transverse server layout in accordance with an embodiment of the present disclosure.
  • FIG. 10 depicts a serviceability and modular blade extraction mechanism for the liquid immersion cooling tank as a high density server chassis in accordance with an embodiment of the present disclosure.
  • FIG. 11 depicts a flow diagram of a method of cooling the liquid immersion cooling tank as a high density server chassis in accordance with an embodiment of the present disclosure.
  • FIG. 12 depicts another flow diagram of a method of cooling the liquid immersion cooling tank as a high density server chassis in accordance with an embodiment of the present disclosure.
  • Throughout the description, similar reference numbers may be used to identify similar elements in the several embodiments and drawings. Although specific embodiments of the invention have been illustrated, the invention is not to be limited to the specific forms or arrangements of parts so described and illustrated. The scope of the invention is to be defined by the claims herein and their equivalents.
  • DETAILED DESCRIPTION
  • Reference will now be made to exemplary embodiments illustrated in the drawings and specific language will be used herein to describe the same. It will nevertheless be understood that no limitation of the scope of the disclosure is thereby intended. Alterations and further modifications of the inventive features illustrated herein and additional applications of the principles of the inventions as illustrated herein, which would occur to one skilled in the relevant art and having possession of this disclosure, are to be considered within the scope of the invention.
  • Throughout the present disclosure, the term ‘server chassis’ refers to a physical structure that is used to house or physically assemble servers in various different form factors. The server chassis makes it possible to put multiple servers and other storage and peripheral equipment in a single physical body. The terms ‘aggregated,’ and ‘disaggregated,’ refer respectively to components operating on a single substrate and on multiple substrates of varying percentages of same and similar component types. In other words, an aggregated single server blade composes a processor, memory, management, power distribution, control and data buses. A disaggregated modular blade comprises several processors and some support components for a partially disaggregated modular blade to all processors and no support components for a completely disaggregated modular blade. Therefore a CPU modular blade, for example, comprises all CPU components and very little support components if any. On the other hand, another CPU modular blade, for example comprises several co-processor CPUs and some support components. Similarly, a GPU modular blade, a Storage modular blade, a management modular blade, an accelerator modular blade, etc, are dedicated to a particular function in the effective liquid immersion cooling tank as a server chasses to varying degrees based on heat transfer and fluid dynamics for thermal management thereof.
  • The term ‘modular blade,’ refers to a disaggregated substrate for dedicating similar and same functions including but not limited to CPU (central processing unit), GPU (graphics processing unit), FPU (floating point processing unit), DSP (digital signal processor), Media processor, ASIC (application specific integrated circuit) processor, PSU (power supply unit), Storage, Interfaces, and Management as explained and detailed throughout the present disclosure. ‘Transverse,’ is used throughout the present disclosure to describe components which are lengthwise situated side by side relative to a lengthwise side of a modular blade. In other words, transverse components are lengthwise parallel to a lateral dimension of the modular blade. The term ‘backplane,’ refers to a group of electrical connectors in parallel with each other wherein each pin of each connector is linked to the same relative pin of all the other connectors. Therefore and accordingly, the phrase ‘tank as a chassis,’ is defined as each disaggregated modular blade having individual power needs supplied by an external Power Distribution Unit (PDU) that is either attached or built-in the cooling tank. Thus, there is no need for PSU (power supply units) and a removal of respective fans. The term ‘modular class blade,’ refers to the modular blades dedicated to specific functions such as GPU, CPU, Storage, Interface, Management and etc.
  • FIG. 1 depicts the liquid immersion cooling tank as a high density server chassis for modular blades in accordance with an embodiment of the present disclosure. The depiction includes the cooling tank 5, the cooling fluid 10, the modular class blades 20 and the lid of the cooling tank 15. The lid 15 is shown hinged on a lengthwise side but may also hinge from any edge and not be hinged at all. The lid may be metallic or a transparent material allowing visual inspection of the cooling tank. The modular class blades 20 extend into the cooling fluid 10 and are therefore not depicted below a level of the cooling fluid 10 for depiction purposes. Also, the modular blades are covered and immersed completely in operation and not visible above the level of the cooling fluid 10 depicted.
  • FIG. 2 depicts types of high density modular blades with integrated control, data and power buses in accordance with an embodiment of the present disclosure. The depiction includes the power bus 30, the data bus 35, the control bus 40, the accelerator blade 45, the central processing blade 50, the storage blade 55, the management blade 60 and the interfaces blade 65 disposed in the cooling tank (not shown). For depiction purposes, the modular blades are shown outside of the cooling tank chassis but are immersed completely therein in operation. Also for depiction purposes, the respective modular blades are shown in block diagram form but in built-out installation include components which are hereafter detailed and described.
  • FIG. 3 depicts an expanded view of the liquid immersion cooling tank as a high density server chassis for modular blades with fluid circulation in accordance with an embodiment of the present disclosure. The depiction includes the immersion tank 5, the graphics accelerator blades 45, the central processing blade 50, the storage blade 55, the interface blade 65 and the management blades 60, the fluid pump 75, and the heat exchanger 80. The external power distribution 85 sits adjacent the cooling tank and supplies electrical power to each blade on a backplane or a power line. The fluid pump 75 circulates the cooling fluid in the cooling tank through the heat exchanger 80. The cooling fluid 10 will circulate in the cooling tank 5 without the fluid and without the heat exchanger under physical properties of heat transfer and fluid dynamics. However, the fluid pump and the heat exchanger accelerate the heat transfer and fluid dynamics in a more time efficient manner. The open server approach modularizes each blade for dedicated functions. The central processing blade runs any Linux distribution. The dedicated management blade enables administration, security and monitoring.
  • FIG. 4 depicts a high speed backplane for control and data buses for signaling and communication between modular blades in accordance with an embodiment of the present disclosure. The depiction includes the cooling tank interior view of the GPU blade 45, the CPU blade 50, the storage blade 55, the interface blade 65 and the management blade 60. A perspective view of a modular class blade 20 is included with a data bus 35 and a control bus 40 at an edge connector of the modular blade 20. The high speed connector cabling 90 supports the high speed backplane 90 in distributing power, data and control for signaling and communication modular blade to modular blade through the tank backplane and to peripherals and external digital hardware.
  • FIG. 5 depicts block diagram components of a software defined network architecture with a layering technologies approach in accordance with an embodiment of the present disclosure. The depiction includes the control layer 95, the data layer 100, the application layer 105, the SDN (software defined network) controller 110, the SDN 120, the SDN approach to layering of technologies 125, the Northbound APIs (application programming interfaces)130 and the Southbound APIs 135.
  • FIG. 6 depicts a top view and end views of a single server with transverse brackets in accordance with an embodiment of the present disclosure. The depiction includes the side panel removed 200, the top end 215, the bottom end 210, the transverse mounted brackets 220 and the bottom end vents 215. Brackets are transverse mounted to not obstruct cooling liquid flow. The chassis side panel exposes a lower third of the aggregated single server to provide optimal liquid contact for heat transfer and cooling. Medical grade metals are used throughout the system for optimal performance. Components are disposed on the aggregated single server with highest operating temperatures located at the lowest end of the chassis for optimal heat flow, optimal fluid dynamics and optimal heat transfer. The bottom end 210 is vented for efficient liquid flow.
  • FIG. 7 depicts a block diagram view of a partially disaggregated longitudinal processor server layout in accordance with an embodiment of the present disclosure. A GPU modular blade is a customized electronic circuit board mounted in a lightweight but strong chassis for installing and connecting a maximum number of Graphics Processing Unit (GPU) cards for immersion cooling. It will have provisions for power and current PCIE connectivity. It will have harnesses to secure GPU cards in place to prevent any movement while immersed in coolant liquid. An implementation includes the processor units 235 which are GPU or CPU (central processing units) or FPU (floating point processing unit) or DSP (digital signal processor) or a Media processor or an ASIC processor depending on an aggregated or disaggregated implementation. The PSU (power supply unit) 240, the non-volatile solid state drive 245, the PSU breakout board 250 and a subsequent processing unit 255 which is a CPU (central processing unit) or a subsequent GPU (graphics processing unit) or FPU or DSP or Media processor or an ASIC processor depending on an aggregated or disaggregated implementation. Embodiments of the disclosure include a modular blade configuration where the processing units 235 and 255 are respectively part of a co-processor CPU implementation or a co-processor GPU implementation or co-processor FPU or a DSP co-processor or Media co-processor or an ASIC co-processor implementation. The processing unit 255 is located proximal the top and the processing units 235 are proximal a bottom of the aggregated single server.
  • FIG. 8 depicts a block diagram view of a partially disaggregated transverse processor server layout in accordance with an embodiment of the present disclosure. The CPU blade is a customized electronic board mounted in a lightweight but strong chassis for installing one or more CPUs and main memory. It will have industry specifications for CPU sockets and Dual In-line Memory Module sockets. The Central Processing Blade is effectively a motherboard with external connections for PCIE and other peripherals such as network interfaces. The Central Processing Blade is where the system's Operating System will be installed. The depiction further includes the transverse mounted processor unit 235 which are GPU or CPU or FPU or DSP or Media processor or an ASIC processor depending on an aggregated or disaggregated implementation. The PSU (power supply unit) 240, the non-volatile solid state drive 245, the PSU breakout board 250 and the subsequent processing unit 255 which is a GPU or a CPU or FPU or DSP or Media processor or ASIC processor depending on an aggregated or disaggregated implementation. The subsequent processing unit 255 is located proximal the bottom and the transverse mounted processing units 235 are proximal a top thereof. The transverse orientation enables a top to bottom heat transfer and fluid dynamic for efficient cooling proximal a top thereof. Embodiments of the disclosure include a modular blade configuration where the processing units 235 and 255 are respectively part of a co-processor CPU implementation or a co-processor GPU implementation or a FPU co-processor implementation or a DSP co-processor implementation or Media co-processor or ASIC co-processor.
  • In other words, an aggregated single server blade composes a processor, memory, management, power distribution, control and data buses. A disaggregated modular CPU blade comprises several processors and some support components or comprises all processors and no support components. Therefore a CPU modular blade, for example, comprises all CPU components and very little support components if any. On the other hand, another CPU modular blade, for example, comprises several co-processor CPUs and some support components immersed in the liquid cooling tank as a server chassis to varying degrees based on heat transfer and fluid dynamics for thermal management thereof.
  • FIG. 9 depicts a block diagram view of another partially disaggregated transverse processor layout in accordance with an embodiment of the present disclosure. The storage blade is a customized electronic board mounted in a lightweight but strong chassis for installing various types of Solid-State Drives (SSD) such as 2.5 inch Flash Drives and M.2 SSDs. It will effectively be a JBOF unit—Just a Bunch of Flash, with high-speed connections for minimal latency. The depiction further includes the transverse mounted processor units 235 which are GPU or CPU or FPU or DSP or Media processor or ASIC processor depending on an aggregated or disaggregated implementation. The PSU (power supply unit) 240, the non-volatile solid state drive 245, the PSU breakout board 250 and the subsequent processing unit 255 which is a CPU or a GPU or FPU or DSP or Media processor or ASIC processor depending on an aggregated or disaggregated implementation. The subsequent processing unit 255 is located proximal the bottom and the transverse mounted processing units 235 are proximal a top of the single server. The transverse orientation enables a top to bottom heat transfer and fluid dynamic for efficient cooling proximal a bottom thereof. Embodiments of the disclosure include a modular blade configuration where the processing units 235 and 255 are respectively part of a co-processor CPU implementation or a co-processor GPU implementation or FPU co-processor implementation or a DSP co-processor implementation or a Media co-processor or an ASIC co-processor.
  • FIG. 10 depicts a serviceability and modular blade extraction mechanism for the liquid immersion cooling tank as a high density server chassis in accordance with an embodiment of the present disclosure. The interfaces blade is a customized electronic board mounted in a lightweight but strong chassis with multiple Network Interfaces (10 GB-Ethernet, 100 GB-Ethernet, 1000 GB-Ethernet, Optical, FiberChannel, and more. It will also have various Peripheral interfaces—PCIE, USB, Thunderbolt, Serial, Bluetooth, etc. The depiction further includes the liquid immersion cooling tank 5, the modular blades 20, the hydraulic lift for pushing each modular class blade 20 out of the tank 5, the blade extraction mechanism 310 with movable winches for manipulating the modular class blades 20. The depiction also includes the winches 320, the maintenance platform 330 for drainage and access to components and the blade extraction boom 340. Heavy duty locking casters are used for mobility and tank maintenance.
  • FIG. 11 depicts a flow diagram of a method of cooling the liquid immersion cooling tank as a high density server chassis in accordance with an embodiment of the present disclosure. The method includes configuring 400 a liquid immersion cooling tank as a server chassis comprising an integrated bus for receiving and servicing a plurality of modular blades resembling a beekeeper's box of vertical and spaced operation, insertion and extraction. The method also includes configuring 410 a plurality of modular blades dedicating disaggregated server components of similar functions with respective hottest operating components lowest in a heat flow in the liquid immersion cooling tank via transverse mounted brackets and vented lower ends. The method further includes extracting 420 one of the plurality of modular blades via a blade extraction mechanism simultaneously from a top side of the heat flow and from a bottom side of the heat flow out of the liquid immersion cooling tank.
  • FIG. 12 depicts another flow diagram of a method of cooling the liquid immersion cooling tank as a high density server chassis in accordance with an embodiment of the present disclosure. The method includes a heat flowing 430 in the system from a coolest and a lowest point to a hotter and a highest point in the liquid immersion cooling tank and in each of the plurality of modular blades. The liquid cooling immersion tank defines an access opening adjacent the highest point of the heat flow. The method also includes disaggregating 440 an aggregated server's functions into the plurality of modular blades by a dedicated same and similar function including processing, storing data and instructions, interfacing and managing administration, security and monitoring. The method additionally includes manipulating 450 the modular blades from a top side of the heat flow via a modular blade extraction mechanism and pushing each modular blade from a bottom of the heat flow out of the liquid immersion cooling tank via a modular blade extraction mechanism of a hydraulic lift.
  • In other words, the disclosure disaggregates single aggregated servers into dedicated blades for GPUs, Central Processing units or FPUs, Storage, etc. for cooling tank immersion heat transfer via ambient and dynamic fluid dynamics. The liquid immersion cooling tank aggregates the modular blades into a server chassis of dedicated functions
  • For example a modular GPU Blade is a customized electronic circuit board mounted in a lightweight but strong chassis for installing and connecting a maximum number of Graphics Processing Unit (GPU) cards for immersion cooling. It has provisions for power and current PCIE connectivity. It has harnesses to secure GPU cards in place to prevent any movement while immersed in the coolant liquid.
  • A modular Central Processing Blade is a customized electronic board mounted in a lightweight but strong chassis for installing one or more CPUs and main memory. It has industry specifications for CPU sockets and Dual In-line Memory Module sockets. The Central Processing Blade is effectively a motherboard with external connections for PCIE and other peripherals such as network interfaces. The Central Processing Blade is where the system's Operating System is installed.
  • A Floating Point processor is specially designed to carry out operations on floating-point numbers. Operations include addition, subtraction, multiplication, division, and square root. FPUs can also perform various transcendental functions such as exponential or trigonometric calculations, with varying accuracy so embodiments compute these functions in software. In aggregated servers, one or more FPUs are integrated as execution units within the central processing unit; however, many embedded processors do not have hardware support for floating-point operations while they increasingly have them as standard, at least 32-bit ones.
  • A Digital Signal Processor is used for measuring, filtering and/or compress digital or analog signals. The signal processing means analysis and manipulation of signal. This processing can be done via computer or Application Specific Integrated Circuits (ASIC), Field Programmable Gate Array (FPGA) or Digital Signal Processor (DSP) to obtain the clear signal. The DSP processors are used in an oscilloscope, barcode scanners, mobile phones, printers, etc. These processors are fast and use for real-time applications.
  • A media processor is designed or created to deal with image, video and audio data in real-time. The voice user interface and professional audio are the applications of the audio processor. Some of the media processors are TN2302AP IP, IN2602 AP IP, DM3730, DM3725, DM37385, DM388, TMS320DM6467, TMS320DM6431, etc
  • An ASIC processor (application-specific integrated circuits) are built for specific applications. These processors are small in size and consume low power. The design cost of ASIC is high and this is the main disadvantage. The application-specific integrated circuit chips are used in satellites, modems, computers, etc. Some of the top ASICs manufacturer companies are Ams AG. Listed Company, Bitfury. Private Company, XMOS Semiconductor Private Company, Analogix Semiconductor Private Company, EDAptive Computing Private Company, Lumen Radio Private Company, Integrated Device Technology, Hookit. Private Company, etc.
  • A modular Storage Blade is a customized electronic board mounted in a lightweight but strong chassis for installing various types of Solid-State Drives (SSD) such as 2.5 inch Flash Drives and M.2 SSDs. It is effectively be a JBOF unit—Just a Bunch of Flash, with high-speed connections for minimal latency.
  • A modular Interfaces Blade is a customized electronic board mounted in a lightweight but strong chassis with multiple Network Interfaces (10 GB-Ethernet, 100 GB-Ethernet, 1000 GB-Ethernet, Optical, FiberChannel, and more. It has various Peripheral interfaces—PCIE, USB, Thunderbolt, Serial, Bluetooth, etc.
  • Each blade has individual power needs supplied by an external Power Distribution Unit (PDU) that is either attached or built-in the tank. Thus, there is no need for PSUs and the removal or disabling of respective fans. The modular blades include at least one management blade, interfaces and peripherals blade, storage blade, Central Processing blade and one or more GPU blades. Additional GPU and Storage blades are easily added to the system for scaling-out processing and storage needs, respectively.
  • Therefore, in embodiments of the disclosure, disaggregated processors are grouped on dedicated modular blades to optimize heat transfer and fluid dynamics in the liquid cooling tank by immersing the modular blades into a heat flow from hottest bottom components to cooler top components immersed therein. The cooling tank further acts as the server chassis complete with power distribution, data and control buses and precludes the need for air cooling fans and aggregated processor and support architectures. The liquid immersion cooling tank aggregates the modular blades into a server chassis of dedicated functions The disclosure therefore fills a need heretofore unmet in the cooling space for high density servers.
  • Although the operations of the method(s) herein are shown and described in a particular order, the order of the operations of each method may be altered so that certain operations may be performed in an inverse order or so that certain operations may be performed, at least in part, concurrently with other operations. In another embodiment, instructions or sub-operations of distinct operations may be implemented in an intermittent and/or alternating manner.
  • While the forgoing examples are illustrative of the principles of the present disclosure in one or more particular applications, it will be apparent to those of ordinary skill in the art that numerous modifications in form, usage and details of implementation can be made without the exercise of inventive faculty, and without departing from the principles and concepts of the invention. Accordingly, it is not intended that the disclosure be limited, except as by the specification and claims set forth herein.

Claims (20)

What is claimed is:
1. A computer cooling system comprising:
a plurality of modular blades each dedicated to a singular function of different functions including graphics, central processing, memory storage, peripheral interface and device management via components disaggregated for a heat transfer from an aggregated server of the different functions;
a liquid immersion cooling tank configured as a server chassis of the plurality of modular blades comprising a backplane power bus, control bus and data bus and configured to group the heat transfer of the disaggregated components by the respective singular function of each of the plurality of modular blades;
wherein the liquid immersion cooling tank aggregates the plurality of modular blades into a single server chassis of the different functions.
2. (canceled)
3. (canceled)
4. (canceled)
5. The system of claim 1, further comprising a modular blade extraction mechanism configured to remove the plurality of modular blades from a top side of the heat flow and from a bottom side of the heat flow out of the liquid immersion cooling tank.
6. The system of claim 5, wherein the modular blade extraction mechanism comprises movable winches for manipulating the plurality of modular blades from a top side of the heat flow.
7. The system of claim 5, wherein the modular blade extraction mechanism further comprises a hydraulic lift configured to push each modular blade from a bottom of the heat flow out of the liquid immersion cooling tank.
8. The system of claim 1, further comprising a fluid pump and a heat exchanger and a redundant fluid pump and a redundant heat exchanger configured to remove heat from the heat flow in the liquid immersion cooling tank.
9. The system of claim 1, further comprising a plurality of power supply components integral to the liquid immersion cooling tank and having disabled air fans to reduce a power consumption of the system.
10. The system of claim 1, wherein the integrated buses further comprise a built-in backplane configured to serve as a control bus and as a data bus for a signaling and a communication between the plurality of modular blades.
11. The system of claim 1, wherein the plurality of modular blades further comprises a dedicated management blade for blade administration, blade security and blade monitoring.
12. The system of claim 1, further comprising a software defined network controller configured to logically decouple a control modular blade from a data modular blade of the plurality of modular blades and enable a scalability of a number of the plurality of modular blades.
13. The system of claim 1, wherein each of the respective hottest operating components of the plurality of modular blades, each further comprises a spring loaded reduced z coordinate height double riser and heat sink.
14. The system of claim 1, wherein the respective hottest operating components of the plurality of modular blades comprises a plurality of GPU (graphics processor units), a plurality of CPU (central processing unit) and a PSU (power supply unit).
15. The system of claim 1, wherein the liquid immersion cooling tank further comprises double hull stainless steel walls to prevent corrosion and leakage of the liquid therein.
16. The system of claim 1, further comprising a maintenance platform configured for drainage and access to the plurality of modular blades, the integrated bus and the modular blade extraction mechanism.
17. The system of claim 1, wherein the liquid immersion cooling tank further comprises an integrated temperature gauge, temperature alarm and RFID (radio frequency identification).
18. (canceled)
19. (canceled)
20. A computer cooling system, comprising:
a) a liquid immersion cooling tank configured as a server chassis comprising a backplane having a power bus, a control bus and a data bus and configured to receive and service a plurality of modular blades resembling a beekeeper's box of vertical and spaced operation, insertion and extraction;
b) a plurality of modular blades comprising at least one disaggregated management blade, interfaces and peripherals blade, storage blade, CPU blade and GPU blade, wherein each blade configures hottest operating components lowest in a coolest portion of a heat flow to optimize heat transfer; and
c) a blade extraction mechanism comprising movable winches for manipulating the plurality of modular blades from a top side of the heat flow and a hydraulic lift for pushing each modular blade from a bottom of the heat flow out of the liquid immersion cooling tank,
wherein the ambient heat flows from a coolest and a lowest point to a hotter and a highest point in the liquid immersion cooling tank and in each of the plurality of modular blades and wherein the liquid immersion cooling tank aggregates the modular blades into a single server chassis of dedicated functions.
US16/889,023 2020-06-01 2020-06-01 Liquid immersion cooling tank as a high density aggregated server chassis for modular blades Abandoned US20210378148A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US16/889,023 US20210378148A1 (en) 2020-06-01 2020-06-01 Liquid immersion cooling tank as a high density aggregated server chassis for modular blades
US17/473,932 US11304340B2 (en) 2020-06-01 2021-09-13 Liquid immersion cooling tank as a high density aggregated server chassis for modular blades

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US16/889,023 US20210378148A1 (en) 2020-06-01 2020-06-01 Liquid immersion cooling tank as a high density aggregated server chassis for modular blades

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/473,932 Division US11304340B2 (en) 2020-06-01 2021-09-13 Liquid immersion cooling tank as a high density aggregated server chassis for modular blades

Publications (1)

Publication Number Publication Date
US20210378148A1 true US20210378148A1 (en) 2021-12-02

Family

ID=78704654

Family Applications (2)

Application Number Title Priority Date Filing Date
US16/889,023 Abandoned US20210378148A1 (en) 2020-06-01 2020-06-01 Liquid immersion cooling tank as a high density aggregated server chassis for modular blades
US17/473,932 Active US11304340B2 (en) 2020-06-01 2021-09-13 Liquid immersion cooling tank as a high density aggregated server chassis for modular blades

Family Applications After (1)

Application Number Title Priority Date Filing Date
US17/473,932 Active US11304340B2 (en) 2020-06-01 2021-09-13 Liquid immersion cooling tank as a high density aggregated server chassis for modular blades

Country Status (1)

Country Link
US (2) US20210378148A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220361381A1 (en) * 2021-05-06 2022-11-10 Tyco Fire & Security Gmbh Liquid immersion cooling tank with variable flow for high density computer server equipment
US20220361365A1 (en) * 2021-05-06 2022-11-10 Tyco Fire & Security Gmbh Electrical power distribution optimized liquid immersion cooling tank with variable flow for high density computer server equipment
US20230123999A1 (en) * 2021-10-15 2023-04-20 Dell Products, L.P. High-availability (ha) management networks for high performance computing platforms

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117715394B (en) * 2024-02-06 2024-04-19 广州豪特节能环保科技股份有限公司 Liquid cooling intelligent control system based on data center

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9195282B2 (en) * 2013-02-01 2015-11-24 Dell Products, L.P. Vertically-oriented immersion server with vapor bubble deflector
JP6980969B2 (en) * 2016-04-13 2021-12-15 富士通株式会社 Data center and data center control method
JP6658312B2 (en) * 2016-06-01 2020-03-04 富士通株式会社 Immersion cooling device, immersion cooling system, and control method of immersion cooling device
WO2018087905A1 (en) * 2016-11-12 2018-05-17 株式会社ExaScaler Electronic device for liquid immersion cooling, power supply unit, and cooling system
JP6939034B2 (en) * 2017-04-05 2021-09-22 富士通株式会社 Cooling systems, cooling devices, and electronic systems
EP3623902A4 (en) * 2017-05-11 2021-03-31 Exascaler Inc. Electronic device for immersion cooling, and processor module for immersion cooling
US10653043B2 (en) * 2018-09-19 2020-05-12 TMGCore, LLC Vapor management system for a liquid immersion cooling system
JP7235959B2 (en) * 2019-02-05 2023-03-09 富士通株式会社 Liquid immersion cooling device
US10750637B1 (en) * 2019-10-24 2020-08-18 Microsoft Technology Licensing, Llc Immersion cooling infrastructure module having compute device form factor
US20220390993A1 (en) * 2019-11-11 2022-12-08 TMGCore, LLC External robotic system for liquid immersion cooling platform

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220361381A1 (en) * 2021-05-06 2022-11-10 Tyco Fire & Security Gmbh Liquid immersion cooling tank with variable flow for high density computer server equipment
US20220361365A1 (en) * 2021-05-06 2022-11-10 Tyco Fire & Security Gmbh Electrical power distribution optimized liquid immersion cooling tank with variable flow for high density computer server equipment
US11678462B2 (en) * 2021-05-06 2023-06-13 Tyco Fire & Security Gmbh Electrical power distribution optimized liquid immersion cooling tank with variable flow for high density computer server equipment
US11696423B2 (en) * 2021-05-06 2023-07-04 Tyco Fire & Security Gmbh Liquid immersion cooling tank with variable flow for high density computer server equipment
US20230123999A1 (en) * 2021-10-15 2023-04-20 Dell Products, L.P. High-availability (ha) management networks for high performance computing platforms
US11809289B2 (en) * 2021-10-15 2023-11-07 Dell Products L.P. High-availability (HA) management networks for high performance computing platforms

Also Published As

Publication number Publication date
US11304340B2 (en) 2022-04-12
US20210410337A1 (en) 2021-12-30

Similar Documents

Publication Publication Date Title
US11304340B2 (en) Liquid immersion cooling tank as a high density aggregated server chassis for modular blades
EP2918151B1 (en) Twin server blades for high-density clustered computer system
CN108733178B (en) Heat removal method and system using heat removal liquid based on workload
US9872415B2 (en) Dry power supply assembly for immersion-cooled information handling systems
US20190150326A1 (en) Method for providing cooling to electronic racks using liquid cooling and air cooling
US10980154B1 (en) Cooling design for PCIE mounted server peripheral electronics
CN110557925A (en) Liquid cooled leak detection and response system for data center electronics racks
EP3270261A1 (en) Graphics card thermal interposer
US20190281730A1 (en) Design for cold plate assembly for server liquid cooling of electronic racks of a data center
US20120020006A1 (en) Server
US11147192B2 (en) Fluid cooling system for an enclosed electronic package
US20230025254A1 (en) Enhanced information handling system component immersion cooling via pump return connection
US20190324506A1 (en) Card-based extension cooling
RU2632400C1 (en) Computer cluster with submerged cooling system
US11589476B2 (en) Hybrid oil immersion server and associated computing rack
US11809893B2 (en) Systems and methods for collapsing resources used in cloud deployments
US20230065556A1 (en) Two phase system for enclosure systems
US20230109137A1 (en) Liquid cooling leakage abatement system and method of using the same
CN217034655U (en) Double-circuit server
US20170285696A1 (en) Method and Apparatus for Mounting Power Supplies in Rack-Mountable Computer Chassis
US20230026424A1 (en) Immersion cooling of information handling systems with on-node boost pumps
US20240078196A1 (en) Cxl persistent memory module link topology
US20100002376A1 (en) Planer Board with Integrated Cold Plate
US20240040734A1 (en) High-Density Chassis Supporting Replaceable Hardware Accelerators
TWI484323B (en) Server

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION