US20180088608A1

US20180088608A1 - Thermal capacity management

Info

Publication number: US20180088608A1
Application number: US15/819,318
Authority: US
Inventors: Mahmoud I. Ibrahim; Saurabh K. Shrivastava; Robert E. Wilcox
Original assignee: Panduit Corp
Current assignee: Panduit Corp
Priority date: 2013-09-04
Filing date: 2017-11-21
Publication date: 2018-03-29
Also published as: JP6469199B2; JP2018022525A; EP3042259B1; US9851726B2; EP3042259A1; US20150066219A1; JP2016532220A; JP6235149B2; WO2015034859A1

Abstract

Embodiments of the present disclosure generally relate to the field of thermal capacity management within data centers. In an embodiment, the present disclosure describes a method including using temperature measurements to provide real-time capacity usage information in a given data center and to use that information to perform moves/adds/changes with a particular level of confidence.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of, and claims the benefits of priority to, U.S. patent application Ser. No. 14/474,496, filed on Sep. 2, 2014 (now allowed), and U.S. Provisional Patent Application No. 61/873,632, filed on Sep. 4, 2013, which are incorporated herein by reference in their entireties.

FIELD OF INVENTION

Embodiment of the present invention generally relate to the field of thermal capacity management within data centers, and more specifically, to methods and systems which provide feedback based on thermal information associated with parts of a data center.

BACKGROUND

Data centers are often designed with a projected capacity, which is usually more than twice the capacity utilized in the first day of its operation. Consequently, over time, equipment within the data center gets updated, replaced, and added as necessitated by the operational needs. Given the changes which take place during the life of a data center, it is important to be aware of what locations can be considered safe for new equipment. The safety factor is not only dictated by the available rack unit (RU) spaces within cabinets, the cabinet weight limits, and power availability, but more importantly it is also dictated by the available cooling (thermal) capacity at a given cabinet.
Various systems direct to thermal capacity management have been developed. However, continued need by data center managers for new ways of evaluating thermal capacity of a data center and how electronic equipment impacts this capacity creates a need for new and improved systems and methods related to this field.

SUMMARY

Accordingly, at least some embodiment of the present invention are generally directed to systems and methods for providing feedback information based on thermal and power variables.
In an embodiment, the present invention is a method comprising the steps of using temperature measurements and power meter readings to provide a real-time capacity usage in a given data center.
In another embodiment, the present invention is a system for managing cooling capacity within a data center or within a subset of a data center, where the system includes at least one processor; and a computer readable medium connected to the at least one processor. The computer readable medium includes instructions for collecting information from a plurality of cabinets, the information including an inlet temperature, a maximum allowable cabinet temperature, and a supply air temperature, where the collected temperatures are used to calculate a value Theta for each of the plurality of cabinets. The computer readable medium further includes instructions for determining whether any of the calculated Theta values indicates that any of the plurality of cabinets' inlet temperatures is at least one of below, at, and above the respective maximum allowable cabinet temperature. The computer readable medium further includes instructions for determining whether, based on any of the calculated Theta values, performed cooling capacity management will satisfy a user confidence level, and if the confidence level is satisfied, for distributing the remaining cooling capacity over at the plurality of cabinets.
In yet another embodiment, the present invention is a non-transitory computer readable storage medium including a sequence of instructions stored thereon for causing a computer to execute a method for managing cooling capacity within a data center. The method includes collecting cabinet information from each of a plurality of cabinets, the cabinet information including an inlet temperature, a maximum allowable cabinet temperature, and a supply air temperature. The method also includes collecting a total power consumption for the plurality of cabinets. The method also includes collecting a total cooling capacity for the plurality of cabinets. The method also includes deriving a remaining cooling capacity for the plurality of cabinets. The method also includes for each of the plurality of cabinets calculating a θ value, each of the calculated θ values being calculated at least in part from the respective collected cabinet information. And the method also includes for each of the calculated θ values determining whether any one of the plurality of cabinets' inlet temperatures is at least one of below, at, and above the respective maximum allowable cabinet temperatures, where if any one of the inlet temperatures is at least one of at and above the respective maximum allowable cabinet temperatures, providing a first alarm, and where if all of the inlet temperatures are below the respective maximum allowable cabinet temperatures, determining whether each of the calculated θ values is at least one of below, at, and above a user-defined θ value, where if any one of the calculated θ values is at least one of at and above the user-defined θ value, providing a second alarm, and where if all of the calculated θ values are below the user-defined θ value, distributing the remaining cooling capacity over the plurality of cabinets.
These and other features, aspects, and advantages of the present invention will become better-understood with reference to the following drawings, description, and any claims that may follow.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a flow chart representative of an embodiment of the present invention.

FIG. 2 illustrates the correlation between a confidence percentage and a Theta value.

FIG. 3 illustrates an executed embodiment of the present invention.

DETAILED DESCRIPTION

Referring now to FIG. 1, this figure illustrates a flowchart showing the steps performed in one embodiment of the present invention. In the initial step 100, cabinet inlet temperatures T_max,iare obtained from the available cabinets within the data center. This can be achieved by monitoring temperature sensors which are installed within the cabinets. While in instances where only one sensor is installed, only one temperature reading can be obtained, in instances where multiple sensors are installed in a cabinet, it is preferable to use the maximum recorded temperature for the T_max,ivalue. Alternatively, average values may be considered.
In the next step 105, power consumption values P_iare obtained from the available cabinets. One way of obtaining the necessary real-time power readings is to collect power usage information from power outlet units (POUs) which are typically installed in data center cabinets. Each POU provides a total power usage reading for the respective cabinet. Adding the available POU readings from each of the cabinets present within a data center or within a subset of a data center provides the total power usage value ΣP_ifor the respective data center or for a respective subset of that data center.
In the next step 110, the total cooling capacity of a data center or of a subset of a data center is calculated. This can be done by using manufacturer-supplied data, such as the rated capacity of the cooling equipment within the data center. Using this data, the rated capacity of the cooling equipment within the data center or within a subset of a data center are summed together and are used to obtain the total remaining cooling capacity available at the current specified cooling equipment set-point.
Having the total power usage, it is then possible to determine the remaining cooling capacity in step 115. To do this, the total power usage ΣP_icalculated in step 105 is subtracted from the total cooling capacity calculated in step 110. The resulting P_coolvalue.
Next, it is necessary to calculate a non-dimensional parameter Theta (θ). This parameter is computed for at least one cabinet, and preferably for every cabinet in a data center or a subset of a data center. For every cabinet, Theta is calculated using the maximum inlet cabinet temperature T_max,i, maximum allowable temperature T_Allowable, and the supply air temperature T_SATof the air being supplied by the cooling equipment, where θ is derived using the following equation:
$θ = \frac{T_{\max, i} - T_{SAT}}{T_{Allowable} - T_{SAT}}$
The maximum allowable temperature T_Allowablecan be obtained either from the manufacturer's specification or this value may be set to any value deemed appropriate by the user. The supply air temperature T_SATof the air being supplied by the cooling equipment can be obtained by way of measuring said temperature at or near the equipment supplying the cooling air or at any position before the cabinet that is deemed to provide an accurate representation of the temperature of the air that is being supplied.
Theta can be described as the temperature gradient between the inlet temperature T_max,iof each cabinet and the supply air temperature T_SAT, with respect to a maximum allowable temperature T_Allowable. A Theta value of zero indicates that the cabinet inlet temperature is at the supply air temperature (no gradient). A Theta value of one indicates that the cabinet inlet temperature is at the allowable temperature, and a value above one indicates a cabinet inlet temperature above the allowable temperature.
As shown in step 125, the calculated Theta value is used to determine the next course of action. If any one cabinet inlet temperature is at or above a set allowable temperature (evidenced by a Theta value being equal or greater than 1), the system determines that there is no additional cooling capacity available on any of the cabinets until the issue of the inlet temperature being higher than the allowable temperature is resolved to where the inlet temperature is lower than the allowable temperature. To notify the user of the potential risk of overheating, an alarm may be signaled to the user, as shown in in step 130. This may be done in any number of suitable ways and can include electronic, visual, aural, or any other appropriate methods of delivery. In one embodiment, the user receives a message within data center management software used to manage the data center where the message provides a map-like representation of the data center with any of the problematic cabinets being highlighted a certain color. In a variation of this embodiment all the cabinets may be highlighted such that any cabinet having Theta≧1 appears red, any cabinet having 1>Theta>0 appears yellow, and any cabinet having Theta=0 appears green. Once the user has received an alarm, he may undertake the necessary action to remedy the problem. As illustrated in step 135, the present invention may provide the user with potential ways to fix the issues causing the alarm. This may include, without limitations, suggestions to check the blanking panels, add perforated tiles, and/or change the cooling unit set-point.
If all the cabinet inlet temperatures are below the allowable temperature (evidenced by having all the calculated Theta values remain below 1), the present invention compares the calculated Theta values against a predefined θ_uservalue. The θ_uservalue corresponds to a specific user-confidence percentage, and the predefined correlation between the two is derived through a number of Computational Fluid Dynamics (CFD) models that are representative of actual data centers (as explained later in the specification). The plot in FIG. 2 shows the confidence value in the cooling capacity management method used for different theta values. If, for example, the user specified Theta (θ_user) is 0.3 or below, the cooling capacity management method represented by the flow chart of FIG. 1 is likely to work 100% of the time, keeping a safe thermal environment for the IT equipment. However if the θ_useris 0.6, the cooling capacity management method represented by the flow chart of FIG. 1 is likely to work 70% of the time. Note that if and when a certain confidence level is selected, such a level correlates to the highest possible value of θ_userthat will still correspond to the selected confidence level. Therefore, for example, if a confidence level of 100% is selected, the θ_uservalue used in the execution of the present invention will be 0.3 instead of 0.1.
Thus, if in step 140 it is determined that the calculated Theta values for a set of cabinets or all the cabinets within a data center fall below a predefined value θ_user, the present invention distributes the remaining cooling capacity P_coolover said cabinets in step 145 and provides the user with a confidence percentage that the executed distribution will successfully work. If, however, any of the calculated Theta values are equal to or greater than θ_user, the present invention outputs an alarm (similar to the alarm of step 130) in step 150. This alarm can signal to the user that the cooling capacity management in accordance with the present invention would not achieve the sufficient confidence percentage.
Note that the predefined θ_uservalue can be set by the user by way of selecting a desired confidence level, wherein based on the selected confidence level, the present invention determines the appropriate θ_uservalue. Thus, if the user had determined that the appropriate confidence percentage was at no less than ˜85%, the present invention would translate that percentage into a θ_uservalue of 0.4 and use that value in step 140.
As noted previously, the correlation between the θ_uservalue and the confidence level is developed via a number of Computational Fluid Dynamics (CFD) models that are representative of real data centers. The CFD models are ran for different conditions, changing a number of key variables such as: supply air temperature, cabinet power, and different types of IT equipment. For each case, the CFD models are ran with different air ratios (AR). In an embodiment, there ranges are from 0.8 AR to 2 AR. Air ratio is defined as the ratio between the airflow supplied by the cooling units and the total airflow required for the IT equipment.
For each CFD run, the maximum cabinet inlet temperatures are monitored. If a cabinet maximum inlet temperature exceeds a specified allowable temperature, thermal capacity is not managed. If all cabinet inlet temperatures are below the allowable temperatures, capacity is managed by distributing the available cooling capacity among all the cabinets equally. The model is then rerun using the new managed capacity for different ARs. Theta is calculated per cabinet for the baseline run with the minimum AR that provided safe cabinet inlet temperatures. The maximum Theta value is used for the percent confidence value in the present invention.
This work is repeatedly done for the remaining CFD models at different cases. The maximum Theta values are collected to provide the overall percent confidence in the present invention. The percent confidence is a way of providing the user with a barometer for confidence for the approach used for capacity management among the cabinets, for a given set of theta values in their data center.
An example of the how a system in accordance with the present invention may be used is shown in FIG. 3. This figure illustrates two data center layouts (one being the current layout and one being the projected layout) and provides a user input interface where the user may select a particular confidence level. In the currently described embodiment the selection of the confidence level is done by way of a slider which ranges from “optimistic” to “conservative” with “conservative” being most confident and “optimistic” being least confident. However, a particular confidence level may be inputted in any number of ways, including without limitation manual entry of a number or automatic entry based on at least one other factor. Having the necessary temperature values, the system calculates the maximum Theta value to be 0.05. Given that this value is below 1, the present invention proceeds to the next step without triggering an alarm. The 0.05 Theta value is then compared to the θ_uservalue which is derived from the selected confidence level percentage. In the described embodiment, the selected confidence level percentage is ˜100%, which translates to a θ_uservalue of 0.3. Since the maximum Theta is not greater than or equal to θ_uservalue, the system proceeds, yet again without triggering an alarm, to distribute the remaining cooling capacity evenly over all the cabinets under consideration. In this case, the remaining cooling capacity is distributed evenly, and thus each cabinet receives an additional 5.73 kw of cooling capacity. In alternate embodiments, alternate distribution schemes may be implemented.
Note that the mention of the “data center” should not be interpreted as referring only to an entire data center, as it may refer only to a subset of a data center. Accordingly, references to a “data center” throughout this application and the claims may be understood to refer to the entire data center and/or to a subset of a data center.
Embodiment of the present invention may be implemented using at least one computer. At least some of the operations described above may be codified in computer readable instructions such that these operations may be executed by the computer. The computer may be a stationary device (e.g., a server) or a portable device (e.g., a laptop). The computer includes a processor, memory, and one or more drives or storage devices. The storage devices and their associated computer storage media provide storage of computer readable instructions, data structures, program modules and other non-transitory information for the computer. Storage devices include any device capable of storing non-transitory data, information, or instructions, such as: a memory chip storage including RAM, ROM, EEPROM, EPROM or any other type of flash memory device; a magnetic storage device including a hard or floppy disk, and magnetic tape; optical storage devices such as a CD-ROM disc, a BD-ROM disc, and a BluRay™ disc; and holographic storage devices.
The computer may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer. The remote computer may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and may include many if not all of the elements described above relative to computer. Networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet. For example, in the subject matter of the present application, a computer may comprise the source machine from which data is being migrated, and the remote computer may comprise the destination machine. Note, however, that source and destination machines need not be connected by a network or any other means, but instead, data may be migrated via any media capable of being written by the source platform and read by the destination platform or platforms. When used in a LAN or WLAN networking environment, a computer is connected to the LAN through a network interface or an adapter. When used in a WAN networking environment, a computer typically includes a network interface card or other means for establishing communications over the WAN to environments such as the Internet. It will be appreciated that other means of establishing a communications link between the computers may be used.
Those having skill in the art will recognize that the state of the art has progressed to the point where there is little distinction left between hardware and software implementations of aspects of systems; the use of hardware or software is generally (but not always, in that in certain contexts the choice between hardware and software can become significant) a design choice representing cost vs. efficiency tradeoffs. Those having skill in the art will appreciate that there are various vehicles by which processes and/or systems and/or other technologies described herein can be effected (e.g., hardware, software, and/or firmware), and that the preferred vehicle will vary with the context in which the processes and/or systems and/or other technologies are deployed. For example, if an implementer determines that speed and accuracy are paramount, the implementer may opt for a mainly hardware and/or firmware vehicle; alternatively, if flexibility is paramount, the implementer may opt for a mainly software implementation; or, yet again alternatively, the implementer may opt for some combination of hardware, software, and/or firmware. Hence, there are several possible vehicles by which the processes and/or devices and/or other technologies described herein may be effected, none of which is inherently superior to the other in that any vehicle to be utilized is a choice dependent upon the context in which the vehicle will be deployed and the specific concerns (e.g., speed, flexibility, or predictability) of the implementer, any of which may vary. Those skilled in the art will recognize that optical aspects of implementations will typically employ optically-oriented hardware, software, and or firmware.
Note that while this invention has been described in terms of several embodiments, these embodiments are non-limiting (regardless of whether they have been labeled as exemplary or not), and there are alterations, permutations, and equivalents, which fall within the scope of this invention. Additionally, the described embodiments should not be interpreted as mutually exclusive, and should instead be understood as potentially combinable if such combinations are permissive. It should also be noted that there are many alternative ways of implementing the methods and apparatuses of the present invention. It is therefore intended that claims that may follow be interpreted as including all such alterations, permutations, and equivalents as fall within the true spirit and scope of the present invention.

Claims

We claim:

1. A method for data center thermal capacity management, comprising:

collecting cabinet information from a plurality of cabinets in a data center, the cabinet information including at least an inlet temperature and a maximum allowable cabinet temperature for each of the plurality of cabinets;

deriving a remaining cooling capacity for the data center;

for each cabinet among the plurality of cabinets, calculating a θ value using at least the collected cabinet information for the cabinet;

determining that all of the inlet temperatures for the plurality of cabinets are below their respective maximum allowable cabinet temperatures, and in response, determining whether each of the calculated θ values is below, at, or above a user-defined θ value;

if any one of the calculated θ values is at or above the user-defined θ value, providing an alarm; and

if all of the calculated θ values are below the user-defined θ value, distributing the derived remaining cooling capacity among the plurality of cabinets.

2. The method of claim 1, wherein distributing the derived remaining cooling capacity among the plurality of cabinets comprises:

distributing the derived remaining cooling capacity evenly among the plurality of cabinets.

3. The method of claim 1, comprising:

collecting a total power usage for the plurality of cabinets.

4. The method of claim 3, wherein collecting the total power usage for the plurality of cabinets comprises:

collecting total power usage readings from each cabinet among the plurality of cabinets; and

summing each of the collected total power usage readings for each cabinet among the plurality of cabinets to obtain the total power usage for the plurality of cabinets.

5. The method of claim 4, wherein collecting the total power usage reading from a cabinet comprises:

collecting the total power usage reading from a power outlet unit installed in the cabinet.

6. The method of claim 3, comprising:

calculating a total cooling capacity for the data center.

7. The method of claim 6, wherein calculating the total cooling capacity for the data center comprises:

obtaining a rated capacity of cooling equipment within the data center; and

summing the obtained rated capacities of the cooling equipment within the data center to obtain the total cooling capacity for the data center.

8. The method of claim 7, wherein deriving the remaining cooling capacity for the data center comprises:

subtracting the total power usage for the plurality of cabinets from the calculated total cooling capacity for the data center.

9. A method for data center thermal capacity management, comprising:

collecting an inlet temperature and a maximum allowable cabinet temperature for each cabinet among a plurality of cabinets in a data center;

for each cabinet among the plurality of cabinets, calculating a θ value using at least the collected inlet temperature and maximum allowable cabinet temperature for the cabinet;

determining whether any of the calculated θ values is greater than or equal to 1;

if any of the calculated θ values is greater than or equal to 1:

providing a first alarm to a user of a potential overheating risk; and

providing the user with suggestions for correcting the overheating risk;

if none of the calculated θ values is greater than or equal to 1, determining whether any of the calculated θ values is greater than or equal to a user-defined θ value;

if any one of the calculated θ values is greater than or equal to the user-defined θ value, providing a second alarm to the user to adjust the user-defined θ value; and

if none of the calculated θ values is greater than or equal to the user-defined θ value, distributing any remaining cooling capacity among the plurality of cabinets.

10. The method of claim 9, wherein collecting an inlet temperature for a cabinet among a plurality of cabinets in a data center comprises:

recording temperatures from a plurality of temperature sensors installed in the cabinet; and

selecting a maximum recorded temperature among the recorded temperatures as the inlet temperature for the cabinet.

11. The method of claim 9, wherein collecting an inlet temperature for a cabinet among a plurality of cabinets in a data center comprises:

averaging the recorded temperatures to obtain the inlet temperature for the cabinet.