US20210397240A1 - Systems and methods for enabling power budgeting in an information handling system comprising a plurality of modular information handling systems - Google Patents

Systems and methods for enabling power budgeting in an information handling system comprising a plurality of modular information handling systems Download PDF

Info

Publication number
US20210397240A1
US20210397240A1 US16/907,965 US202016907965A US2021397240A1 US 20210397240 A1 US20210397240 A1 US 20210397240A1 US 202016907965 A US202016907965 A US 202016907965A US 2021397240 A1 US2021397240 A1 US 2021397240A1
Authority
US
United States
Prior art keywords
information handling
handling systems
chassis
modular information
level maximum
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US16/907,965
Other versions
US11249533B2 (en
Inventor
Anto DolphinJose Jesurajan Marystella
Craig A. Klein
Arun Muthaiyan
Nagesh Babu Venkata DODDAPANENI
Somenath Das
Mark Tsai
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dell Products LP
Original Assignee
Dell Products LP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dell Products LP filed Critical Dell Products LP
Priority to US16/907,965 priority Critical patent/US11249533B2/en
Assigned to CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH reassignment CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH SECURITY AGREEMENT Assignors: DELL PRODUCTS L.P., EMC IP Holding Company LLC
Assigned to THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT reassignment THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DELL PRODUCTS L.P., EMC IP Holding Company LLC
Assigned to THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT reassignment THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DELL PRODUCTS L.P., EMC IP Holding Company LLC
Assigned to THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT reassignment THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DELL PRODUCTS L.P., EMC IP Holding Company LLC
Assigned to DELL PRODUCTS L.P. reassignment DELL PRODUCTS L.P. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DODDAPANENI, NAGESH BABU VENKATA, TSAI, MARK, DAS, SOMENATH, JESURAJAN MARYSTELLA, ANTO DOLPHINJOSE, Klein, Craig A., MUTHAIYAN, ARUN
Assigned to EMC IP Holding Company LLC, DELL PRODUCTS L.P. reassignment EMC IP Holding Company LLC RELEASE OF SECURITY INTEREST AT REEL 053531 FRAME 0108 Assignors: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Publication of US20210397240A1 publication Critical patent/US20210397240A1/en
Publication of US11249533B2 publication Critical patent/US11249533B2/en
Application granted granted Critical
Assigned to EMC IP Holding Company LLC, DELL PRODUCTS L.P. reassignment EMC IP Holding Company LLC RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053578/0183) Assignors: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Assigned to DELL PRODUCTS L.P., EMC IP Holding Company LLC reassignment DELL PRODUCTS L.P. RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053574/0221) Assignors: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Assigned to DELL PRODUCTS L.P., EMC IP Holding Company LLC reassignment DELL PRODUCTS L.P. RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053573/0535) Assignors: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3209Monitoring remote activity, e.g. over telephone lines or network connections
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/28Supervision thereof, e.g. detecting power-supply failure by out of limits supervision
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/3287Power saving characterised by the action undertaken by switching off individual functional units in the computer system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/542Event management; Broadcasting; Multicasting; Notifications

Definitions

  • the present disclosure relates in general to information handling systems, and more particularly to methods and systems for power budgeting in an information handling system comprising a plurality of modular information handling systems.
  • An information handling system generally processes, compiles, stores, and/or communicates information or data for business, personal, or other purposes thereby allowing users to take advantage of the value of the information.
  • information handling systems may also vary regarding what information is handled, how the information is handled, how much information is processed, stored, or communicated, and how quickly and efficiently the information may be processed, stored, or communicated.
  • the variations in information handling systems allow for information handling systems to be general or configured for a specific user or specific use such as financial transaction processing, airline reservations, enterprise data storage, or global communications.
  • information handling systems may include a variety of hardware and software components that may be configured to process, store, and communicate information and may include one or more computer systems, data storage systems, and networking systems.
  • Some data center servers are equipped with chassis manager firmware, which manages power supply units and the redundancy configuration of the power supply units.
  • Individual information handling system server nodes made be managed by a baseboard management controller having a handshake with the chassis manager via an Internet Protocol Management Bus (IPMB).
  • IPMB Internet Protocol Management Bus
  • Existing chassis manager firmware does support power budgeting and management, often resulting in a less than ideal customer experience.
  • Server nodes in existing server architectures may draw power immediately on a power button press, without a power budget check, sometimes resulting in throttling and poor performance, and in some cases cause complete chassis shutdown when the chassis power consumption exceeds the power supply capacity.
  • lack of power budgeting in existing approaches prevents calculation of lower and upper boundaries for power capping. For example, existing approaches were unable to calculate a fast throttle boundary (FTB), a node lower boundary (NLB), or to protect power supply units and prevent exothermic events while maximizing the system performance via a hardware protection policy (HWPP) defining an average power limit for a server node.
  • FTB fast throttle boundary
  • NLB node lower boundary
  • HWPP hardware protection policy
  • a method may include, in a system comprising a plurality of power supply units, determining a redundancy configuration of the plurality of power supply units, determining a power capacity of the plurality of power supply units, determining a number of modular information handling systems installed in the system, determining a chassis-level maximum transient power limit for each of the modular information handling systems based on the redundancy configuration, the power capacity, and the number of modular information handling systems, determining a chassis-level maximum average power limit for each of the modular information handling systems, and communicating the chassis-level maximum transient power limit and chassis-level maximum average power limit to a respective baseboard management controller of each of the modular information handling systems, wherein each respective baseboard management controller is configured to determine if sled-level power requirements of its respective information handling system are within the chassis-level maximum transient power limit and chassis-level maximum average power limit.
  • an article of manufacture may include a non-transitory computer-readable medium and computer-executable instructions carried on the computer-readable medium, the instructions readable by a processor, the instructions, when read and executed, for causing the processor to, in a system comprising a plurality of power supply units: determine a redundancy configuration of the plurality of power supply units, determine a power capacity of the plurality of power supply units, determine a number of modular information handling systems installed in the system, determine a chassis-level maximum transient power limit for each of the modular information handling systems based on the redundancy configuration, the power capacity, and the number of modular information handling systems, determine a chassis-level maximum average power limit for each of the modular information handling systems, and communicate the chassis-level maximum transient power limit and chassis-level maximum average power limit to a respective baseboard management controller of each of the modular information handling systems, wherein each respective baseboard management controller is configured to determine if sled-level power requirements of its respective information handling system are within the
  • a management module configured to be communicatively coupled to a plurality of power supply units and may be further configured to determine a redundancy configuration of the plurality of power supply units, determine a power capacity of the plurality of power supply units, determine a number of modular information handling systems installed in a system, determine a chassis-level maximum transient power limit for each of the modular information handling systems based on the redundancy configuration, the power capacity, and the number of modular information handling systems, determine a chassis-level maximum average power limit for each of the modular information handling systems, and communicate the chassis-level maximum transient power limit and chassis-level maximum average power limit to a respective baseboard management controller of each of the modular information handling systems, wherein each respective baseboard management controller is configured to determine if sled-level power requirements of its respective information handling system are within the chassis-level maximum transient power limit and chassis-level maximum average power limit.
  • FIG. 1 illustrates a block diagram of an example system, in accordance with embodiments of the present disclosure
  • FIG. 2 illustrates a flow chart of an example method for enabling, at the level of a chassis manager, power budgeting in a chassis comprising a plurality of modular information handling systems, in accordance with embodiments of the present disclosure
  • FIG. 3 illustrates a flow chart of an example method for enabling, at the level of a baseboard management controller, power budgeting in a chassis comprising a plurality of modular information handling systems, in accordance with embodiments of the present disclosure.
  • FIGS. 1 through 3 wherein like numbers are used to indicate like and corresponding parts.
  • an information handling system may include any instrumentality or aggregate of instrumentalities operable to compute, classify, process, transmit, receive, retrieve, originate, switch, store, display, manifest, detect, record, reproduce, handle, or utilize any form of information, intelligence, or data for business, scientific, control, entertainment, or other purposes.
  • an information handling system may be a personal computer, a personal digital assistant (PDA), a consumer electronic device, a network storage device, or any other suitable device and may vary in size, shape, performance, functionality, and price.
  • the information handling system may include memory, one or more processing resources such as a central processing unit (“CPU”) or hardware or software control logic.
  • Additional components of the information handling system may include one or more storage devices, one or more communications ports for communicating with external devices as well as various input/output (“I/O”) devices, such as a keyboard, a mouse, and a video display.
  • the information handling system may also include one or more buses operable to transmit communication between the various hardware components.
  • Computer-readable media may include any instrumentality or aggregation of instrumentalities that may retain data and/or instructions for a period of time.
  • Computer-readable media may include, without limitation, storage media such as a direct access storage device (e.g., a hard disk drive or floppy disk), a sequential access storage device (e.g., a tape disk drive), compact disk, CD-ROM, DVD, random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), and/or flash memory; as well as communications media such as wires, optical fibers, microwaves, radio waves, and other electromagnetic and/or optical carriers; and/or any combination of the foregoing.
  • storage media such as a direct access storage device (e.g., a hard disk drive or floppy disk), a sequential access storage device (e.g., a tape disk drive), compact disk, CD-ROM, DVD, random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-
  • information handling resources may broadly refer to any component system, device or apparatus of an information handling system, including without limitation processors, service processors, basic input/output systems, buses, memories, I/O devices and/or interfaces, storage resources, network interfaces, motherboards, and/or any other components and/or elements of an information handling system.
  • FIG. 1 illustrates a block diagram of an example system 100 , in accordance with embodiments of the present disclosure.
  • system 100 may comprise a chassis 101 for enclosing a plurality of information handling resources, including a plurality of modular information handling systems 102 (e.g., sleds), a management module 112 , an internal network 118 , and a power system comprising one or more power supply units (PSUs) 110 .
  • PSUs power supply units
  • Chassis 101 may include any suitable enclosure for housing the various components of system 100 , and may also be referred to as a rack, tower, enclosure, and/or housing.
  • an information handling system 102 may include a processor 103 , a memory 104 communicatively coupled to processor 103 , a basic input/output system (BIOS) 105 communicatively coupled to processor 103 , and a baseboard management controller 108 communicatively coupled to processor 103 .
  • BIOS basic input/output system
  • a processor 103 may include any system, device, or apparatus configured to interpret and/or execute program instructions and/or process data, and may include, without limitation, a microprocessor, microcontroller, digital signal processor (DSP), application specific integrated circuit (ASIC), or any other digital or analog circuitry configured to interpret and/or execute program instructions and/or process data.
  • processor 103 may interpret and/or execute program instructions and/or process data stored in an associated memory 104 and/or another component of its associated information handling system 102 .
  • a memory 104 may be communicatively coupled to an associated processor 103 and may include any system, device, or apparatus configured to retain program instructions and/or data for a period of time (e.g., computer-readable media).
  • a memory 104 may include RAM, EEPROM, a PCMCIA card, flash memory, magnetic storage, opto-magnetic storage, or any suitable selection and/or array of volatile or non-volatile memory that retains data after power to information handling system 102 is turned off.
  • BIOS 105 may be communicatively coupled to an associated processor 103 and may include any system, device, or apparatus configured to identify, test, and/or initialize information handling resources of an associated information handling system 102 .
  • BIOS may broadly refer to any system, device, or apparatus configured to perform such functionality, including without limitation, a Unified Extensible Firmware Interface (UEFI).
  • BIOS 105 may be implemented as a program of instructions that may be read by and executed on processor 103 to carry out the functionality of BIOS 105 .
  • a BIOS 105 may comprise boot firmware configured to be the first code executed by processor 103 when information handling system 102 is booted and/or powered on.
  • BIOS 105 code may be configured to set components of information handling system 102 into a known state, so that one or more applications (e.g., an operating system or other application programs) stored on compatible media (e.g., memory 104 ) may be executed by processor 103 and given control of information handling system 102 .
  • applications e.g., an operating system or other application programs
  • compatible media e.g., memory 104
  • a baseboard management controller 108 may be configured to provide out-of-band management facilities for management of information handling system 102 . Such management may be made by baseboard management controller 108 even if information handling system 102 is powered off or powered to a standby state.
  • baseboard management controller 108 may include or may be an integral part of a remote access controller (e.g., a Dell Remote Access Controller or Integrated Dell Remote Access Controller).
  • FIG. 1 depicts only two information handling systems 102 within system 100 , it is understood that system 100 may comprise any suitable number of information handling systems 102 .
  • an information handling system 102 may include one or more other information handling resources.
  • an information handling system 102 may include more than one memory 104 .
  • an information handling system 102 may include a programmable logic device (e.g., integral to or separate from baseboard management controller 108 ).
  • Management module 112 may be configured to provide out-of-band management facilities for management of shared chassis infrastructure of system 100 , such as air movers, PSUs 110 , and/or other components shared by a plurality of information handling systems 102 . Such management may be made by management module 112 even if system 100 is powered off or powered to a standby state.
  • Management module 112 may include a processor 113 and one or more memories 111 .
  • management module 112 may include or may be an integral part of an enclosure controller (EC).
  • EC enclosure controller
  • management module 112 may include or may be an integral part of a chassis management controller (CMC).
  • CMC chassis management controller
  • management module 112 may also be referred to as a “chassis manager.”
  • FIG. 1 depicts only one management module 112 , it is understood that system 100 may comprise any suitable number of management modules 112 .
  • two management modules 112 may be arranged in a redundant configuration, in which, at a given moment, one management module 112 may be “active” in that it is actively functional and performing its functionality, while another management module 112 is in a “standby” mode and may become active in the event that the active management module 112 experiences a fault or failure that causes it to failover to the standby management module 112 .
  • Processor 113 may include any system, device, or apparatus configured to interpret and/or execute program instructions and/or process data, and may include, without limitation, a microprocessor, microcontroller, digital signal processor (DSP), application specific integrated circuit (ASIC), or any other digital or analog circuitry configured to interpret and/or execute program instructions and/or process data.
  • processor 113 may interpret and/or execute program instructions (e.g., firmware) and/or process data stored in memory 111 and/or another component of system 100 or management module 112 .
  • processor 113 may comprise an enclosure controller configured to execute firmware relating to functionality as an enclosure controller.
  • processor 113 may include a network interface 114 for communicating with an internal network 118 of system 100 .
  • Memory 111 may be communicatively coupled to processor 113 and may include any system, device, or apparatus configured to retain program instructions and/or data for a period of time (e.g., computer-readable media).
  • Memory 111 may include RAM, EEPROM, a PCMCIA card, flash memory, magnetic storage, opto-magnetic storage, or any suitable selection and/or array of volatile or non-volatile memory that retains data after power to management module 112 is turned off.
  • Internal network 118 may comprise any suitable system, apparatus, or device operable to serve as communication infrastructure for network interface 114 to communicate to one or more other components, such as baseboard management controllers 108 of information handling systems 102 .
  • internal network 118 may implement an Internet Protocol Management Bus (IPMB).
  • IPMB Internet Protocol Management Bus
  • a PSU 110 may include any system, device, or apparatus configured to supply electrical current to one or more information handling resources of system 100 .
  • a PSU 110 may provide electrical energy via (a) a main power rail, indicated in FIG. 1 as “MAIN POWER,” and (b) an auxiliary power rail, indicated in FIG. 1 as “AUX POWER.”
  • the main power rail may generally be used to provide power to information handling resources of an information handling system 102 when such information handling system 102 is turned on and/or to provide power to certain components of system 100 .
  • the auxiliary power rail may generally be used to provide power to certain auxiliary information handling resources when energy is not supplied via the main power rail.
  • the auxiliary power rail may be used to provide power to baseboard management controller 108 when electrical energy is not provided to processor 103 , memory 104 , and/or other information handling resources via the main power rail.
  • the auxiliary power rail may be used to provide power to management module 112 when electrical energy is not provided to information handling resources 102 via the main power rail.
  • a management module 112 may be configured to communicate with one or more PSUs 110 to communicate control and/or telemetry data between management module 112 and PSUs 110 .
  • a PSU 110 may communicate information regarding specifications (e.g., power rating, maximum current, etc.) and/or measurements of electrical parameters (e.g., electrical currents or voltages) present within such PSU 110 .
  • system 100 may include one or more other information handling resources.
  • an information handling system 102 may include a programmable logic device (e.g., integral to or separate from management module 112 ).
  • management module 112 may be configured to determine power budget values and power limit values for information handling systems 102 and pass such values to baseboard management controllers 108 via internal network 118 . With such values, an information handling system 102 may be enabled to, during BIOS power-on/self-test, determine and report any insufficiency of power.
  • management module 112 may be configured to allocate power to individual modular information handling systems 102 based on a number of modular information handling systems 102 present in chassis 101 and a redundancy configuration of PSUs 110 .
  • Such power budget values, power limit values, and allocation of power may be orchestrated around image verification checks by BIOS 105 in order to allow a BIOS 105 of each information handling system 102 to allow or block information handling system 102 from powering on.
  • image verification check may be performed initially when alternating current (AC) power is applied to PSUs 110 , as well as on every subsequent request by an information handling system 102 to power on.
  • AC alternating current
  • BIOS image verifications may be avoided and a continuous loop of failed verifications may be avoided.
  • a power inventory and modular information handling system 102 powering on procedure may be sequences based on verification results.
  • the systems and methods disclosed herein may take advantage of a built-in power budget and power control infrastructure of management module 112 , baseboard management controller 108 , and BIOS 105 .
  • the systems and methods disclosed herein may:
  • a power limit calculated by management module 112 may include a per-information handling system 102 full-throttle boundary (FTB).
  • FTB limits may be influenced by effective capacity of PSUs 110 and a redundancy configuration of PSUs 110 .
  • the FTB calculation may determine maximum transient peak power events expected at outputs of PSUs 110 .
  • management module 112 may calculate FTB as:
  • P OUT effective output capacity of PSUs 110 (e.g., manufacturer-rated maximum power output multiplied by a redundancy factor PSU COUNT );
  • PSU COUNT 1 for grid redundant configuration; 2 for non-redundant configuration;
  • EPR an extended power output range of PSUs 110 (e.g., 1.4);
  • P SHARED power consumed by components of chassis 101 shared by all information handling systems 102 (e.g., chassis backplane, management module 112 , air movers, etc.);
  • N a number of information handling systems 102 installed in chassis 101 .
  • management module 112 may calculate FTB as follows:
  • Management module 112 may communicate FTB to each information handling system 102 via internal network 118 , along with an HWPP defining an average power consumption limit for each information handling system 102 .
  • the HWPP may serve as a node lower bound (NLB) for each information handling system 102 .
  • BIOS 105 of an information handling system 102 may compare its own calculated sled-level FTB to the chassis-level FTB received from management module 112 . If the sled-level FTB is greater than the chassis-level FTB, BIOS 105 may fail its power budget check.
  • BIOS 105 of an information handling system 102 may compare its own calculated sled-level NLB to the sled-level HWPP (which may be the lesser of the HWPP received from management module 112 and a sled-connector maximum). If the sled-level NLB is greater than the sled-level HWPP, BIOS 105 may fail its power budget check.
  • BIOS 105 may pass power budget checks only if both FTB and NLB checks pass for its associated information handling system 102 . If either of these checks fail, BIOS 105 may prevent information handling system 102 from fully powering on (e.g., boot of information handling system 102 may halt at the end of power-on/self-test with a halt F1/F2 message).
  • baseboard management controller 108 may log an error for power budget failure.
  • Each information handling system 102 may be addressed independently for failure scenarios.
  • the FTB and HWPP values calculated by management module 112 may dynamically change in the event an information handling system 102 is added or removed from chassis 101 , if the redundancy configuration of PSUs 110 is modified (e.g., by a user), or if a PSU 110 is added (or powered on) or removed (or powered down, loses AC “power OK”).
  • management module 112 may calculate new FTP and HWPP values and communicate such updated values to each modular information handling system 102 .
  • a modular information handling system 102 may again compare such values against its sled-level FTB and NLB values, respectively. If either sled-level value exceeds its respective chassis-level value, baseboard management controller 108 may log a “system power budget exceeds PSU capacity.” However, at this point any information handling systems 102 that are currently on may not be shut down or restarted due to this power budget check. Any hardware limits may be addressed by baseboard management controller 108 using HWPP, which may always remain enabled.
  • management module 112 may recalculate the FTB and HWPP values, communicate such values to information handling systems 102 , and baseboard management controllers 108 may perform power budget checks as described above.
  • FIG. 2 illustrates a flow chart of an example method 200 for enabling, at the level of management module 112 , power budgeting in chassis 101 comprising a plurality of modular information handling systems 102 , in accordance with embodiments of the present disclosure.
  • method 200 may begin at step 202 .
  • teachings of the present disclosure may be implemented in a variety of configurations of information handling system 102 . As such, the preferred initialization point for method 200 and the order of the steps comprising method 200 may depend on the implementation chosen.
  • Method 200 may start at step 202 in response to a powering on or restart of management module 112 .
  • management module 112 may determine a redundancy configuration of PSUs 110 .
  • management module 112 may discover PSUs 110 and determine the manufacturer rated power capacity for each.
  • management module 112 may determine a power consumed by components of chassis 101 shared by information handling systems 102 .
  • management module 112 may validate and enumerate information handling systems 102 installed within chassis 101 .
  • management module 112 may calculate FTB and HWPP values based on information collected at steps 202 - 208 .
  • management module 112 may communicate these chassis-level FTB and HWPP values to each information handling system 102 .
  • management module 112 may determine if a redundancy configuration of PSUs 110 has changed or a PSU 110 has been added or removed. If a redundancy configuration of PSUs 110 has changed or a PSU 110 has been added or removed, method 200 may proceed again to step 202 . Otherwise, method 200 may proceed to step 216 .
  • management module 112 may determine if the number of information handling systems 102 installed in chassis 101 has changed. If the number of information handling systems 102 installed in chassis 101 has changed, method 200 may proceed again to step 202 . Otherwise, method 200 may proceed again to step 214 .
  • FIG. 2 discloses a particular number of steps to be taken with respect to method 200
  • method 200 may be executed with greater or fewer steps than those depicted in FIG. 2 .
  • FIG. 2 discloses a certain order of steps to be taken with respect to method 200
  • the steps comprising method 200 may be completed in any suitable order.
  • Method 200 may be implemented using a baseboard management controller 108 , and/or any other system operable to implement method 200 .
  • method 200 may be implemented partially or fully in software and/or firmware embodied in computer-readable media.
  • FIG. 3 illustrates a flow chart of an example method 300 for enabling, at the level of a baseboard management controller 108 , power budgeting in chassis 101 comprising a plurality of modular information handling systems 102 , in accordance with embodiments of the present disclosure.
  • method 300 may begin at step 302 .
  • teachings of the present disclosure may be implemented in a variety of configurations of information handling system 102 . As such, the preferred initialization point for method 300 and the order of the steps comprising method 300 may depend on the implementation chosen.
  • Method 300 may start at step 302 in response to a powering on or restart of an information handling system 102 , which may initialize operation of a baseboard management controller 108 .
  • baseboard management controller 108 may determine if a request has been made to power on information handling system 102 . If a request has been made to power on information handling system 102 , method 300 may proceed to step 304 . Otherwise, step 302 may repeat until a request has been made to power on information handling system 102 .
  • baseboard management controller 108 may calculate sled-level FTB and NLB values for its associated information handling system 102 .
  • baseboard management controller 108 may determine if its sled-level FTB exceeds a chassis-level FTB communicated from management module 112 . If the sled-level FTB value exceeds a chassis-level FTB value communicated from management module 112 , method 300 may proceed to step 312 . Otherwise, method 300 may proceed to step 308 .
  • baseboard management controller 108 may determine if its sled-level NLB value exceeds a chassis-level HWPP value communicated from management module 112 . If the sled-level NLB value exceeds a chassis-level HWPP value communicated from management module 112 , method 300 may proceed to step 312 . Otherwise, method 300 may proceed to step 310 .
  • baseboard management controller 108 may determine if an updated chassis-level FTB value and/or updated chassis-level HWPP value has been received from management module 112 . If an updated chassis-level FTB value and/or updated chassis-level HWPP value has been received from management module 112 , method 300 may proceed again to step 306 . Otherwise, method 300 may remain at step 310 until an updated chassis-level FTB value and/or updated chassis-level HWPP value has been received from management module 112 .
  • baseboard management controller 108 may determine if its associated information handling system 102 is powered on (e.g., in power state S 0 ). If the associated information handling system 102 is powered on, method 300 may proceed to step 314 . Otherwise, method 300 may proceed to step 316 .
  • baseboard management controller 108 may log an alert indicating a power budget check failure. After completion of step 314 , method 300 may proceed again to step 302 .
  • baseboard management controller 108 may prevent its associated information handling system 102 from powering on, and may report a power failure to BIOS 105 (e.g., with a halt F1/F2 message). After completion of step 316 , method 300 may proceed again to step 302 .
  • FIG. 3 discloses a particular number of steps to be taken with respect to method 300
  • method 300 may be executed with greater or fewer steps than those depicted in FIG. 3 .
  • FIG. 3 discloses a certain order of steps to be taken with respect to method 300
  • the steps comprising method 300 may be completed in any suitable order.
  • Method 300 may be implemented using a baseboard management controller 108 , and/or any other system operable to implement method 300 .
  • method 200 may be implemented partially or fully in software and/or firmware embodied in computer-readable media.
  • references in the appended claims to an apparatus or system or a component of an apparatus or system being adapted to, arranged to, capable of, configured to, enabled to, operable to, or operative to perform a particular function encompasses that apparatus, system, or component, whether or not it or that particular function is activated, turned on, or unlocked, as long as that apparatus, system, or component is so adapted, arranged, capable, configured, enabled, operable, or operative. Accordingly, modifications, additions, or omissions may be made to the systems, apparatuses, and methods described herein without departing from the scope of the disclosure. For example, the components of the systems and apparatuses may be integrated or separated.
  • each refers to each member of a set or each member of a subset of a set.

Abstract

A method may include, in a system comprising a plurality of power supply units, determining a redundancy configuration of the plurality of power supply units, determining a power capacity of the plurality of power supply units, determining a number of modular information handling systems installed in the system, determining a chassis-level maximum transient power limit for each of the modular information handling systems based on the redundancy configuration, the power capacity, and the number of modular information handling systems, determining a chassis-level maximum average power limit for each of the modular information handling systems, and communicating the chassis-level maximum transient power limit and chassis-level maximum average power limit to a respective baseboard management controller of each of the modular information handling systems, wherein each respective baseboard management controller is configured to determine if sled-level power requirements of its respective information handling system are within the chassis-level maximum transient power limit and chassis-level maximum average power limit.

Description

    TECHNICAL FIELD
  • The present disclosure relates in general to information handling systems, and more particularly to methods and systems for power budgeting in an information handling system comprising a plurality of modular information handling systems.
  • BACKGROUND
  • As the value and use of information continues to increase, individuals and businesses seek additional ways to process and store information. One option available to users is information handling systems. An information handling system generally processes, compiles, stores, and/or communicates information or data for business, personal, or other purposes thereby allowing users to take advantage of the value of the information. Because technology and information handling needs and requirements vary between different users or applications, information handling systems may also vary regarding what information is handled, how the information is handled, how much information is processed, stored, or communicated, and how quickly and efficiently the information may be processed, stored, or communicated. The variations in information handling systems allow for information handling systems to be general or configured for a specific user or specific use such as financial transaction processing, airline reservations, enterprise data storage, or global communications. In addition, information handling systems may include a variety of hardware and software components that may be configured to process, store, and communicate information and may include one or more computer systems, data storage systems, and networking systems.
  • Some data center servers are equipped with chassis manager firmware, which manages power supply units and the redundancy configuration of the power supply units. Individual information handling system server nodes made be managed by a baseboard management controller having a handshake with the chassis manager via an Internet Protocol Management Bus (IPMB).
  • Existing chassis manager firmware does support power budgeting and management, often resulting in a less than ideal customer experience. Server nodes in existing server architectures may draw power immediately on a power button press, without a power budget check, sometimes resulting in throttling and poor performance, and in some cases cause complete chassis shutdown when the chassis power consumption exceeds the power supply capacity. Also, lack of power budgeting in existing approaches prevents calculation of lower and upper boundaries for power capping. For example, existing approaches were unable to calculate a fast throttle boundary (FTB), a node lower boundary (NLB), or to protect power supply units and prevent exothermic events while maximizing the system performance via a hardware protection policy (HWPP) defining an average power limit for a server node.
  • SUMMARY
  • In accordance with the teachings of the present disclosure, the disadvantages and problems associated with existing approaches to managing power in an information handling system may be reduced or eliminated.
  • In accordance with embodiments of the present disclosure, a method may include, in a system comprising a plurality of power supply units, determining a redundancy configuration of the plurality of power supply units, determining a power capacity of the plurality of power supply units, determining a number of modular information handling systems installed in the system, determining a chassis-level maximum transient power limit for each of the modular information handling systems based on the redundancy configuration, the power capacity, and the number of modular information handling systems, determining a chassis-level maximum average power limit for each of the modular information handling systems, and communicating the chassis-level maximum transient power limit and chassis-level maximum average power limit to a respective baseboard management controller of each of the modular information handling systems, wherein each respective baseboard management controller is configured to determine if sled-level power requirements of its respective information handling system are within the chassis-level maximum transient power limit and chassis-level maximum average power limit.
  • In accordance with these and other embodiments of the present disclosure, an article of manufacture may include a non-transitory computer-readable medium and computer-executable instructions carried on the computer-readable medium, the instructions readable by a processor, the instructions, when read and executed, for causing the processor to, in a system comprising a plurality of power supply units: determine a redundancy configuration of the plurality of power supply units, determine a power capacity of the plurality of power supply units, determine a number of modular information handling systems installed in the system, determine a chassis-level maximum transient power limit for each of the modular information handling systems based on the redundancy configuration, the power capacity, and the number of modular information handling systems, determine a chassis-level maximum average power limit for each of the modular information handling systems, and communicate the chassis-level maximum transient power limit and chassis-level maximum average power limit to a respective baseboard management controller of each of the modular information handling systems, wherein each respective baseboard management controller is configured to determine if sled-level power requirements of its respective information handling system are within the chassis-level maximum transient power limit and chassis-level maximum average power limit.
  • In accordance with these and other embodiments of the present disclosure, a management module configured to be communicatively coupled to a plurality of power supply units and may be further configured to determine a redundancy configuration of the plurality of power supply units, determine a power capacity of the plurality of power supply units, determine a number of modular information handling systems installed in a system, determine a chassis-level maximum transient power limit for each of the modular information handling systems based on the redundancy configuration, the power capacity, and the number of modular information handling systems, determine a chassis-level maximum average power limit for each of the modular information handling systems, and communicate the chassis-level maximum transient power limit and chassis-level maximum average power limit to a respective baseboard management controller of each of the modular information handling systems, wherein each respective baseboard management controller is configured to determine if sled-level power requirements of its respective information handling system are within the chassis-level maximum transient power limit and chassis-level maximum average power limit.
  • Technical advantages of the present disclosure may be readily apparent to one skilled in the art from the figures, description and claims included herein. The objects and advantages of the embodiments will be realized and achieved at least by the elements, features, and combinations particularly pointed out in the claims.
  • It is to be understood that both the foregoing general description and the following detailed description are examples and explanatory and are not restrictive of the claims set forth in this disclosure.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • A more complete understanding of the present embodiments and advantages thereof may be acquired by referring to the following description taken in conjunction with the accompanying drawings, in which like reference numbers indicate like features, and wherein:
  • FIG. 1 illustrates a block diagram of an example system, in accordance with embodiments of the present disclosure;
  • FIG. 2 illustrates a flow chart of an example method for enabling, at the level of a chassis manager, power budgeting in a chassis comprising a plurality of modular information handling systems, in accordance with embodiments of the present disclosure; and
  • FIG. 3 illustrates a flow chart of an example method for enabling, at the level of a baseboard management controller, power budgeting in a chassis comprising a plurality of modular information handling systems, in accordance with embodiments of the present disclosure.
  • DETAILED DESCRIPTION
  • Preferred embodiments and their advantages are best understood by reference to FIGS. 1 through 3, wherein like numbers are used to indicate like and corresponding parts.
  • For the purposes of this disclosure, an information handling system may include any instrumentality or aggregate of instrumentalities operable to compute, classify, process, transmit, receive, retrieve, originate, switch, store, display, manifest, detect, record, reproduce, handle, or utilize any form of information, intelligence, or data for business, scientific, control, entertainment, or other purposes. For example, an information handling system may be a personal computer, a personal digital assistant (PDA), a consumer electronic device, a network storage device, or any other suitable device and may vary in size, shape, performance, functionality, and price. The information handling system may include memory, one or more processing resources such as a central processing unit (“CPU”) or hardware or software control logic. Additional components of the information handling system may include one or more storage devices, one or more communications ports for communicating with external devices as well as various input/output (“I/O”) devices, such as a keyboard, a mouse, and a video display. The information handling system may also include one or more buses operable to transmit communication between the various hardware components.
  • For the purposes of this disclosure, computer-readable media may include any instrumentality or aggregation of instrumentalities that may retain data and/or instructions for a period of time. Computer-readable media may include, without limitation, storage media such as a direct access storage device (e.g., a hard disk drive or floppy disk), a sequential access storage device (e.g., a tape disk drive), compact disk, CD-ROM, DVD, random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), and/or flash memory; as well as communications media such as wires, optical fibers, microwaves, radio waves, and other electromagnetic and/or optical carriers; and/or any combination of the foregoing.
  • For the purposes of this disclosure, information handling resources may broadly refer to any component system, device or apparatus of an information handling system, including without limitation processors, service processors, basic input/output systems, buses, memories, I/O devices and/or interfaces, storage resources, network interfaces, motherboards, and/or any other components and/or elements of an information handling system.
  • FIG. 1 illustrates a block diagram of an example system 100, in accordance with embodiments of the present disclosure. As shown in FIG. 1, system 100 may comprise a chassis 101 for enclosing a plurality of information handling resources, including a plurality of modular information handling systems 102 (e.g., sleds), a management module 112, an internal network 118, and a power system comprising one or more power supply units (PSUs) 110.
  • Chassis 101 may include any suitable enclosure for housing the various components of system 100, and may also be referred to as a rack, tower, enclosure, and/or housing.
  • As shown in FIG. 1, an information handling system 102 may include a processor 103, a memory 104 communicatively coupled to processor 103, a basic input/output system (BIOS) 105 communicatively coupled to processor 103, and a baseboard management controller 108 communicatively coupled to processor 103.
  • A processor 103 may include any system, device, or apparatus configured to interpret and/or execute program instructions and/or process data, and may include, without limitation, a microprocessor, microcontroller, digital signal processor (DSP), application specific integrated circuit (ASIC), or any other digital or analog circuitry configured to interpret and/or execute program instructions and/or process data. In some embodiments, processor 103 may interpret and/or execute program instructions and/or process data stored in an associated memory 104 and/or another component of its associated information handling system 102.
  • A memory 104 may be communicatively coupled to an associated processor 103 and may include any system, device, or apparatus configured to retain program instructions and/or data for a period of time (e.g., computer-readable media). A memory 104 may include RAM, EEPROM, a PCMCIA card, flash memory, magnetic storage, opto-magnetic storage, or any suitable selection and/or array of volatile or non-volatile memory that retains data after power to information handling system 102 is turned off.
  • A BIOS 105 may be communicatively coupled to an associated processor 103 and may include any system, device, or apparatus configured to identify, test, and/or initialize information handling resources of an associated information handling system 102. “BIOS” may broadly refer to any system, device, or apparatus configured to perform such functionality, including without limitation, a Unified Extensible Firmware Interface (UEFI). In some embodiments, BIOS 105 may be implemented as a program of instructions that may be read by and executed on processor 103 to carry out the functionality of BIOS 105. In these and other embodiments, a BIOS 105 may comprise boot firmware configured to be the first code executed by processor 103 when information handling system 102 is booted and/or powered on. As part of its initialization functionality, BIOS 105 code may be configured to set components of information handling system 102 into a known state, so that one or more applications (e.g., an operating system or other application programs) stored on compatible media (e.g., memory 104) may be executed by processor 103 and given control of information handling system 102.
  • A baseboard management controller 108 may be configured to provide out-of-band management facilities for management of information handling system 102. Such management may be made by baseboard management controller 108 even if information handling system 102 is powered off or powered to a standby state. In certain embodiments, baseboard management controller 108 may include or may be an integral part of a remote access controller (e.g., a Dell Remote Access Controller or Integrated Dell Remote Access Controller).
  • Although, for the purposes of clarity and exposition, FIG. 1 depicts only two information handling systems 102 within system 100, it is understood that system 100 may comprise any suitable number of information handling systems 102.
  • In addition to a processor 103, a memory 104, BIOS 105, and a baseboard management controller 108, an information handling system 102 may include one or more other information handling resources. For example, in some embodiments, an information handling system 102 may include more than one memory 104. As another example, in some embodiments, an information handling system 102 may include a programmable logic device (e.g., integral to or separate from baseboard management controller 108).
  • Management module 112 may be configured to provide out-of-band management facilities for management of shared chassis infrastructure of system 100, such as air movers, PSUs 110, and/or other components shared by a plurality of information handling systems 102. Such management may be made by management module 112 even if system 100 is powered off or powered to a standby state. Management module 112 may include a processor 113 and one or more memories 111. In certain embodiments, management module 112 may include or may be an integral part of an enclosure controller (EC). In other embodiments, management module 112 may include or may be an integral part of a chassis management controller (CMC). In some embodiments, management module 112 may also be referred to as a “chassis manager.”
  • Although, for the purposes of clarity and exposition, FIG. 1 depicts only one management module 112, it is understood that system 100 may comprise any suitable number of management modules 112. For example, in some embodiments, two management modules 112 may be arranged in a redundant configuration, in which, at a given moment, one management module 112 may be “active” in that it is actively functional and performing its functionality, while another management module 112 is in a “standby” mode and may become active in the event that the active management module 112 experiences a fault or failure that causes it to failover to the standby management module 112.
  • Processor 113 may include any system, device, or apparatus configured to interpret and/or execute program instructions and/or process data, and may include, without limitation, a microprocessor, microcontroller, digital signal processor (DSP), application specific integrated circuit (ASIC), or any other digital or analog circuitry configured to interpret and/or execute program instructions and/or process data. In some embodiments, processor 113 may interpret and/or execute program instructions (e.g., firmware) and/or process data stored in memory 111 and/or another component of system 100 or management module 112. In some embodiments, processor 113 may comprise an enclosure controller configured to execute firmware relating to functionality as an enclosure controller. As shown in FIG. 1, processor 113 may include a network interface 114 for communicating with an internal network 118 of system 100.
  • Memory 111 may be communicatively coupled to processor 113 and may include any system, device, or apparatus configured to retain program instructions and/or data for a period of time (e.g., computer-readable media). Memory 111 may include RAM, EEPROM, a PCMCIA card, flash memory, magnetic storage, opto-magnetic storage, or any suitable selection and/or array of volatile or non-volatile memory that retains data after power to management module 112 is turned off.
  • Internal network 118 may comprise any suitable system, apparatus, or device operable to serve as communication infrastructure for network interface 114 to communicate to one or more other components, such as baseboard management controllers 108 of information handling systems 102. In some embodiments, internal network 118 may implement an Internet Protocol Management Bus (IPMB).
  • Generally speaking, a PSU 110 may include any system, device, or apparatus configured to supply electrical current to one or more information handling resources of system 100. As shown in FIG. 1, a PSU 110 may provide electrical energy via (a) a main power rail, indicated in FIG. 1 as “MAIN POWER,” and (b) an auxiliary power rail, indicated in FIG. 1 as “AUX POWER.” The main power rail may generally be used to provide power to information handling resources of an information handling system 102 when such information handling system 102 is turned on and/or to provide power to certain components of system 100. On the other hand, the auxiliary power rail may generally be used to provide power to certain auxiliary information handling resources when energy is not supplied via the main power rail. For example, the auxiliary power rail may be used to provide power to baseboard management controller 108 when electrical energy is not provided to processor 103, memory 104, and/or other information handling resources via the main power rail. As another example, the auxiliary power rail may be used to provide power to management module 112 when electrical energy is not provided to information handling resources 102 via the main power rail.
  • In some embodiments, a management module 112 may be configured to communicate with one or more PSUs 110 to communicate control and/or telemetry data between management module 112 and PSUs 110. For example, a PSU 110 may communicate information regarding specifications (e.g., power rating, maximum current, etc.) and/or measurements of electrical parameters (e.g., electrical currents or voltages) present within such PSU 110.
  • In addition to information handling systems 102, management modules 112, internal network 118, and PSUs 110, system 100 may include one or more other information handling resources. As an example, in some embodiments, an information handling system 102 may include a programmable logic device (e.g., integral to or separate from management module 112).
  • In operation, as described in greater detail below, in a modular system including multiple information handling systems 102, management module 112 may be configured to determine power budget values and power limit values for information handling systems 102 and pass such values to baseboard management controllers 108 via internal network 118. With such values, an information handling system 102 may be enabled to, during BIOS power-on/self-test, determine and report any insufficiency of power.
  • Further, management module 112 may be configured to allocate power to individual modular information handling systems 102 based on a number of modular information handling systems 102 present in chassis 101 and a redundancy configuration of PSUs 110.
  • In addition, such power budget values, power limit values, and allocation of power may be orchestrated around image verification checks by BIOS 105 in order to allow a BIOS 105 of each information handling system 102 to allow or block information handling system 102 from powering on. Such image verification check may be performed initially when alternating current (AC) power is applied to PSUs 110, as well as on every subsequent request by an information handling system 102 to power on.
  • Moreover, using the systems and methods described herein, multiple simultaneous BIOS image verifications may be avoided and a continuous loop of failed verifications may be avoided. A power inventory and modular information handling system 102 powering on procedure may be sequences based on verification results.
  • Among the advantages of the systems and methods disclosed herein is that they may provide a cost-effective approach to provide a power budget check alert and power control without the complexity and cost of enclosure controllers that are often used for power budgeting.
  • Instead, the systems and methods disclosed herein may take advantage of a built-in power budget and power control infrastructure of management module 112, baseboard management controller 108, and BIOS 105. For example, the systems and methods disclosed herein may:
      • leverage an existing hardware protection policy (HWPP) for power control to avoid overconsumption;
      • leverage an existing baseboard management controller-BIOS handshake power budget checks; and/or
      • leverage the power management capabilities of a baseboard management controller (e.g., iDRAC Power Manager SMBAlert) power excursion by PSUs 110.
  • A power limit calculated by management module 112 may include a per-information handling system 102 full-throttle boundary (FTB). FTB limits may be influenced by effective capacity of PSUs 110 and a redundancy configuration of PSUs 110. The FTB calculation may determine maximum transient peak power events expected at outputs of PSUs 110.
  • To further illustrate, management module 112 may calculate FTB as:

  • FTB=(P OUT*EPR−P SHARED)/N
  • wherein:
  • POUT=effective output capacity of PSUs 110 (e.g., manufacturer-rated maximum power output multiplied by a redundancy factor PSUCOUNT);
  • PSUCOUNT=1 for grid redundant configuration; 2 for non-redundant configuration;
  • EPR=an extended power output range of PSUs 110 (e.g., 1.4);
  • PSHARED=power consumed by components of chassis 101 shared by all information handling systems 102 (e.g., chassis backplane, management module 112, air movers, etc.); and
  • N=a number of information handling systems 102 installed in chassis 101.
  • Thus, as an example, assuming two PSUs 110 each having a manufacturer rated capacity of 2400 W in a redundant configuration, 357 W of power consumed by shared components of chassis 101, and four information handling system 102, management module 112 may calculate FTB as follows:
  • F T B = ( P OUT EPR - P SHARED ) / N = ( 2400 W 1 1.4 - 357 W ) / 4 = 750 W
  • Management module 112 may communicate FTB to each information handling system 102 via internal network 118, along with an HWPP defining an average power consumption limit for each information handling system 102. The HWPP may serve as a node lower bound (NLB) for each information handling system 102.
  • During power-on/self-test, BIOS 105 of an information handling system 102 may compare its own calculated sled-level FTB to the chassis-level FTB received from management module 112. If the sled-level FTB is greater than the chassis-level FTB, BIOS 105 may fail its power budget check.
  • Similarly, during power-on/self-test, BIOS 105 of an information handling system 102 may compare its own calculated sled-level NLB to the sled-level HWPP (which may be the lesser of the HWPP received from management module 112 and a sled-connector maximum). If the sled-level NLB is greater than the sled-level HWPP, BIOS 105 may fail its power budget check.
  • A BIOS 105 may pass power budget checks only if both FTB and NLB checks pass for its associated information handling system 102. If either of these checks fail, BIOS 105 may prevent information handling system 102 from fully powering on (e.g., boot of information handling system 102 may halt at the end of power-on/self-test with a halt F1/F2 message).
  • For power budget check failure scenarios described above, baseboard management controller 108 may log an error for power budget failure. Each information handling system 102 may be addressed independently for failure scenarios.
  • The FTB and HWPP values calculated by management module 112 may dynamically change in the event an information handling system 102 is added or removed from chassis 101, if the redundancy configuration of PSUs 110 is modified (e.g., by a user), or if a PSU 110 is added (or powered on) or removed (or powered down, loses AC “power OK”).
  • To illustrate, when a modular information handling system 102 is added or removed from chassis 101, management module 112 may calculate new FTP and HWPP values and communicate such updated values to each modular information handling system 102. When a modular information handling system 102 receives the updated chassis-level FTB and HWPP values, it may again compare such values against its sled-level FTB and NLB values, respectively. If either sled-level value exceeds its respective chassis-level value, baseboard management controller 108 may log a “system power budget exceeds PSU capacity.” However, at this point any information handling systems 102 that are currently on may not be shut down or restarted due to this power budget check. Any hardware limits may be addressed by baseboard management controller 108 using HWPP, which may always remain enabled.
  • When a redundancy configuration of PSUs 110 is changed or a PSU 110 is added or removed, management module 112 may recalculate the FTB and HWPP values, communicate such values to information handling systems 102, and baseboard management controllers 108 may perform power budget checks as described above.
  • FIG. 2 illustrates a flow chart of an example method 200 for enabling, at the level of management module 112, power budgeting in chassis 101 comprising a plurality of modular information handling systems 102, in accordance with embodiments of the present disclosure. According to some embodiments, method 200 may begin at step 202. As noted above, teachings of the present disclosure may be implemented in a variety of configurations of information handling system 102. As such, the preferred initialization point for method 200 and the order of the steps comprising method 200 may depend on the implementation chosen.
  • Method 200 may start at step 202 in response to a powering on or restart of management module 112.
  • At step 202, management module 112 may determine a redundancy configuration of PSUs 110. At step 204, management module 112 may discover PSUs 110 and determine the manufacturer rated power capacity for each. At step 206, management module 112 may determine a power consumed by components of chassis 101 shared by information handling systems 102. At step 208, management module 112 may validate and enumerate information handling systems 102 installed within chassis 101.
  • At step 210, management module 112 may calculate FTB and HWPP values based on information collected at steps 202-208. At step 212, management module 112 may communicate these chassis-level FTB and HWPP values to each information handling system 102.
  • At step 214, management module 112 may determine if a redundancy configuration of PSUs 110 has changed or a PSU 110 has been added or removed. If a redundancy configuration of PSUs 110 has changed or a PSU 110 has been added or removed, method 200 may proceed again to step 202. Otherwise, method 200 may proceed to step 216.
  • At step 216, management module 112 may determine if the number of information handling systems 102 installed in chassis 101 has changed. If the number of information handling systems 102 installed in chassis 101 has changed, method 200 may proceed again to step 202. Otherwise, method 200 may proceed again to step 214.
  • Although FIG. 2 discloses a particular number of steps to be taken with respect to method 200, method 200 may be executed with greater or fewer steps than those depicted in FIG. 2. In addition, although FIG. 2 discloses a certain order of steps to be taken with respect to method 200, the steps comprising method 200 may be completed in any suitable order.
  • Method 200 may be implemented using a baseboard management controller 108, and/or any other system operable to implement method 200. In certain embodiments, method 200 may be implemented partially or fully in software and/or firmware embodied in computer-readable media.
  • FIG. 3 illustrates a flow chart of an example method 300 for enabling, at the level of a baseboard management controller 108, power budgeting in chassis 101 comprising a plurality of modular information handling systems 102, in accordance with embodiments of the present disclosure. According to some embodiments, method 300 may begin at step 302. As noted above, teachings of the present disclosure may be implemented in a variety of configurations of information handling system 102. As such, the preferred initialization point for method 300 and the order of the steps comprising method 300 may depend on the implementation chosen.
  • Method 300 may start at step 302 in response to a powering on or restart of an information handling system 102, which may initialize operation of a baseboard management controller 108.
  • At step 302, baseboard management controller 108 may determine if a request has been made to power on information handling system 102. If a request has been made to power on information handling system 102, method 300 may proceed to step 304. Otherwise, step 302 may repeat until a request has been made to power on information handling system 102.
  • At step 304, baseboard management controller 108 may calculate sled-level FTB and NLB values for its associated information handling system 102.
  • At step 306, baseboard management controller 108 may determine if its sled-level FTB exceeds a chassis-level FTB communicated from management module 112. If the sled-level FTB value exceeds a chassis-level FTB value communicated from management module 112, method 300 may proceed to step 312. Otherwise, method 300 may proceed to step 308.
  • At step 308, baseboard management controller 108 may determine if its sled-level NLB value exceeds a chassis-level HWPP value communicated from management module 112. If the sled-level NLB value exceeds a chassis-level HWPP value communicated from management module 112, method 300 may proceed to step 312. Otherwise, method 300 may proceed to step 310.
  • At step 310, baseboard management controller 108 may determine if an updated chassis-level FTB value and/or updated chassis-level HWPP value has been received from management module 112. If an updated chassis-level FTB value and/or updated chassis-level HWPP value has been received from management module 112, method 300 may proceed again to step 306. Otherwise, method 300 may remain at step 310 until an updated chassis-level FTB value and/or updated chassis-level HWPP value has been received from management module 112.
  • At step 312, baseboard management controller 108 may determine if its associated information handling system 102 is powered on (e.g., in power state S0). If the associated information handling system 102 is powered on, method 300 may proceed to step 314. Otherwise, method 300 may proceed to step 316.
  • At step 314, baseboard management controller 108 may log an alert indicating a power budget check failure. After completion of step 314, method 300 may proceed again to step 302.
  • At step 316, baseboard management controller 108 may prevent its associated information handling system 102 from powering on, and may report a power failure to BIOS 105 (e.g., with a halt F1/F2 message). After completion of step 316, method 300 may proceed again to step 302.
  • Although FIG. 3 discloses a particular number of steps to be taken with respect to method 300, method 300 may be executed with greater or fewer steps than those depicted in FIG. 3. In addition, although FIG. 3 discloses a certain order of steps to be taken with respect to method 300, the steps comprising method 300 may be completed in any suitable order.
  • Method 300 may be implemented using a baseboard management controller 108, and/or any other system operable to implement method 300. In certain embodiments, method 200 may be implemented partially or fully in software and/or firmware embodied in computer-readable media.
  • As used herein, when two or more elements are referred to as “coupled” to one another, such term indicates that such two or more elements are in electronic communication or mechanical communication, as applicable, whether connected indirectly or directly, with or without intervening elements.
  • This disclosure encompasses all changes, substitutions, variations, alterations, and modifications to the example embodiments herein that a person having ordinary skill in the art would comprehend. Similarly, where appropriate, the appended claims encompass all changes, substitutions, variations, alterations, and modifications to the example embodiments herein that a person having ordinary skill in the art would comprehend. Moreover, reference in the appended claims to an apparatus or system or a component of an apparatus or system being adapted to, arranged to, capable of, configured to, enabled to, operable to, or operative to perform a particular function encompasses that apparatus, system, or component, whether or not it or that particular function is activated, turned on, or unlocked, as long as that apparatus, system, or component is so adapted, arranged, capable, configured, enabled, operable, or operative. Accordingly, modifications, additions, or omissions may be made to the systems, apparatuses, and methods described herein without departing from the scope of the disclosure. For example, the components of the systems and apparatuses may be integrated or separated. Moreover, the operations of the systems and apparatuses disclosed herein may be performed by more, fewer, or other components and the methods described may include more, fewer, or other steps. Additionally, steps may be performed in any suitable order. As used in this document, “each” refers to each member of a set or each member of a subset of a set.
  • Although exemplary embodiments are illustrated in the figures and described below, the principles of the present disclosure may be implemented using any number of techniques, whether currently known or not. The present disclosure should in no way be limited to the exemplary implementations and techniques illustrated in the drawings and described above.
  • Unless otherwise specifically noted, articles depicted in the drawings are not necessarily drawn to scale.
  • All examples and conditional language recited herein are intended for pedagogical objects to aid the reader in understanding the disclosure and the concepts contributed by the inventor to furthering the art, and are construed as being without limitation to such specifically recited examples and conditions. Although embodiments of the present disclosure have been described in detail, it should be understood that various changes, substitutions, and alterations could be made hereto without departing from the spirit and scope of the disclosure.
  • Although specific advantages have been enumerated above, various embodiments may include some, none, or all of the enumerated advantages. Additionally, other technical advantages may become readily apparent to one of ordinary skill in the art after review of the foregoing figures and description.
  • To aid the Patent Office and any readers of any patent issued on this application in interpreting the claims appended hereto, applicants wish to note that they do not intend any of the appended claims or claim elements to invoke 35 U.S.C. § 112(f) unless the words “means for” or “step for” are explicitly used in the particular claim.

Claims (20)

1. A method comprising, in a system comprising a plurality of power supply units:
determining a redundancy configuration of the plurality of power supply units;
determining a power capacity of the plurality of power supply units;
determining a number of modular information handling systems installed in the system;
determining a chassis-level maximum transient power limit for each of the modular information handling systems based on the redundancy configuration, the power capacity, and the number of modular information handling systems;
determining a chassis-level maximum average power limit for each of the modular information handling systems; and
communicating the chassis-level maximum transient power limit for each of the modular information handling systems and the chassis-level maximum average power limit for each of the modular information handling systems to a respective baseboard management controller of each of the modular information handling systems, wherein each respective baseboard management controller is configured to determine if sled-level power requirements of its respective information handling system are within the chassis-level maximum transient power limit for each of the modular information handling systems and the chassis-level maximum average power limit for each of the modular information handling systems;
wherein each baseboard management controller is configured to, responsive to determining that sled-level power requirements of its respective information handling system exceed either of chassis-level maximum transient power limit and chassis-level maximum average power limit, prevent powering on of the respective information handling system such baseboard management controller is integral to.
2. The method of claim 1, further comprising:
determining a power consumed by components of the system shared by the modular information handling systems; and
further determining the chassis-level maximum transient power limit for each of the modular information handling systems based on the power consumed by components of the system shared by the modular information handling systems.
3. The method of claim 1, further comprising updating the chassis-level maximum transient power limit for each of the modular information handling systems responsive to a change in the redundancy configuration of the plurality of power supply units.
4. The method of claim 1, further comprising:
updating the chassis-level maximum transient power limit for each of the modular information handling systems responsive to a change in the number of modular information handling systems installed in the system; and
communicating the chassis-level maximum transient power limit for each of the modular information handling systems as updated to the respective baseboard management controller of each of the modular information handling systems.
5. The method of claim 1, wherein the chassis-level maximum transient power limit for each of the modular information handling systems and the chassis-level maximum average power limit for each of the modular information handling systems is communicated from a management module via an internal communication network of the system.
6. (canceled)
7. The method of claim 1, wherein each baseboard management controller is configured to, responsive to determining that sled-level power requirements of its respective information handling system exceed either of the chassis-level maximum transient power limit for each of the modular information handling systems and the chassis-level maximum average power limit for each of the modular information handling systems, generate an alert indicating a power check failure of the respective information handling system such baseboard management controller is integral to.
8. An article of manufacture comprising:
a non-transitory computer-readable medium; and
computer-executable instructions carried on the computer-readable medium, the instructions readable by a processor, the instructions, when read and executed, for causing the processor to, in a system comprising a plurality of power supply units:
determine a redundancy configuration of the plurality of power supply units;
determine a power capacity of the plurality of power supply units;
determine a number of modular information handling systems installed in the system;
determine a chassis-level maximum transient power limit for each of the modular information handling systems based on the redundancy configuration, the power capacity, and the number of modular information handling systems;
determine a chassis-level maximum average power limit for each of the modular information handling systems; and
communicate the chassis-level maximum transient for each of the modular information handling systems power limit and the chassis-level maximum average power limit for each of the modular information handling systems to a respective baseboard management controller of each of the modular information handling systems, wherein each respective baseboard management controller is configured to determine if sled-level power requirements of its respective information handling system are within the chassis-level maximum transient power limit for each of the modular information handling systems and the chassis-level maximum average power limit for each of the modular information handling systems;
wherein each baseboard management controller is configured to, responsive to determining that sled-level power requirements of its respective information handling system exceed either of chassis-level maximum transient power limit and chassis-level maximum average power limit, prevent powering on of the respective information handling system such baseboard management controller is integral to.
9. The article of manufacture of claim 8, the instructions for further causing the processor to:
determine a power consumed by components of the system shared by the modular information handling systems; and
further determine the chassis-level maximum transient power limit for each of the modular information handling systems based on the power consumed by components of the system shared by the modular information handling systems.
10. The article of manufacture of claim 8, the instructions for further causing the processor to update the chassis-level maximum transient power limit for each of the modular information handling systems responsive to a change in the redundancy configuration of the plurality of power supply units.
11. The article of manufacture of claim 8, the instructions for further causing the processor to:
update the chassis-level maximum transient power limit for each of the modular information handling systems responsive to a change in the number of modular information handling systems installed in the system; and
communicate the chassis-level maximum transient power limit for each of the modular information handling systems as updated to the respective baseboard management controller of each of the modular information handling systems.
12. The article of manufacture of claim 8, wherein the chassis-level maximum transient power limit for each of the modular information handling systems and the chassis-level maximum average power limit for each of the modular information handling systems is communicated from a management module via an internal communication network of the system.
13. (canceled)
14. The article of manufacture of claim 8, wherein each baseboard management controller is configured to, responsive to determining that sled-level power requirements of its respective information handling system exceed either of chassis-level maximum transient power limit for each of the modular information handling systems and chassis-level maximum average power limit for each of the modular information handling systems, generate an alert indicating a power check failure of the respective information handling system such baseboard management controller is integral to.
15. A management module configured to be communicatively coupled to a plurality of power supply units and further configured to:
determine a redundancy configuration of the plurality of power supply units;
determine a power capacity of the plurality of power supply units;
determine a number of modular information handling systems installed in a system;
determine a chassis-level maximum transient power limit for each of the modular information handling systems based on the redundancy configuration, the power capacity, and the number of modular information handling systems;
determine a chassis-level maximum average power limit for each of the modular information handling systems; and
communicate the chassis-level maximum transient power limit for each of the modular information handling systems and the chassis-level maximum average power limit for each of the modular information handling systems to a respective baseboard management controller of each of the modular information handling systems, wherein each respective baseboard management controller is configured to determine if sled-level power requirements of its respective information handling system are within the chassis-level maximum transient power limit for each of the modular information handling systems and chassis-level maximum average power limit for each of the modular information handling systems;
wherein each baseboard management controller is configured to, responsive to determining that sled-level power requirements of its respective information handling system exceed either of chassis-level maximum transient power limit and chassis-level maximum average power limit, prevent powering on of the respective information handling system such baseboard management controller is integral to.
16. The management module of claim 15, further configured to:
determine a power consumed by components of the system shared by the modular information handling systems; and
further determine the chassis-level maximum transient power for each of the modular information handling systems limit based on the power consumed by components of the system shared by the modular information handling systems.
17. The management module of claim 15, further configured to update the chassis-level maximum transient power limit for each of the modular information handling systems responsive to a change in the redundancy configuration of the plurality of power supply units.
18. The management module of claim 15, further configured to:
update the chassis-level maximum transient power limit for each of the modular information handling systems responsive to a change in the number of modular information handling systems installed in the system; and
communicate the chassis-level maximum transient power limit for each of the modular information handling systems as updated to the respective baseboard management controller of each of the modular information handling systems.
19. (canceled)
20. The management module of claim 15, wherein each baseboard management controller is configured to, responsive to determining that sled-level power requirements of its respective information handling system exceed either of chassis-level maximum transient power limit for each of the modular information handling systems and chassis-level maximum average power limit for each of the modular information handling systems, generate an alert indicating a power check failure of the respective information handling system such baseboard management controller is integral to.
US16/907,965 2020-06-22 2020-06-22 Systems and methods for enabling power budgeting in an information handling system comprising a plurality of modular information handling systems Active US11249533B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/907,965 US11249533B2 (en) 2020-06-22 2020-06-22 Systems and methods for enabling power budgeting in an information handling system comprising a plurality of modular information handling systems

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US16/907,965 US11249533B2 (en) 2020-06-22 2020-06-22 Systems and methods for enabling power budgeting in an information handling system comprising a plurality of modular information handling systems

Publications (2)

Publication Number Publication Date
US20210397240A1 true US20210397240A1 (en) 2021-12-23
US11249533B2 US11249533B2 (en) 2022-02-15

Family

ID=79023471

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/907,965 Active US11249533B2 (en) 2020-06-22 2020-06-22 Systems and methods for enabling power budgeting in an information handling system comprising a plurality of modular information handling systems

Country Status (1)

Country Link
US (1) US11249533B2 (en)

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7457976B2 (en) * 2005-11-22 2008-11-25 International Business Machines Corporation Power management using spare capacity of redundant power supply in blade environment
US7493503B2 (en) * 2005-12-22 2009-02-17 International Business Machines Corporation Programmable throttling in blade/chassis power management
US7383454B2 (en) * 2006-04-18 2008-06-03 Dell Products L.P. System and method for blade information handling system power inventory
US7555666B2 (en) * 2006-05-04 2009-06-30 Dell Products L.P. Power profiling application for managing power allocation in an information handling system
US7669071B2 (en) * 2006-05-05 2010-02-23 Dell Products L.P. Power allocation management in an information handling system
US7779276B2 (en) * 2007-03-05 2010-08-17 International Business Machines Corporation Power management in a power-constrained processing system
US8082454B2 (en) * 2007-11-07 2011-12-20 International Business Machines Corporation Managing power consumption based on historical average
US8756440B2 (en) * 2008-04-16 2014-06-17 International Business Machines Corporation System power capping using information received from the installed power supply
JP4743242B2 (en) * 2008-09-08 2011-08-10 日本電気株式会社 Power feeding system and power feeding method
JP5428267B2 (en) * 2008-09-26 2014-02-26 富士通株式会社 Power supply control system and power supply control method
JP5244862B2 (en) * 2010-06-16 2013-07-24 株式会社日立製作所 Information processing system provided with a power suppression function according to the output state of the power supply module
US9021290B2 (en) * 2012-04-05 2015-04-28 Oracle International Corporation Systems and methods for dynamic power management in a blade server
US9170627B2 (en) * 2012-08-20 2015-10-27 Dell Products L.P. Power management for PCIE switches and devices in a multi-root input-output virtualization blade chassis
US9632552B2 (en) * 2013-04-10 2017-04-25 Dell Products L.P. System and method for aggressively budgeting power allocation for an information handling system using redundant configuration of power supply units
US9336106B2 (en) * 2014-04-17 2016-05-10 Cisco Technology, Inc. Dynamically limiting bios post for effective power management
US9958923B2 (en) * 2014-06-20 2018-05-01 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Preventing oversubscription to power resources in a computing system
US9477281B2 (en) * 2014-09-12 2016-10-25 Vigyanlabs Inc. Distributed information technology infrastructure dynamic policy driven peak power management system
US10268262B2 (en) * 2015-08-02 2019-04-23 Dell Products, L.P. Dynamic peak power limiting to processing nodes in an information handling system
US10067548B2 (en) * 2016-05-19 2018-09-04 Dell Products L.P. Efficient power-on sequence for a modular information handling system
US10824215B2 (en) * 2018-07-31 2020-11-03 Nutanix, Inc. Managing power budget of multiple computing node clusters in a computing rack system

Also Published As

Publication number Publication date
US11249533B2 (en) 2022-02-15

Similar Documents

Publication Publication Date Title
US8390148B2 (en) Systems and methods for power supply wear leveling in a blade server chassis
US9916165B2 (en) Systems and methods to optimize boot for information handling system comprising persistent memory
US9710179B2 (en) Systems and methods for persistent memory timing characterization
US10031571B2 (en) Systems and methods for power loss protection of storage resources
US11099961B2 (en) Systems and methods for prevention of data loss in a power-compromised persistent memory equipped host information handling system during a power loss event
US20210208650A1 (en) Systems and methods for graceful termination of applications in response to power event
US11340684B2 (en) System and method for predictive battery power management
US20210240831A1 (en) Systems and methods for integrity verification of secondary firmware while minimizing boot time
US20140237290A1 (en) Information processing apparatus, method for controlling information processing apparatus, and information processing system
US10387306B2 (en) Systems and methods for prognosticating likelihood of successful save operation in persistent memory
US11429371B2 (en) Life cycle management acceleration
US10996876B2 (en) Systems and methods for dynamically modifying memory namespace allocation based on memory attributes and application requirements
US11157060B2 (en) Systems and methods for chassis-level persistent memory sequencing and safety
US20220391188A1 (en) Systems and methods for context-aware firmware update
US11226665B2 (en) Systems and methods for optimizing fault tolerant redundancy for an information handling system with multiple power supply units
US11334436B2 (en) GPU-based advanced memory diagnostics over dynamic memory regions for faster and efficient diagnostics
US9612638B1 (en) Systems and methods for automatic detection and configuration of voltage regulator phases in a multi-rail voltage regulator
US10365705B2 (en) System and methods for prioritized multi-node server and infrastructure availability during power capacity loss
US11243757B2 (en) Systems and methods for efficient firmware update of memory devices in BIOS/UEFI environment
US20210397240A1 (en) Systems and methods for enabling power budgeting in an information handling system comprising a plurality of modular information handling systems
US11593141B2 (en) Atomic groups for configuring HCI systems
US20210406064A1 (en) Systems and methods for asynchronous job scheduling among a plurality of managed information handling systems
CN111124095B (en) Power supply running state detection method and related device during upgrading of power supply firmware
US20200249738A1 (en) Systems and methods for isolation of a power-compromised host information handling system to prevent impact to other host information handling systems during a persistent memory save operation
US20200252280A1 (en) Systems and methods for validated configuration compliance assurance

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, NORTH CAROLINA

Free format text: SECURITY AGREEMENT;ASSIGNORS:DELL PRODUCTS L.P.;EMC IP HOLDING COMPANY LLC;REEL/FRAME:053531/0108

Effective date: 20200818

AS Assignment

Owner name: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT, TEXAS

Free format text: SECURITY INTEREST;ASSIGNORS:DELL PRODUCTS L.P.;EMC IP HOLDING COMPANY LLC;REEL/FRAME:053578/0183

Effective date: 20200817

Owner name: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT, TEXAS

Free format text: SECURITY INTEREST;ASSIGNORS:DELL PRODUCTS L.P.;EMC IP HOLDING COMPANY LLC;REEL/FRAME:053574/0221

Effective date: 20200817

Owner name: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT, TEXAS

Free format text: SECURITY INTEREST;ASSIGNORS:DELL PRODUCTS L.P.;EMC IP HOLDING COMPANY LLC;REEL/FRAME:053573/0535

Effective date: 20200817

AS Assignment

Owner name: DELL PRODUCTS L.P., TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:JESURAJAN MARYSTELLA, ANTO DOLPHINJOSE;KLEIN, CRAIG A.;MUTHAIYAN, ARUN;AND OTHERS;SIGNING DATES FROM 20200615 TO 20200909;REEL/FRAME:053721/0365

AS Assignment

Owner name: EMC IP HOLDING COMPANY LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST AT REEL 053531 FRAME 0108;ASSIGNOR:CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH;REEL/FRAME:058001/0371

Effective date: 20211101

Owner name: DELL PRODUCTS L.P., TEXAS

Free format text: RELEASE OF SECURITY INTEREST AT REEL 053531 FRAME 0108;ASSIGNOR:CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH;REEL/FRAME:058001/0371

Effective date: 20211101

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: EMC IP HOLDING COMPANY LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053574/0221);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:060333/0001

Effective date: 20220329

Owner name: DELL PRODUCTS L.P., TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053574/0221);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:060333/0001

Effective date: 20220329

Owner name: EMC IP HOLDING COMPANY LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053578/0183);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:060332/0864

Effective date: 20220329

Owner name: DELL PRODUCTS L.P., TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053578/0183);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:060332/0864

Effective date: 20220329

Owner name: EMC IP HOLDING COMPANY LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053573/0535);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:060333/0106

Effective date: 20220329

Owner name: DELL PRODUCTS L.P., TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053573/0535);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:060333/0106

Effective date: 20220329

CC Certificate of correction