US11068176B2 - Method, apparatus and computer program product for managing storage system - Google Patents

Method, apparatus and computer program product for managing storage system Download PDF

Info

Publication number
US11068176B2
US11068176B2 US16/504,624 US201916504624A US11068176B2 US 11068176 B2 US11068176 B2 US 11068176B2 US 201916504624 A US201916504624 A US 201916504624A US 11068176 B2 US11068176 B2 US 11068176B2
Authority
US
United States
Prior art keywords
resource pool
disks
storage resource
added
phase
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US16/504,624
Other languages
English (en)
Other versions
US20200026445A1 (en
Inventor
Sheng Wang
Jian Gao
Shuai Ni
Geng Han
Xinlei Xu
Ruiyong Jia
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
EMC Corp
Original Assignee
EMC IP Holding Co LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by EMC IP Holding Co LLC filed Critical EMC IP Holding Co LLC
Assigned to EMC IP Holding Company LLC reassignment EMC IP Holding Company LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GAO, JIAN, HAN, GENG, JIA, RUIYONG, NI, Shuai, WANG, SHENG, XU, XINLEI
Assigned to CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH reassignment CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH SECURITY AGREEMENT Assignors: DELL PRODUCTS L.P., EMC CORPORATION, EMC IP Holding Company LLC
Assigned to THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT reassignment THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT PATENT SECURITY AGREEMENT (NOTES) Assignors: DELL PRODUCTS L.P., EMC CORPORATION, EMC IP Holding Company LLC
Publication of US20200026445A1 publication Critical patent/US20200026445A1/en
Assigned to THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A. reassignment THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A. SECURITY AGREEMENT Assignors: CREDANT TECHNOLOGIES INC., DELL INTERNATIONAL L.L.C., DELL MARKETING L.P., DELL PRODUCTS L.P., DELL USA L.P., EMC CORPORATION, EMC IP Holding Company LLC, FORCE10 NETWORKS, INC., WYSE TECHNOLOGY L.L.C.
Assigned to THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT reassignment THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DELL PRODUCTS L.P., EMC CORPORATION, EMC IP Holding Company LLC
Publication of US11068176B2 publication Critical patent/US11068176B2/en
Application granted granted Critical
Assigned to EMC CORPORATION, DELL PRODUCTS L.P., EMC IP Holding Company LLC reassignment EMC CORPORATION RELEASE OF SECURITY INTEREST AT REEL 050406 FRAME 421 Assignors: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Assigned to EMC CORPORATION, DELL PRODUCTS L.P., EMC IP Holding Company LLC reassignment EMC CORPORATION RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (050724/0571) Assignors: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Assigned to DELL PRODUCTS L.P., EMC IP Holding Company LLC, EMC CORPORATION reassignment DELL PRODUCTS L.P. RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Assignors: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0689—Disk arrays, e.g. RAID, JBOD
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1415—Saving, restoring, recovering or retrying at system level

Definitions

  • Embodiments of the present disclosure generally relate to the field of data storage, and specifically to a method, an apparatus and a computer program product for managing a storage system.
  • a storage resource pool composed of a lot of disks.
  • the disks may be divided into a set of continuous, non-overlapping and fixed sized disk extents (hereinafter referred to as DE).
  • a redundant array of independent disks (RAID) group can be built based on the plurality of extents, and a storage logic unit can be created on the RAID group for use by a user.
  • the RAID built based on the disk extents rather than the whole disk is also called a “mapped RAID”.
  • mapped RAID To ensure the access performance of the mapped RAID, a plurality of extents in each RAID stripe of the mapped RAID are expected to be evenly distributed in respective disks.
  • the newly-added disk may be divided into a plurality of extents, and these extents may be used to create a new RAID group.
  • the amount of data to be migrated is relatively large, the user usually needs to wait a long period of time to obtain an available capacity of the extended storage resource pool.
  • embodiments of the present disclosure provide a method, an apparatus and a computer program product for managing a storage system.
  • a method for managing a storage system includes in response to receiving a request to add a first number of disks to a storage resource pool in the storage system, determining whether the first number of disks are to be added to the storage resource pool in a plurality of phases, wherein the storage resource pool includes at least one disk having a plurality of extents, and at least a part of the plurality of extents is included in at least one disk array group.
  • the method further includes in response to determining that the first number of disks are to be added to the storage resource pool in the plurality of phases including a first phase, determining a second number of disks to be added to the storage resource pool in the first phase.
  • the method further includes determining first information on a first disk array group to be created with the second number of disks in the first phase.
  • the method further includes adding the second number of disks to the storage resource pool in the first phase by creating the first disk array group in the storage resource pool based on the first information.
  • an apparatus for managing a storage system includes at least one processing unit and at least one memory.
  • the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit.
  • the instructions when executed by the at least one processing unit, cause the apparatus to perform acts including: in response to receiving a request to add a first number of disks to a storage resource pool in the storage system, determining whether the first number of disks are to be added to the storage resource pool in a plurality of phases, wherein the storage resource pool includes at least one disk having a plurality of extents, and at least a part of the plurality of extents is included in at least one disk array group; in response to determining that the first number of disks are to be added to the storage resource pool in the plurality of phases including a first phase, determining a second number of disks to be added to the storage resource pool in the first phase; determining first information on a first disk array group to be created with the second number of disks in the first phase; and adding the second number of disks to the storage resource pool in the first phase by creating the first disk array group in the storage resource pool based on the first information.
  • a computer program product that is tangibly stored on a non-transient computer readable medium and includes machine-executable instructions.
  • the machine-executable instructions when being executed by an apparatus, cause the apparatus to execute any step of the method according to the first aspect of the present disclosure.
  • FIG. 1 illustrates a schematic diagram of an example storage resource pool
  • FIGS. 2A-2D illustrate schematic diagrams of a process for shuffling extents of the storage resource pool
  • FIG. 3 illustrates a block diagram of an example storage system in which embodiments of the present disclosure can be implemented
  • FIG. 4 illustrates a flow chart of an example process for managing a storage system according to embodiments of the present disclosure
  • FIG. 5 illustrates a flow chart of an example process for determining information on a RAID group to be created according to embodiments of the present disclosure
  • FIG. 6 illustrates a flow chart of an example method for managing a storage system according to embodiments of the present disclosure.
  • FIG. 7 illustrates a block diagram of an example device adapted to implement embodiments of the present disclosure.
  • the specialized circuitry that performs one or more of the various operations disclosed herein may be formed by one or more processors operating in accordance with specialized instructions persistently stored in memory.
  • Such components may be arranged in a variety of ways such as tightly coupled with each other (e.g., where the components electronically communicate over a computer bus), distributed among different locations (e.g., where the components electronically communicate over a computer network), combinations thereof, and so on.
  • the term “includes” and its variants are to be read as open-ended terms that mean “includes, but is not limited to.”
  • the term “or” is to be read as “and/or” unless the context clearly indicates otherwise.
  • the term “based on” is to be read as “based at least in part on.”
  • the term “one example implementation” and “an example implementation” are to be read as “at least one example implementation.”
  • the term “another implementation” is to be read as “at least one other implementation.” Terms “a first”, “a second” and others can denote different or identical objects. The following text may also contain other explicit or implicit definitions.
  • the disks may be divided into a set of continuous, non-overlapping and fixed sized disk extents.
  • a redundant array of independent disks (RAID) group can be built based on the plurality of extents, and a storage logic unit can be created on the RAID group for use by a user.
  • the RAID group may include a plurality of RAID strips. Taking a RAIDS in a 4D+1P layout as an example, one RAID strip may include four data extents and one parity extent. To ensure the access performance of the mapped RAID, the plurality of extents in each RAID stripe of the mapped RAID are expected to be evenly distributed in respective disks.
  • FIG. 1 illustrates a schematic diagram of an example storage resource pool 100 , which shows an example of a RAID 5 in a 4D+1P layout built on N storage disks 110 - 1 ⁇ 110 -N (where N is greater than 5).
  • D0-D3 respectively represent data extents for storing user data
  • P represents a parity extent for storing parity information.
  • To create a RAID strip (including D0-D3 and P), five extents may be randomly selected from five different disks. Hence, the user data and parity information are evenly distributed in all disks.
  • an RAID group 120 and an RAID group 130 are created in the storage resource pool 100 .
  • the RAID group 120 may include RAID strips 121 , 122 and 123 , while the RAID group 130 may include RAID strips 131 , 132 and 133 .
  • a logic storage unit 140 is created on the RAID group 120
  • a logic storage unit 150 is created on the RAID group 130 , for use by a user (e.g., an upper-layer application).
  • the newly-added disk may be divided into a plurality of extents, and these extents may be used to create a new RAID group.
  • FIGS. 2A-2D illustrate schematic diagrams of the shuffling process.
  • the storage resource pool 200 initially includes six disks 210 - 1 - 210 - 6 , and an RAID group 220 is built thereon.
  • the user desires to add a disk 210 - 7 to the storage resource pool 200 .
  • the newly-added disk 210 - 7 is divided into a plurality of extents (DEs).
  • DEs extents
  • FIG. 2C data in some extents of the original six disks 210 - 1 - 210 - 6 are migrated to the extents of the newly-added disk 210 - 7 .
  • FIG. 2D after data migration as shown in FIG.
  • a new RAID group 230 may be created based on the current seven disks 210 - 1 - 210 - 7 of the storage resource pool 200 . As shown in FIG. 2D , the new RAID group 230 only includes one RAID strip, in which five extents come from disks 210 - 1 , 210 - 2 , 210 - 4 , 210 - 6 and 210 - 7 respectively.
  • the user needs to wait for completion of the shuffling process. If the amount of data to be migrated is relatively large, the user usually needs to wait a very long period of time to obtain an available capacity of the extended storage resource pool. For example, in the example as shown in FIGS. 2A-2D , assuming that the number of disks to be added is more than one disk (e.g., the number of the disks are not sufficient to create a new storage resource pool), the user might need to wait for a long period of time to obtain an available logic storage unit created on the newly-created RAID group.
  • Embodiments of the present disclosure provide a solution for managing a storage system, aiming to solve the above problems or one or more of other potential problems.
  • the solution enables a multi-phase extension with respect to the storage resource pool.
  • the solution permits to firstly add a portion (e.g., only one) of the disks to the storage resource pool, and then add remaining disks to the storage resource pool.
  • a portion of the newly-added capacity of the extended storage resource pool will be available to the user as quickly as possible.
  • the solution permits the user to decide a respective number of disks to be added in each of the multiple phases, so that the user can balance between the time to obtain the newly-added capacity and the available size of the newly-added capacity to be obtained.
  • FIG. 3 illustrates a block diagram of an example storage system 300 in which an embodiment of the present disclosure can be implemented.
  • the storage system 300 includes an application 310 , a storage processor (SP) 320 and a storage resource pool 330 .
  • SP storage processor
  • FIG. 3 illustrates a block diagram of an example storage system 300 in which an embodiment of the present disclosure can be implemented.
  • the storage system 300 includes an application 310 , a storage processor (SP) 320 and a storage resource pool 330 .
  • SP storage processor
  • the storage resource pool 330 may be the storage resource pool 100 as shown in FIG. 1 or the storage resource pool 200 as shown in FIGS. 2A-2D .
  • the storage resource pool 330 may include a plurality of disks.
  • a “disk” may refer to any non-volatile storage medium currently known or to be developed in future, for example, a magnetic disk, an optical disk or a solid-state disk (SSD).
  • SSD solid-state disk
  • each disk in the storage resource pool 330 may be divided into a set of continuous, non-overlapping and fixed sized disk extents.
  • the plurality of extents of the plurality of disks may be organized into one or more RAID groups.
  • a logic storage unit can be created based on the RAID group for use by the application 310 .
  • the application 310 may run on any physical computer, virtual machine, server and so on.
  • the application 310 may send a request to the storage processor 310 to operate the storage resource pool 330 .
  • the storage processor 320 may be configured to manage the storage resource pool 330 .
  • the storage processor 320 may include a control module 321 and a driver module 322 .
  • the control module 321 may receive from the application 310 a request, for example, to extend or shrink the storage resource pool 330 .
  • the control module 321 may generate a corresponding command based on the request received from the application 310 , and send the command to the driver module 322 .
  • the driver module 322 may perform a corresponding operation in response to the command from the control module 321 .
  • such operation may include but not limited to creating various storage objects (e.g., RAID groups or logic storage units) in the storage resource pool, and performing the shuffling operation shown in FIG. 2 on the storage resource pool.
  • FIG. 4 illustrates a flow chart of an example process 400 for managing a storage system according to embodiments of the present disclosure.
  • the process 400 is described in FIG. 4 with respect to the application 310 , control module 321 and driver module 322 as shown in FIG. 3 . It is to be understood that the method 400 may further include additional acts not shown and/or omit some shown acts. The scope of the present disclosure is not limited in this aspect.
  • the application 310 may send 401 , to the control module 321 , a request to extend the storage resource pool 330 .
  • the request for example may indicate a first number of disks are to be added to the storage resource pool 330 .
  • control module 321 may determine 402 whether the first number of disks are to be added to the storage resource pool 330 in a plurality of phases.
  • the control module 321 may determine, based on the first number, determine whether to add the first number of disks to the storage resource pool 330 via multiple phases. For example, if the first number is below a predetermined threshold, the control module 321 may determine that the first number of disks are to be added to the storage resource pool 330 in a plurality of phases. When the first number exceeds the predetermined threshold, the control module 321 may that the first number of disks are to be added to the storage resource pool 330 in only one phase.
  • the predetermined threshold may be associated with a width of the RAID. Taking a RAIDS with 4D+P1 layout as an example, its width is the number of extents included in one RAID strip, namely, five. In some embodiments, the predetermined threshold may be any value greater than the RAID width. For example, the predetermined threshold may be the RAID width plus 1, namely, 6. Additionally or alternatively, the predetermined threshold may refer to a minimum number of disks required for creating a new storage resource pool.
  • the control module 321 may control the driver module 322 to directly create a new storage resource pool based on the first number of disks, and then create an RAID group and a logic storage unit on the new storage resource pool for use by the application 310 . That is, when the first number of the disks to be added exceeds the predetermined threshold, the shuffling process shown in FIG. 2 may not need to be performed.
  • control module 321 may further determine a respective number of disks to be added to the storage resource pool 330 in each of the one or more phases.
  • the corresponding number of disks to be added to the storage resource pool 330 in each of the one or more phases may be specified by the application 310 (e.g., the user).
  • the corresponding number of disks to be added to the storage resource pool 330 in each of the multiple phases may be a predetermined value. For example, taking a two-phase extension as an example, only one disk may be added to the storage resource pool 330 in a first phase, and one or more remaining disks may be added to the storage resource pool 330 in a subsequent second phase.
  • the control module 321 may send 403 a first command to the driver module 322 , to obtain from the driver module 322 information on one or more RAID groups to be created in the storage resource pool 330 in each of the one or more phases.
  • the first command may include: an indication about whether to perform the extension in multiple phase, a corresponding number of disks to be added to the storage resource pool 330 in each of the multiple phases, and other information about the storage resource pool 330 (e.g., the number of disks, the size of an extent, a RAID type, and a RAID width).
  • the driver module 322 may determine, based on the first command, information on the one or more RAID groups to be created in the storage resource pool 330 in each of the multiple phases.
  • FIG. 5 illustrates a flow chart of an example process 500 executed at the driver module 322 according to embodiments of the present disclosure.
  • the process 500 may serve as an example implementation of the act 404 as shown in FIG. 4 . It is to be understood that the process 500 may further include additional acts not shown and/or omit some shown acts. The scope of the present disclosure is not limited in this aspect.
  • the driver module 323 receives the first command from the control module 321 .
  • the first command may include: an indication about whether to perform extension in multiple phase, a corresponding number of disks to be added to the storage resource pool 330 in each of the multiple phases, and other information about the storage resource pool 330 (e.g., the number of disks, the size of an extent, a RAID type, and a RAID width).
  • the driver module 322 determines, based on the first command, whether the extension of the storage resource pool 330 is a multi-phase extension. For example, the driver module 322 may perform the determination based on the indication about whether to perform the extension in multiple phases which is included in the first command.
  • the driver module 322 determines whether all of the multiple phases have been performed.
  • the driver module 322 may set up a simulation environment, and configure the simulation environment with information of the storage resource pool 330 prior to the extension in this phase.
  • the driver module 322 may perform a predetermined simulation algorithm based on the number of disks to be added in this phase (for example, the algorithm may include the shuffling process as shown in FIG. 2 ), and at 560 , obtain information on a RAID group to be created in this phase.
  • the process 500 may proceed to 550 , where the driver module 322 may perform the predetermined simulation algorithm based on the first number of disks to be added, so as to obtain, at 560 , the information on the RAID group to be created.
  • the process 500 proceeds to 570 , where the driver module 322 may determine whether the extension of the storage resource pool 330 is a multi-phase extension (identical to the act 520 ). If the extension is a single-phase extension, at 580 , the driver module 322 returns the obtained information on the RAID group to be created. If the extension is a multi-phase extension, the process 500 proceeds to 530 .
  • the process 500 proceeds to 580 , where the driver module 322 returns the obtained information on respective RAID groups to be created in the multiple phases.
  • the driver module 322 may return 405 the information to the control module 321 .
  • the returned information for example may include: a respective number of RAID groups to be created in each of the multiple phases, a total RAID capacity that can be provided in each of the multiple phases, a capacity of each of the RAID groups, and the number of disk extents to be shuffled estimated prior to the RAID group being created.
  • the control module 321 may generate one or more corresponding commands based on the obtained information, so as to control the driver module 322 to perform specific operations.
  • such operations may include but not limited to creating various storage objects (e.g., RAID group or logic storage unit) in the storage resource pool, and performing the shuffling operation as shown in FIG. 2 for the storage resource pool.
  • RAID group or logic storage unit e.g., RAID group or logic storage unit
  • the control module 321 may send 406 , to the driver module 322 , a first sequence of commands for the extension in a first phase.
  • the first sequence of commands may include respective commands for initiating a storage resource pool extension task in the first phase, creating a corresponding RAID group, creating a logic storage unit, and adding and activating the created logic storage unit.
  • the driver module 322 may perform 407 respective operations to create a corresponding RAID group (also called “a first disk array group” herein) with the disks to be added in the first phase (also called “a second number of disks” herein), and further create, add and/or activate a logical storage unit on the created RAID group.
  • the driver module 322 may return 408 an execution result of the first phase to the control module 321 .
  • the control module 321 may indicate 409 , to the application 310 , a newly-added available capacity of the extended storage resource pool 330 for use by the application 310 .
  • the control module 321 may further send 410 , to the driver module 322 , a second sequence of commands for the extension in a second phase.
  • the second sequence of commands may include respective commands for initiating a storage resource pool extension task in the second phase, creating a corresponding RAID group, creating a logic storage unit, and adding and activating the created logic storage unit.
  • the driver module 322 may perform 411 respective operations to create a corresponding RAID group (also called “a second disk array group” herein) with the disks to be added in the second phase (also called “a third number of disks” herein), and further create, add and/or activate a logical storage unit on the created RAID group.
  • the driver module 322 may return 408 an execution result of the second phase to the control module 321 .
  • the control module 321 may indicate 413 , to the application 310 , a newly-added available capacity of the extended storage resource pool 330 for use by the application 310 .
  • the control module 321 may perform the extension of the storage resource pool 330 in two phases. For example, only a part of the disks (e.g., only one) may be added to the storage resource pool 330 in a first phase, and then other disks may be added to the storage resource pool 330 in a second phase. If any operation in the first phase fails, all of the extension operations that have been performed may be rolled back, so as to restore the storage resource pool 330 back to a state before the first phase extension.
  • all operations in the first phase succeed but a certain operation in the second phase fails, all of the extension operations that have been performed in the second phase may be rolled back, so as to restore the storage resource pool 330 back to a state when the first phase extension is completed.
  • the control module 321 may have already activated the created logic storage object and provided it to the application 310 for use at the end of the first phase. In this case, it is unnecessary to roll back any operation performed in the first phase. Hence, such rollback mechanism can greatly reduce the overall time of the failure rollback process.
  • FIG. 6 illustrates a flow chart of an example method 600 for managing a storage system according to embodiments of the present disclosure.
  • the method 600 may be executed by the storage processor 320 as shown in FIG. 1 . It is to be understood that the method 600 may further include additional acts not shown and/or omit some shown acts. The scope of the present disclosure is not limited in this aspect.
  • the storage processor 320 determines whether the first number of disks are to be added to the storage resource pool in a plurality of phases, wherein the storage resource pool includes at least one disk having a plurality of extents, and at least a part of the plurality of extents is included in at least one disk array group.
  • the storage processor 320 may determine, based on the first number, whether to add the first number of disks to the storage resource pool in the plurality of phases.
  • the storage processor 320 may determine that the first number of disks are to be added to the storage resource pool in the plurality of phases in response to the first number being below a predetermined threshold.
  • the at least one disk array group is a redundant array of independent disks (RAID), and the predetermined threshold is associated with a width of the RAID.
  • RAID redundant array of independent disks
  • the predetermined threshold indicates a minimum number of disks required for creating a storage resource pool.
  • the storage processor 320 may create another storage resource pool in the storage system using the first number of disks in response to the first number exceeding the predetermined threshold.
  • the storage processor 320 determines a second number of disks to be added to the storage resource pool in the first phase.
  • the storage processor 320 determines first information on a first disk array group to be created with the second number of disks in the first phase.
  • the storage processor 320 adds the second number of disks to the storage resource pool in the first phase by creating the first disk array group in the storage resource pool based on the first information.
  • the plurality of phases further include a second phase.
  • the storage processor 320 may determine a third number of disks to be added to the storage resource pool in the second phase.
  • the storage processor 320 may determine, based on the third number, second information on a second disk array group to be created in the storage resource pool in the second phase.
  • the storage processor 320 may add the third number of disks to the storage resource pool in the second phase by creating the second disk array group in the storage resource pool based on the second information.
  • the third number exceeds the second number. In some embodiments, the second number is one.
  • the solution for managing a storage system enables a multi-phase extension with respect to the storage resource pool.
  • the solution permits to firstly add a portion (e.g., only one) of the disks to the storage resource pool, and then add remaining disks to the storage resource pool.
  • a portion of the newly-added capacity of the extended storage resource pool will be available to the user as quickly as possible.
  • the solution permits the user to decide a respective number of disks to be added in each of the multiple phases, so that the user can balance between the time to obtain the newly-added capacity and the available size of the newly-added capacity to be obtained.
  • one or more of the above-described acts of the method 600 may be performed by the storage system while the storage system responds to host input/output (I/O) requests on behalf of one or more host computers. In some arrangements, all of the acts of the method 600 occur while processing circuitry of the storage system performs data storage operations on the RAID in response to host I/O requests from a set of host computers.
  • I/O host input/output
  • FIG. 7 illustrates a block diagram of an example device 700 adapted to implement embodiments of the present disclosure.
  • the storage processor 320 as shown in FIG. 3 may be implemented by the device 700 .
  • the device 700 includes a central process unit (CPU) 701 , which can execute various suitable actions and processing based on the computer program instructions stored in the read-only memory (ROM) 702 or computer program instructions loaded in the random-access memory (RAM) 703 from a storage unit 708 .
  • the RAM 703 can also store all kinds of programs and data required by the operation of the device 700 .
  • CPU 701 , ROM 702 and RAM 703 are connected to each other via a bus 704 .
  • the input/output (I/O) interface 705 is also connected to the bus 704 .
  • a plurality of components in the device 700 is connected to the I/O interface 705 , including: an input unit 706 , such as keyboard, mouse and the like; an output unit 707 , e.g., various kinds of display and loudspeakers etc.; a storage unit 708 , such as disk and optical disk etc.; and a communication unit 709 , such as network card, modem, wireless transceiver and the like.
  • the communication unit 709 allows the device 700 to exchange information/data with other devices via the computer network, such as Internet, and/or various telecommunication networks.
  • each procedure and processing can also be executed by the processing unit 701 .
  • the method 500 and/or 600 can be implemented as a computer software program tangibly included in the machine-readable medium, e.g., storage unit 708 .
  • the computer program can be partially or fully loaded and/or mounted to the device 700 via ROM 702 and/or communication unit 709 .
  • the computer program is loaded to RAM 703 and executed by the CPU 701 , one or more actions of the above described method 500 and/or 600 can be implemented.
  • the present disclosure can be method, apparatus, system and/or computer program product.
  • the computer program product can include a computer-readable storage medium, on which the computer-readable program instructions for executing various aspects of the present disclosure are loaded.
  • the computer-readable storage medium can be a tangible apparatus that maintains and stores instructions utilized by the instruction executing apparatuses.
  • the computer-readable storage medium can be, but not limited to, such as electrical storage device, magnetic storage device, optical storage device, electromagnetic storage device, semiconductor storage device or any appropriate combinations of the above.
  • the computer-readable storage medium includes: portable computer disk, hard disk, random-access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash), static random-access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, mechanical coding devices, punched card stored with instructions thereon, or a projection in a slot, and any appropriate combinations of the above.
  • the computer-readable storage medium utilized here is not interpreted as transient signals per se, such as radio waves or freely propagated electromagnetic waves, electromagnetic waves propagated via waveguide or other transmission media (such as optical pulses via fiber-optic cables), or electric signals propagated via electric wires.
  • the described computer-readable program instruction can be downloaded from the computer-readable storage medium to each computing/processing device, or to an external computer or external storage via Internet, local area network, wide area network and/or wireless network.
  • the network can include copper-transmitted cable, optical fiber transmission, wireless transmission, router, firewall, switch, network gate computer and/or edge server.
  • the network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium of each computing/processing device.
  • the computer program instructions for executing operations of the present disclosure can be assembly instructions, instructions of instruction set architecture (ISA), machine instructions, machine-related instructions, microcodes, firmware instructions, state setting data, or source codes or target codes written in any combinations of one or more programming languages, wherein the programming languages consist of object-oriented programming languages, e.g., Smalltalk, C++ and so on, and traditional procedural programming languages, such as “C” language or similar programming languages.
  • the computer-readable program instructions can be implemented fully on the user computer, partially on the user computer, as an independent software package, partially on the user computer and partially on the remote computer, or completely on the remote computer or server.
  • the remote computer can be connected to the user computer via any type of networks, including local area network (LAN) and wide area network (WAN), or to the external computer (e.g., connected via Internet using the Internet service provider).
  • state information of the computer-readable program instructions is used to customize an electronic circuit, e.g., programmable logic circuit, field programmable gate array (FPGA) or programmable logic array (PLA).
  • the electronic circuit can execute computer-readable program instructions to implement various aspects of the present disclosure.
  • the computer-readable program instructions can be provided to the processor of general-purpose computer, dedicated computer or other programmable data processing apparatuses to manufacture a machine, such that the instructions that, when executed by the processing unit of the computer or other programmable data processing apparatuses, generate an apparatus for implementing functions/actions stipulated in one or more blocks in the flow chart and/or block diagram.
  • the computer-readable program instructions can also be stored in the computer-readable storage medium and cause the computer, programmable data processing apparatus and/or other devices to work in a particular manner, such that the computer-readable medium stored with instructions contains an article of manufacture, including instructions for implementing various aspects of the functions/actions stipulated in one or more blocks of the flow chart and/or block diagram.
  • the computer-readable program instructions can also be loaded into computer, other programmable data processing apparatuses or other devices, so as to execute a series of operation steps on the computer, other programmable data processing apparatuses or other devices to generate a computer-implemented procedure. Therefore, the instructions executed on the computer, other programmable data processing apparatuses or other devices implement functions/actions stipulated in one or more blocks of the flow chart and/or block diagram.
  • each block in the flow chart or block diagram can represent a module, a part of program segment or code, wherein the module and the part of program segment or code include one or more executable instructions for performing stipulated logic functions.
  • the functions indicated in the block can also take place in an order different from the one indicated in the drawings. For example, two successive blocks can be in fact executed in parallel or sometimes in a reverse order dependent on the involved functions.
  • each block in the block diagram and/or flow chart and combinations of the blocks in the block diagram and/or flow chart can be implemented by a hardware-based system exclusive for executing stipulated functions or actions, or by a combination of dedicated hardware and computer instructions.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
US16/504,624 2018-07-20 2019-07-08 Method, apparatus and computer program product for managing storage system Active 2039-07-15 US11068176B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810804196.8 2018-07-20
CN201810804196.8A CN110737402B (zh) 2018-07-20 2018-07-20 管理存储系统的方法、设备和计算机存储介质

Publications (2)

Publication Number Publication Date
US20200026445A1 US20200026445A1 (en) 2020-01-23
US11068176B2 true US11068176B2 (en) 2021-07-20

Family

ID=69162971

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/504,624 Active 2039-07-15 US11068176B2 (en) 2018-07-20 2019-07-08 Method, apparatus and computer program product for managing storage system

Country Status (2)

Country Link
US (1) US11068176B2 (zh)
CN (1) CN110737402B (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11748040B2 (en) 2021-07-19 2023-09-05 EMC IP Holding Company LLC Extending a storage system by utilizing stripes of different widths associated with respective storage array standards

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11231859B2 (en) * 2019-10-29 2022-01-25 EMC IP Holding Company LLC Providing a RAID resiliency set from a plurality of storage devices
CN113590018A (zh) * 2020-04-30 2021-11-02 伊姆西Ip控股有限责任公司 用于存储管理的方法、电子设备和计算机程序产品
CN112994949A (zh) * 2021-04-02 2021-06-18 软通动力信息技术(集团)股份有限公司 一种专网连接方法、装置、设备及存储介质

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070118689A1 (en) * 2005-11-23 2007-05-24 Hyde Joseph S Ii Rebalancing of striped disk data
US20110296103A1 (en) * 2010-05-31 2011-12-01 Fujitsu Limited Storage apparatus, apparatus control method, and recording medium for storage apparatus control program
US8132073B1 (en) 2009-06-30 2012-03-06 Emc Corporation Distributed storage system with enhanced security
US20130254480A1 (en) * 2012-03-22 2013-09-26 Synology Incorporated Storage system and operation method of a storage system
US20140244927A1 (en) * 2013-02-24 2014-08-28 Alexander Goldberg Storage system and a method for allocating disk drives to redundancy array of independent disks
US9489150B2 (en) * 2003-08-14 2016-11-08 Dell International L.L.C. System and method for transferring data between different raid data storage types for current data and replay data
US20170277631A1 (en) * 2014-09-22 2017-09-28 Hitachi, Ltd. Storage device, semiconductor memory device, and method for controlling same
US10430279B1 (en) * 2017-02-27 2019-10-01 Tintri By Ddn, Inc. Dynamic raid expansion
US10642520B1 (en) 2017-04-18 2020-05-05 EMC IP Holding Company LLC Memory optimized data shuffle
US10747617B2 (en) 2018-04-28 2020-08-18 EMC IP Holding Company LLC Method, apparatus and computer program product for managing storage system
US10782894B1 (en) 2017-07-31 2020-09-22 EMC IP Holding Company, LLC Reducing overlap through shuffle and keeping relationship balance on mapped RAID system and method
US10852966B1 (en) 2017-10-18 2020-12-01 EMC IP Holding Company, LLC System and method for creating mapped RAID group during expansion of extent pool

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8656131B2 (en) * 2008-10-31 2014-02-18 Dot Hill Systems Corporation Method and apparatus for expanding a virtual storage device
CN103365781B (zh) * 2012-03-29 2016-05-04 国际商业机器公司 用于动态地重新配置存储系统的方法和设备
CN105701029B (zh) * 2014-11-25 2018-11-06 华为技术有限公司 一种异构存储优化方法及装置
US9645745B2 (en) * 2015-02-27 2017-05-09 International Business Machines Corporation I/O performance in resilient arrays of computer storage devices
US10509578B2 (en) * 2016-04-14 2019-12-17 Red Hat, Inc. Logical address space for storage resource pools
CN107870730B (zh) * 2016-09-23 2020-11-20 伊姆西Ip控股有限责任公司 用于管理存储系统的方法和系统

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9489150B2 (en) * 2003-08-14 2016-11-08 Dell International L.L.C. System and method for transferring data between different raid data storage types for current data and replay data
US20070118689A1 (en) * 2005-11-23 2007-05-24 Hyde Joseph S Ii Rebalancing of striped disk data
US8132073B1 (en) 2009-06-30 2012-03-06 Emc Corporation Distributed storage system with enhanced security
US20110296103A1 (en) * 2010-05-31 2011-12-01 Fujitsu Limited Storage apparatus, apparatus control method, and recording medium for storage apparatus control program
US20130254480A1 (en) * 2012-03-22 2013-09-26 Synology Incorporated Storage system and operation method of a storage system
US20140244927A1 (en) * 2013-02-24 2014-08-28 Alexander Goldberg Storage system and a method for allocating disk drives to redundancy array of independent disks
US20170277631A1 (en) * 2014-09-22 2017-09-28 Hitachi, Ltd. Storage device, semiconductor memory device, and method for controlling same
US10430279B1 (en) * 2017-02-27 2019-10-01 Tintri By Ddn, Inc. Dynamic raid expansion
US10642520B1 (en) 2017-04-18 2020-05-05 EMC IP Holding Company LLC Memory optimized data shuffle
US10782894B1 (en) 2017-07-31 2020-09-22 EMC IP Holding Company, LLC Reducing overlap through shuffle and keeping relationship balance on mapped RAID system and method
US10852966B1 (en) 2017-10-18 2020-12-01 EMC IP Holding Company, LLC System and method for creating mapped RAID group during expansion of extent pool
US10747617B2 (en) 2018-04-28 2020-08-18 EMC IP Holding Company LLC Method, apparatus and computer program product for managing storage system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11748040B2 (en) 2021-07-19 2023-09-05 EMC IP Holding Company LLC Extending a storage system by utilizing stripes of different widths associated with respective storage array standards

Also Published As

Publication number Publication date
CN110737402B (zh) 2023-12-08
CN110737402A (zh) 2020-01-31
US20200026445A1 (en) 2020-01-23

Similar Documents

Publication Publication Date Title
US11068176B2 (en) Method, apparatus and computer program product for managing storage system
US10726518B2 (en) Capacity reservation for virtualized graphics processing
US11048416B2 (en) Method, apparatus and computer program product for managing storage system
US11340803B2 (en) Method for configuring resources, electronic device and computer program product
US11341049B2 (en) Method, apparatus, and computer program product for managing storage system
US11232005B2 (en) Method, device, and computer program product for managing storage system
US11269770B2 (en) Method, apparatus, and computer program product for managing storage space provided across multiple storage systems
US11003374B2 (en) Methods, devices and computer program products for managing a redundant array of independent disks
US10929230B2 (en) Method, apparatus and computer program product for managing storage system
US11379138B2 (en) Method, device, and computer program product for managing access request in storage system
EP2808778A1 (en) Capacity expansion method and device
US11099761B2 (en) Method, device and computer program product for expanding storage space
US11188247B2 (en) Method, device, and computer program product for managing storage system
US10788997B2 (en) Method and device for storage management with metadata stored in disk extents in an extent pool
US11119703B2 (en) Utilizing a set of virtual storage units distributed across physical storage units
US11500726B2 (en) Method, device, and program product for selecting rebuild destination in storage system
US11119705B2 (en) Method, device, and computer readable storage medium for managing redundant array of independent disks
US10922001B2 (en) Vector-based storage management
CN112748862A (zh) 用于管理盘的方法、电子设备和计算机程序产品
US11836353B2 (en) Method, device, and computer program product for rebuilding storage system
US11442633B2 (en) Method, electronic device and computer program product for storage management
US11907552B2 (en) Method, electronic device and computer program product for extending storage system
US11513681B2 (en) Method, device, and computer program product for managing storage system
US11748040B2 (en) Extending a storage system by utilizing stripes of different widths associated with respective storage array standards
US20210286680A1 (en) Method, electronic device and computer program product for storage management

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: EMC IP HOLDING COMPANY LLC, MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WANG, SHENG;GAO, JIAN;NI, SHUAI;AND OTHERS;REEL/FRAME:050001/0352

Effective date: 20190618

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

AS Assignment

Owner name: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, NORTH CAROLINA

Free format text: SECURITY AGREEMENT;ASSIGNORS:DELL PRODUCTS L.P.;EMC CORPORATION;EMC IP HOLDING COMPANY LLC;REEL/FRAME:050406/0421

Effective date: 20190917

AS Assignment

Owner name: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT, TEXAS

Free format text: PATENT SECURITY AGREEMENT (NOTES);ASSIGNORS:DELL PRODUCTS L.P.;EMC CORPORATION;EMC IP HOLDING COMPANY LLC;REEL/FRAME:050724/0571

Effective date: 20191010

AS Assignment

Owner name: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., TEXAS

Free format text: SECURITY AGREEMENT;ASSIGNORS:CREDANT TECHNOLOGIES INC.;DELL INTERNATIONAL L.L.C.;DELL MARKETING L.P.;AND OTHERS;REEL/FRAME:053546/0001

Effective date: 20200409

AS Assignment

Owner name: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT, TEXAS

Free format text: SECURITY INTEREST;ASSIGNORS:DELL PRODUCTS L.P.;EMC CORPORATION;EMC IP HOLDING COMPANY LLC;REEL/FRAME:053311/0169

Effective date: 20200603

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: EMC IP HOLDING COMPANY LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST AT REEL 050406 FRAME 421;ASSIGNOR:CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH;REEL/FRAME:058213/0825

Effective date: 20211101

Owner name: EMC CORPORATION, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST AT REEL 050406 FRAME 421;ASSIGNOR:CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH;REEL/FRAME:058213/0825

Effective date: 20211101

Owner name: DELL PRODUCTS L.P., TEXAS

Free format text: RELEASE OF SECURITY INTEREST AT REEL 050406 FRAME 421;ASSIGNOR:CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH;REEL/FRAME:058213/0825

Effective date: 20211101

AS Assignment

Owner name: EMC IP HOLDING COMPANY LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (050724/0571);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:060436/0088

Effective date: 20220329

Owner name: EMC CORPORATION, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (050724/0571);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:060436/0088

Effective date: 20220329

Owner name: DELL PRODUCTS L.P., TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (050724/0571);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:060436/0088

Effective date: 20220329

Owner name: EMC IP HOLDING COMPANY LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:060438/0742

Effective date: 20220329

Owner name: EMC CORPORATION, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:060438/0742

Effective date: 20220329

Owner name: DELL PRODUCTS L.P., TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169);ASSIGNOR:THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT;REEL/FRAME:060438/0742

Effective date: 20220329