CN106933496B - Manage the method and device of RAID - Google Patents

Manage the method and device of RAID Download PDF

Info

Publication number
CN106933496B
CN106933496B CN201511027145.1A CN201511027145A CN106933496B CN 106933496 B CN106933496 B CN 106933496B CN 201511027145 A CN201511027145 A CN 201511027145A CN 106933496 B CN106933496 B CN 106933496B
Authority
CN
China
Prior art keywords
hard disk
raid
groups
disk groups
type parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201511027145.1A
Other languages
Chinese (zh)
Other versions
CN106933496A (en
Inventor
肖祖仁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201511027145.1A priority Critical patent/CN106933496B/en
Publication of CN106933496A publication Critical patent/CN106933496A/en
Application granted granted Critical
Publication of CN106933496B publication Critical patent/CN106933496B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608Saving storage space on storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0683Plurality of storage devices
    • G06F3/0689Disk arrays, e.g. RAID, JBOD

Abstract

The invention discloses a kind of methods for managing RAID, belong to storage control field.The method is applied in the storage system for including at least two hard disk groups and controller, hard disk included by each hard disk groups is having the same, is used to indicate the volume type parameter of capacity, this method comprises: receiving the RAID including the greatest member's disk number needed of the RAID at least two hard disk groups manages instruction;When the quantity of the hard disk included by the first hard disk groups is unsatisfactory for greatest member's disk number, the determining volume type parameter with immediate second hard disk groups of volume type parameter of first hard disk groups;The volume type parameter of first hard disk groups is revised as to the volume type parameter of second hard disk groups;RAID management is carried out according to modified volume type parameter, does not need to modify the capacity of each larger capacity hard disk according to hard-disk capacity the smallest in storage system, to achieve the effect that reduce waste of capacity.

Description

Manage the method and device of RAID
Technical field
The present embodiments relate to storage control field, in particular to a kind of method and device for managing RAID.
Background technique
Raid-array (English: Redundant Arrays of Independent Disks, abbreviation: RAID) be it is a kind of the independent hard disk of muti-piece is differently combined to form into a logic hard disk, to provide than single The technology of the higher storage performance of hard disk.
In current RAID storage system, deposited for the ease of capacity management when the muti-piece hard disk comprising different capabilities The capacity of each larger capacity hard disk is revised as the corresponding capacity of minimum capacity hard disk in the storage system first by storage system, When calculating storage system capacity, for each piece of hard disk, total active volume is calculated according to modified capacity.
During realizing the embodiment of the present invention, the inventor finds that the existing technology has at least the following problems:
The capacity of each larger capacity hard disk is repaired according to hard-disk capacity the smallest in storage system in the prior art The hard-disk capacity of the processing mode waste changed is more, causes the volume space utilization rate of storage system lower.
Summary of the invention
In order to solve in the prior art to hold the capacity of each larger capacity hard disk according to hard disk the smallest in storage system The hard-disk capacity for measuring the processing mode waste modified is more, causes the volume space utilization rate of storage system is lower to ask Topic, the embodiment of the invention provides a kind of method and devices for managing RAID.The technical solution is as follows:
In a first aspect, this method is applied within the storage system the embodiment of the invention provides a kind of method for managing RAID, The storage system includes at least two hard disk groups and controller, hard disk appearance having the same included by each hard disk groups Type parameter is measured, the volume type parameter is used to indicate the capacity of the hard disk;The method is executed by controller, comprising: RAID management instruction is received, the management instruction includes greatest member's disk that the RAID at least two hard disk groups needs Number;Judge whether the quantity for the hard disk that each hard disk groups are included meets greatest member's disk number;When the first hard disk groups When the quantity of included hard disk is unsatisfactory for greatest member's disk number, the determining volume type parameter with first hard disk groups The volume type parameter of the volume type parameter of immediate second hard disk groups, second hard disk groups is less than first hard disk The volume type parameter of group;The volume type parameter of first hard disk groups is revised as to the volume type of second hard disk groups Parameter;According to the modified volume type parameter, RAID management, the RAID are carried out at least two hard disk groups Management includes: to create RAID, delete the hard disk areas of RAID or creation comprising at least two hard disk groups.
The method of management RAID provided in an embodiment of the present invention, the quantity of the hard disk included by the first hard disk groups are unsatisfactory for When greatest member's disk number that RAID at least two hard disk groups needs, by the volume type parameter of the first hard disk groups be revised as with The volume type parameter of immediate second hard disk groups of the volume type parameter of first hard disk groups, the capacity class of second hard disk groups Volume type parameter of the shape parameter less than the first hard disk groups;And according to the modified volume type parameter, it is described at least RAID management is carried out in two hard disk groups, when the capacity to each larger capacity hard disk is modified, as long as making storage system In the hard disk number of each hard disk groups meet greatest member's disk number required for the RAID in storage system, do not need by The capacity of each larger capacity hard disk is modified according to hard-disk capacity the smallest in storage system, reduces capacity wave to reach The effect taken.
With reference to first aspect, in the first implementation of first aspect, when RAID management instruction is used to indicate When creating RAID, greatest member's disk number that the RAID at least two hard disk groups needs are as follows: RAID to be created includes Member disk number;Alternatively, member disk number and the larger value of preset disk number threshold value between the two that RAID to be created includes.It is creating When building RAID, dynamic adjustment is carried out according to capacity of the member disk number of RAID to be created to each hard disk groups, avoids capacity unrestrained Take.
With reference to first aspect, in second of implementation of first aspect, when RAID management instruction is used to indicate When deleting RAID, greatest member's disk number of the RAID needs at least two hard disk groups are as follows: delete RAID to be deleted Afterwards, at least two hard disk groups corresponding member disk number of remaining RAID maximum value;Alternatively, RAID to be deleted is deleted After removing, both the maximum value and preset disk number threshold value of the corresponding member disk number of remaining RAID at least two hard disk groups Between the larger value.When deleting RAID, according to the maximum value of the member disk number of remaining RAID to the capacity of each hard disk groups Dynamic adjustment is carried out, waste of capacity is avoided.
With reference to first aspect, in the third implementation of first aspect, when RAID management instruction is used to indicate When creation includes the hard disk areas of at least two hard disk groups, the most great achievement of the RAID needs at least two hard disk groups Member's disk number is preset disk number threshold value.At the beginning of hard disk areas is established, by pre-set disk number threshold value to each hard disk groups Capacity carry out just successive step so that create member disk number be less than the pre-set disk number threshold value RAID when, do not need It modifies to the capacity of each hard disk groups, reduces the number of capacity modification, reduce system complexity.
Any one implementation with reference to first aspect or in the first to three kind of implementation of first aspect, In 4th kind of implementation of first aspect, whether meet the maximum in the quantity for judging hard disk that each hard disk groups are included Before member disk number, further includes: whether the group number m of detection at least two hard disk groups is greater than preset group of number threshold value n, m and n For positive integer;When m is greater than n, determine at least two hard disk groups, the big third hard disk groups of volume type parameter n-th;It will In at least two hard disk groups, the volume type parameter of the maximum m-n hard disk groups of volume type parameter is revised as described The capacity parameter of three hard disk groups.The maximum hard disk groups number supported is set for storage system, simplifies computational complexity.
Second aspect, the embodiment of the invention provides a kind of controller, the controller includes at least one unit, this is extremely A few unit manages for realizing provided by any one possible implementation in above-mentioned first aspect or first aspect The method of RAID.
The third aspect, the embodiment of the invention provides a kind of storage systems, and the system comprises for realizing above-mentioned first The controller of the method for management RAID provided by the possible implementation of any one in aspect or first aspect.
Fourth aspect, the embodiment of the invention also provides a kind of computer-readable medium, the computer-readable medium storages Have for realizing the method for managing RAID provided by the possible implementation of any one in first aspect or first aspect Instruction.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.
Figure 1A is the hardware architecture diagram of storage system shown by an illustrative examples of the invention;
Figure 1B is a kind of hard drive space structure chart that illustrative examples shown in figure 1A are related to;
Fig. 1 C is a kind of composition figure for domain space distribution management program that illustrative examples shown in figure 1A are related to;
Fig. 2 is the flow chart of the method for the management RAID that one illustrative examples of the present invention provide;
Fig. 3 A is the flow chart for the volume type parameter amending method that an illustrative examples of the invention provide;
Fig. 3 B is the volume type parameter modification schematic diagram that illustrative examples shown in Fig. 3 A are related to;
Fig. 4 is the block diagram of the device of management RAID provided by one embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention Formula is described in further detail.
Figure 1A is please referred to, it illustrates the hardware structures of storage system shown by an illustrative examples of the invention Figure.The hardware structure includes following hardware device: redundant array of inexpensive disks 1 10, host 120 and connecting the redundant array of inexpensive disks 1 10 and host 120 controller 130.
It include several hard disks 112 in redundant array of inexpensive disks 1 10.Several hard disks 112 divide at least two hard disk groups, often The volume type parameter having the same of hard disk included by a hard disk groups, the volume type parameter are used to indicate the capacity of hard disk.
Figure 1B is please referred to, it illustrates a kind of hard drive space structure chart that illustrative examples shown in figure 1A are related to, magnetic The volume space of each hard disk in disk array 110 and can be divided into Database Managed Space (English according to the type of storage data Text: Date Base space, abbreviation: DB space), metadata space (English: META space) space, business datum it is empty Between (English: DATA space) space and write hole space (English: Write Hole).Wherein, DB space is for storing Class data are configured, which is not that all hard disks are owned by hard disk areas, in a usually storage engines before the 1st frame 4 pieces of hard disks just have this space;META space is used to store business datum for storing metadata, DATA space, Write Hole is used to store the slitting related data of not complete lower wall.In embodiments of the present invention, form total hard disk areas with And the hard drive space of each sub- hard disk areas refers to META space and the DATA space in each hard disk, in the present invention after Continuous modify to the capacity of hard disk just refers to that the capacity to the two spaces in hard disk is modified.
Host 120 is the user management device being connected with controller 130, for example, can be a PC.User Various management instructions are issued to controller 130 by host 120, for example, creation hard disk areas, creation hard disk groups, deletion hard disk Group and capacity query etc., the management instruction that controller 130 is issued according to host carry out corresponding management operation.
As shown in 1A, which includes processing unit 132 and interface unit 134.Wherein, interface unit 132 can be with Including multiple interfaces, a portion interface with host 120 for being communicated, and another part interface is for connecting disk array 110。
Processing unit 132 includes arithmetic and logic unit, register block and control unit etc., be can be in independent Central processor, or it is also possible to embeded processor, such as microprocessor (English: Micro Processor Unit, contracting Write: MPU), microcontroller (English: Microcontroller Unit, abbreviation: MCU) or digital signal processor (English: Embedded Digital Signal Processor, abbreviation: EDSP) etc..
Optionally, controller 130 further includes the components such as memory 136, Cache 138, bus 1310.Wherein: depositing Reservoir 136 is connected by bus 1310 with processing unit 132 respectively with Cache 138.Cache 138 is for caching The some intermediate data in data and calculating process read and write with redundant array of inexpensive disks 1 10.
Memory 136 is realized by any kind of volatibility or non-volatile memory device or their combination, such as quiet State random access memory (English: Static Random Access Memory, referred to as: SRAM), electrically erasable is only Reading memory (English: Electrically Erasable Programmable Read-Only Memory, referred to as: EEPROM), Erasable Programmable Read Only Memory EPROM (English: Erasable Programmable Read Only Memory, letter Claim: EPROM), programmable read only memory (English: Programmable Read-Only Memory, referred to as: PROM), it is read-only Memory (English: Read Only Memory, abbreviation: ROM), magnetic memory, flash memory, disk or CD.Memory 136 can be used for storing software program and module.
As shown in 1A, memory 136 can application program module needed for storage program area 1362, at least one function 1364.Operating system 1362 can be real time operating system (Real Time eXecutive, RTX), LINUX, UNIX, The operating system of WINDOWS or OS X etc.Application program module 1364 may include system control module 1364a, volume business Management module 1364b, caching accelerating module 1364c, disk explain management module 1364d and domain space allocation managing module 1364e.Processing unit 132 can execute system control module 1364a, to realize that user command parses, order issues, Yong Hupei It sets, the control of Object Management group, system flow, information feedback, event notifies and the functions such as alarm is sent;Alternatively, processing unit 132 Volume service management module 1364b can be executed, to realize that creation, deletion, inquiry and the logic of user volume are rolled onto physical store The functions such as mapping;Alternatively, processing unit 132 can execute caching accelerating module 1364c, to realize business datum and metadata Caching and read-write accelerate etc. functions;Alternatively, processing unit 132, which can execute disk, explains management module 1364d, to realize The functions such as disk identification, positioning, read-write and disk management;Alternatively, domain space distribution management can also be performed in processing unit 132 Module 1364e, with realization, the layout of metadata, space distribution, space reclamation, space management, calculation of capacity, capacity is synchronous, holds Amount refreshes and the functions such as space maintenance.
In this illustrative examples, storage system supports that creation contains at least two the hard disk areas of hard disk groups, and with The hard disk areas is whole, creation or deletion RAID at least two hard disk groups that the hard disk areas includes.
In this illustrative examples, the capacity of part larger capacity hard disk can be revised as time great Rong by storage system Amount, to achieve the effect that reduce waste of capacity.Fig. 1 C is please referred to, it illustrates one that illustrative examples shown in figure 1A are related to The composition figure of kind of domain space distribution management program, in the scheme shown in this illustrative examples, domain space allocation managing module 1364e may include: command reception module 1364e1, judgment module 1364e2, parameter determination module 1364e3, parameter modification mould Block 1364e4 and management module 1364e5.
Command reception module 1364e1, for receiving RAID management instruction, the management instruction includes described at least two Greatest member's disk number that RAID in hard disk groups needs.
Judgment module 1364e2, for judge the quantity of hard disk that each hard disk groups are included whether meet it is described most Major member's disk number.
Parameter determination module 1364e3, the quantity for working as hard disk included by the first hard disk groups are unsatisfactory for the most great achievement When member's disk number, the determining volume type parameter with immediate second hard disk groups of volume type parameter of first hard disk groups, The volume type parameter of second hard disk groups is less than the volume type parameter of first hard disk groups.
Parameter adapting module 1364e4 is hard for the volume type parameter of first hard disk groups to be revised as described second The volume type parameter of disk group.
Management module 1364e5 is used for according to the modified volume type parameter, at least two hard disk groups Middle progress RAID management, the RAID management include: creation RAID, delete RAID or create comprising at least two hard disk The hard disk areas of group.
Optionally, domain space allocation managing module 1364e can also include: that detection module 1364e6 and hard disk groups determine Module 1364e7.
Detection module 1364e6, for judge in the judging unit hard disk that each hard disk groups are included quantity whether Before meeting greatest member's disk number, whether the group number m for detecting at least two hard disk groups is greater than preset group of number threshold value N, m and n are positive integer;
Hard disk groups determining module 1364e7, for determining at least two hard disk groups, volume type when m is greater than n The big third hard disk groups of parameter n-th;
The parameter adapting module 1364e4 is also used at least two hard disk groups, and volume type parameter is maximum The volume type parameters of m-n hard disk groups be revised as the capacity parameters of the third hard disk groups.
Referring to FIG. 2, the flow chart of the method for managing RAID provided it illustrates one illustrative examples of the present invention. The method of management RAID can be used in storage system shown in figure 1A, be executed by controller 130.The side of management RAID Method may include:
Step 201, RAID management instruction is received, management instruction includes that the RAID at least two hard disk groups needs Greatest member's disk number.
Wherein, RAID management instruction can be the instruction that user is issued by host, for example, interaction of the user in host RAID management (creation RAID, the hard disk areas of deletion RAID or creation comprising at least two hard disk groups etc.) is carried out in interface When operation, host issues RAID management instruction to controller.Alternatively, RAID management instruction is also possible to controller and detects There is the instruction automatically generated when relevant management operation.
Wherein, management instruction includes that greatest member's disk number that the RAID at least two hard disk groups needs can have Following several situations:
1) when RAID management instruction, which is used to indicate creation, includes the hard disk areas of at least two hard disk groups, this is at least Greatest member's disk number that RAID in two hard disk groups needs is preset disk number threshold value.
2) when RAID management instruction is used to indicate creation RAID, the RAID at least two hard disk groups needs most Major member's disk number are as follows: the member disk number that RAID to be created includes;Alternatively, the RAID to be created member disk number that includes and default Disk number threshold value the larger value between the two.
In the present example embodiment, a RAID in storage system is by several disk set of blocks (English: Chunk Group, abbreviation: CKG) composition, each CKG includes n disk block, and the n disk block belongs to n hard disk, and n is exactly this The member disk number of RAID.Storage system for RAID distribute a disk set of blocks when, by certain stochastic selection algorithm with Machine selects n hard disk, and takes a disk block respectively from n hard disk being randomly selected to form disk set of blocks.And it stores When system randomly chooses n hard disk by stochastic selection algorithm, the identical hard disk of residual capacity, selected probability is also identical, When containing at least two the hard disk groups of corresponding different volume type parameter in storage system, if not in each hard disk groups Hard disk does any processing, when directly establishing RAID according to the method described above, it may appear that following situations: the hard disk in each hard disk groups Respective remaining capacity is approximately equal, and respectively remaining capacity is then different for the hard disk in different hard disk groups, when there is part hard disk The capacity of hard disk is fully assigned away in group, and the total quantity of each hard disk is less than n in other hard disk groups for having residual capacity When, storage system will show the hard disk groups, and there are also part active volumes, if user issues newly according to the active volume at this time The instruction of storage pool is built, and it is n that the storage pool, which corresponds to the member disk number of RAID, then storage system will be unable to complete the storage pool It establishes, storage system is caused to malfunction.As long as analyzing the above problem it can easily be seen that making the quantity of the hard disk in each hard disk groups The maximum value of member disk number not less than the RAID created within the storage system, it can avoid the above problem.Therefore, originally showing In example property embodiment, when RAID manages instruction instruction one RAID of creation, RAID can be managed in instruction includes that this is extremely Greatest member's disk number that RAID in few two hard disk groups needs is set as the member disk number that RAID to be created includes, in this way, When there is a new RAID to need to create, it is only necessary to so that the hard disk quantity of each hard disk groups be not less than it is to be created The hard disk number of RAID, it can guarantee that the RAID can be successfully established.
In the present example embodiment, storage system creates the hard disk areas comprising at least two hard disk groups first, so It is afterwards whole, creation or deletion RAID in the hard disk areas with the hard disk areas.In practical applications, in hard disk areas In each RAID established, the member disk number of most RAID is all concentrated in some section, only least a portion of RAID's Member disk number exceeds the section, therefore, in order to avoid the capacity of the hard disk in subsequent frequent modification hard disk groups, builds in hard disk areas At the beginning of vertical, just successive step can be carried out by capacity of the pre-set disk number threshold value to each hard disk groups so that creation at It when member's disk number is less than the RAID of the pre-set disk number threshold value, does not need to modify to the capacity of each hard disk groups, reduce The number of capacity modification, reduces system operations complexity.Wherein, the disk number threshold value can according to most of RAID of prediction at Section locating for member's disk number is arranged.For example, current RAID points are typical case RAID and atypia RAID, wherein typical RAID Greatest member's disk number of support is 10, and greatest member's disk number that atypia RAID is supported can be much larger than 10, and user is in storage The RAID established in system is mostly typical RAID, is only partially atypia RAID, therefore, can be by the pre-set disk Number threshold value is set as 10.Correspondingly, RAID can be managed in instruction and be wrapped when RAID manages instruction instruction one RAID of creation Contain, greatest member's disk number that the RAID at least two hard disk groups needs is set as the member disk that RAID to be created includes The several and the larger value of preset disk number threshold value between the two.
3) when RAID management instruction, which is used to indicate, deletes RAID, the RAID at least two hard disk groups needs most Major member's disk number are as follows: after RAID to be deleted is deleted, the corresponding member disk number of remaining RAID at least two hard disk groups Maximum value;Alternatively, after RAID to be deleted is deleted, the corresponding member disk number of remaining RAID at least two hard disk groups Maximum value and the larger value of preset disk number threshold value between the two.
When deleting a RAID within the storage system, and the RAID is the RAID that member disk number is most in storage system When, in order to reduce waste of capacity, the capacity of the hard disk at least two hard disk groups of storage system can be readjusted, It therefore, in the present example embodiment, can be at least two hard by this when RAID management instruction, which is used to indicate, deletes RAID Greatest member's disk number that RAID in disk group needs is set as deleting the maximum of the corresponding member disk number of remaining RAID after RAID Value, alternatively, the problem of considering above-mentioned pre-set disk number threshold value, the RAID at least two hard disk groups can also be needed The greatest member's disk number wanted is set as deleting the maximum value of the corresponding member disk number of remaining RAID and preset disk number after RAID The larger value of threshold value between the two.
Wherein, which can be executed instruction by the processing unit 132 of controller 130 in storage system shown in figure 1A and be connect Module 1364e1 is received to realize.
Step 202, judge whether the quantity for the hard disk that each hard disk groups are included meets greatest member's disk number.
Optionally, in the present example embodiment, storage system can be from the maximum hard disk groups of capacity type parameter Start, successively judges whether the quantity for the hard disk that each hard disk groups are included meets greatest member's disk number.
Wherein, which can judge mould by the execution of processing unit 132 of controller 130 in storage system shown in figure 1A Block 1364e2 is realized.
Step 203, it when the quantity of the hard disk included by the first hard disk groups is unsatisfactory for greatest member's disk number, determines and should The volume type parameter of immediate second hard disk groups of the volume type parameter of first hard disk groups, the capacity class of second hard disk groups Shape parameter is less than the volume type parameter of first hard disk groups.
Wherein, which it is true can to execute parameter by the processing unit 132 of controller 130 in storage system shown in figure 1A Cover half block 1364e3 is realized.
Step 204, the volume type parameter of first hard disk groups is revised as to the volume type parameter of second hard disk groups.
If the quantity of hard disk included by the first hard disk groups meets greatest member's disk number, first hard disk groups are kept Volume type parameter constant.
Wherein, which can execute parameter by the processing unit 132 of controller 130 in storage system shown in figure 1A and repair Change module 1364e4 to realize.
Step 205, according to the modified volume type parameter, RAID management is carried out at least two hard disk groups.
Wherein, RAID management includes: to create RAID, delete RAID or create hard comprising at least two hard disk groups Disk area.
In addition, scheme shown in the present exemplary embodiment, is repaired in the volume type parameter at least two hard disk groups When changing, modification waste capacity caused by the modification of volume type parameter can also be counted, and calculation of capacity is wasted according to the modification The active volume of at least two hard disk groups and capacity is used.
Wherein, which can execute management mould by the processing unit 132 of controller 130 in storage system shown in figure 1A Block 1364e5 is realized.
In conclusion method shown in this illustrative examples, the quantity of the hard disk included by the first hard disk groups is discontented When greatest member's disk number that the RAID at least two hard disk groups of foot needs, the volume type parameter of the first hard disk groups is revised as With the volume type parameter of immediate second hard disk groups of volume type parameter of the first hard disk groups, the capacity of second hard disk groups Volume type parameter of the type parameter less than the first hard disk groups;And according to the modified volume type parameter, this at least two RAID management is carried out in a hard disk groups, when the capacity to each larger capacity hard disk is modified, as long as making in storage system The hard disk number of each hard disk groups meets greatest member's disk number required for the RAID in storage system, and not needing will be each The capacity of a larger capacity hard disk is modified according to hard-disk capacity the smallest in storage system, to reach reduction waste of capacity Effect.
The hard disk number for judging each hard disk groups is required whenever establishing or deleting a RAID according to above scheme Amount whether meet demand, if there are many quantity for establishing the hard disk groups of a hard disk areas, every time establish or delete RAID when, The number for being judged and modifying volume type parameter also can be very much, and system operations complexity is also increase accordingly, and are to reduce System computational complexity, in this regard, please referring to Fig. 3 A, the volume type parameter provided it illustrates an illustrative examples of the invention is repaired The flow chart for changing method, before the step 202 that storage system executes in above-mentioned Fig. 2, can also be performed step 211 to step Volume type parameter amending method shown in rapid 213:
Step 211, detect at least two hard disk groups group number m whether be greater than preset group of number threshold value n, m and n be positive it is whole Number.
Wherein, which can execute detection mould by the processing unit 132 of controller 130 in storage system shown in figure 1A Block 1364e6 is realized.
Step 212, it when m is greater than n, determines at least two hard disk groups, the big third hard disk of volume type parameter n-th Group.
Wherein, which can execute hard disk groups by the processing unit 132 of controller 130 in storage system shown in figure 1A Determining module 1364e7 is realized.
Step 213, by least two hard disk groups, the volume type of the maximum m-n hard disk groups of volume type parameter Parameter is revised as the capacity parameter of the third hard disk groups.
In the present exemplary embodiment, one hard disk groups number threshold value n is set for storage system, if the group of at least two hard disk groups Number m is greater than n, then the volume type parameter of the corresponding maximum several hard disk groups of volume type parameter is modified, so that modification The hard disk groups number in storage system is no more than n afterwards, to simplify the computational complexity of storage system.
Specifically for example, in conjunction with the volume type parameter amending method in Fig. 2 and Fig. 3 A corresponding embodiment, it is assumed that the hard disk groups There are 36 pieces of hard disks, be respectively as follows: 10 pieces of 230G hard disks, 6 pieces of 200G hard disks, 11 pieces of 180G hard disks, 4 pieces of 150G hard disks, 3 pieces of 120G are hard Disk and 2 pieces of 100G hard disks, the capacity kind number that hard disk groups maximum is supported are 5.After storage system receives RAID management instruction, obtain It must manage in instruction and include, greatest member's disk number that the RAID at least two hard disk groups needs is 11.Fig. 3 B is please referred to, Show the volume type parameter modification schematic diagram that illustrative examples shown in Fig. 3 A are related to, wherein due in the hard disk groups Hard disk comprising 6 kinds of different capabilities, then according to above scheme, the 5th kind of capacity is later after needing from small to large to arrange capacity The capacity of hard disk is revised as the capacity of the 5th kind of hard disk, i.e., the capacity of the hard disk of 10 pieces of 230G is modified as 200G, at this point, 200G Hard disk become 16 pieces, be not less than 11, then keep the capacity of the hard disk of 200G constant;Continue with a kind of the hard of lower secondary large capacity Disk, i.e. 180G hard disk, wherein 180G hard disk is 11 pieces, is not less than 11, then keeps 180G hard disk constant;Continue with the hard of 150G The capacity of the hard disk of 150G less than 11, is then revised as 120G since the hard disk of 150G is 4 pieces by disk, at this point, 120G hard disk is 7 Block continues the capacity of the hard disk of 7 pieces of 120G being revised as 100G still less than 11, and finally, being equivalent to 100G disk is 9 pieces, this When, the total capacity of the hard disk groups are as follows: 100G*9+180G*11+200G*16=6080G.
Wherein, which can execute parameter by the processing unit 132 of controller 130 in storage system shown in figure 1A and repair Change module 1364e4 to realize.
In conclusion method shown in this illustrative examples, in the number for judging hard disk that each hard disk groups are included Before whether amount meets greatest member's disk number, whether the group number m that storage system can also detect at least two hard disk groups is big In preset group of number threshold value n, m and n be positive integer;When m is greater than n, determine at least two hard disk groups, volume type parameter N-th big third hard disk groups;By at least two hard disk groups, the capacity class of the maximum m-n hard disk groups of volume type parameter Shape parameter is revised as the capacity parameter of the third hard disk groups, the maximum hard disk groups number supported is arranged for storage system, to simplify The computational complexity of storage system.
Optionally, there are also backup requests for the data stored in storage system, that is, need to stay at least two hard disk groups Lower portion capacity is known as hot standby capacity as spare capacity, this incremental backup capacity.In the present invention, hot standby capacity can be according to each The capacity of hard disk in a hard disk groups distributes, that is, corresponds to each hard disk groups, and the k hard drive space distributed in the hard disk groups is made Enough volume spaces can be found to generation when guaranteeing that most k block hard disks break down in the hard disk groups for hot standby space The hard disk of failure carries out data recombination;Wherein, k is properly termed as HotSpare disk number, and k is the integer more than or equal to 1.For example, extremely A hard disk groups in few two hard disk groups include the hard disk of 10 300G capacity, and the numerical value of k is 1, then need from this at least two Hot standby space of the volume space of 1*300G as the data in this 10 300G hard disks, and this 300G are distributed in a hard disk groups Hot standby space be dispersed in as unit of disk block or disk set of blocks at least two hard disk groups.Consider above-mentioned hot standby want It asks, in the present invention, above-mentioned pre-set disk number threshold value is also possible to 10+x, and x is 10 corresponding HotSpare disk numbers;When RAID is managed When reason instruction instruction one RAID of creation, the greatest member's disk number needed of the RAID at least two hard disk groups can be set to The sum of the member disk number that RAID to be created includes HotSpare disk number corresponding with the member disk number that the RAID to be created includes with The larger value between pre-set disk number threshold value;It, can be by this extremely when RAID management instruction, which is used to indicate, deletes RAID Greatest member's disk number that RAID in few two hard disk groups needs is set as deleting the corresponding member disk of remaining RAID after RAID The sum of several maximum values HotSpare disk number corresponding with the maximum value, with the larger value of preset disk number threshold value between the two.
In the following, the present invention will be illustrated by taking a possible specific implementation as an example, which will be comprehensive Close RAID member disk number, HotSpare disk number and the pre-set disk number threshold value considered in hard disk areas.
Table 1 is please referred to, is provided it illustrates one possible implementation of the present invention, the member disk number of certain type RAID With the corresponding table of back-up disk number.
Table 1
In table 1, each RAID member disk number interval corresponds to two different HotSpare disk numbers, and respectively high fever is standby and low-heat Standby, in this illustrative examples, a newly created RAID can independently be selected standby or low-heat is standby using high fever by user. For example, the maximum of typical case RAID supports that member disk number is 10, referring to table 1, which supports the corresponding high HotSpare disk of member disk number Several and low HotSpare disk number be 1 (if the corresponding high HotSpare disk number of maximum support member disk number is different with low HotSpare disk number, It is subject to user setting);When creating an atypia RAID with 36 member disks, if user's selection is standby using high fever When, then the corresponding HotSpare disk number of member disk number 36 is 3, if user's selection is standby using low-heat, member disk number 36 is corresponding hot standby Disk number is then 2.
The RAID that storage system receives creation hard disk areas manages instruction, includes preset disk number in RAID management instruction Threshold value 11 (i.e. typical case RAID support the HotSpare disk number 1 corresponding with greatest member's disk number of greatest member's disk number 10 and).It deposits Storage system combines method shown in above-mentioned Fig. 2 and Fig. 3 A to the capacity of at least two hard disk groups of one hard disk areas of composition first Type parameter is modified, the total appearance in basis by the sum of capacity of hard disk of modified each hard disk groups as the hard disk areas Amount, at the same record modification waste capacity, optionally, in the present invention, when by preset disk number threshold value at least two hard disks When the volume type parameter of group is modified, modification waste capacity can be set to 0.Simultaneously by the preset disk number threshold value 11 It is recorded as modification threshold value.
When user creates a RAID, storage system obtains the member disk number and the member disk number of the RAID to be created The sum of corresponding HotSpare disk number, and the member disk number HotSpare disk number corresponding with the member disk number for comparing the RAID to be created it And with the size relation between the modification threshold value that has recorded, if the member disk number of the RAID to be created is corresponding with the member disk number The sum of HotSpare disk number be greater than the modification threshold value recorded, then by the member disk number of the RAID to be created and the member disk number pair The sum of HotSpare disk number answered is set as new modification threshold value.Storage system also generates RAID management instruction simultaneously, when modification threshold value When having update, greatest member's disk number that the RAID at least two hard disk groups for including in RAID management instruction needs is update Modification threshold value afterwards, storage system is according to the updated modification threshold value, and the method in conjunction with shown in Fig. 2 and Fig. 3 A is at least two The volume type parameter of hard disk groups is modified, and after record modification at least two hard disk groups total capacity, will be recited above The total capacity that basic total capacity subtracts this modified at least two hard disk groups just obtains the modification waste capacity of this modification. If modification threshold value does not update, it can not include what the RAID at least two hard disk groups needed in RAID management instruction Greatest member's disk number, storage system also do not modify to the volume type parameter of at least two hard disk groups.
For example, it is 1 that inquiry table 1, which obtains corresponding HotSpare disk number, then 5+1=6 if the member disk number of RAID to be created is 5, Less than 11, at this point, keeping modification threshold value is 11 constant.If the member disk number of RAID to be created is 13, user selects hot standby side Formula is that high fever is standby, then inquiry table 1 determines that corresponding HotSpare disk number is 2,13+2=15, is greater than 11, at this point, modification threshold value is updated It is 15.
When user delete a RAID when, after storage system obtains the deletion RAID, storage system first determine whether to Whether the sum of the member disk number of the RAID of deletion HotSpare disk number corresponding with the member disk number is equal to the modification threshold value recorded, if The sum of the member disk number of RAID to be deleted HotSpare disk number corresponding with the member disk number is not equal to the modification threshold value recorded, then It keeps the modification threshold value recorded constant, if being equal to, further obtains the maximum value of the member disk number of remaining each RAID The sum of HotSpare disk number corresponding with the maximum value, and compare the sum of maximum value HotSpare disk number corresponding with the maximum value and preset Disk number threshold value 11 between size relation, if the sum of maximum value HotSpare disk number corresponding with the maximum value be greater than 11, will The sum of maximum value HotSpare disk number corresponding with the maximum value is as new modification threshold value, otherwise, by 11 as new modification threshold Value.Storage system also generates RAID management instruction simultaneously, likewise, when modifying threshold value has update, in RAID management instruction Greatest member's disk number that RAID at least two hard disk groups for including needs is updated modification threshold value, storage system according to The updated modification threshold value, the method in conjunction with shown in Fig. 2 and Fig. 3 A carry out the volume type parameter of at least two hard disk groups Modification.If modification threshold value does not update, the RAID at least two hard disk groups can not be included in RAID management instruction The greatest member's disk number needed, storage system also do not modify to the volume type parameter of at least two hard disk groups.
Allocation capacity and heat when being whole progress calculation of capacity with hard disk areas, in the available hard disk areas Standby capacity, calculate the hard disk areas use capacity are as follows: allocation capacity+modification waste capacity, calculate the hard disk areas can With capacity are as follows: the hot standby capacity of allocation capacity-- modification wastes capacity to basic total capacity-.
Wherein, allocation capacity refers to the capacity dispensed as data space, for example, distributing to storage The capacity of each RAID in system, and, when in storage system also including the data of separate storage, distribute to these independences The capacity of the data of storage.
It should be noted that, when above-mentioned modification threshold value becomes larger, modification waste capacity may also in above-mentioned implementation It can become larger, it is available in order to avoid output when modification waste capacity is greater than the basic total capacity-hot standby capacity of allocation capacity- Capacity is negative value, will modification waste capacity when modification waste capacity is greater than the basic total capacity-hot standby capacity of allocation capacity- Updating is the basic total capacity-hot standby capacity of allocation capacity-.
Referring to FIG. 4, it illustrates the block diagrams of the device of management RAID provided by one embodiment of the present invention.The device can It is embodied as some or all of of the controller 130 of implementation environment shown in Fig. 1 in a manner of through hardware or soft or hard combination, uses To execute all or part of step in the method as shown in Fig. 2 or Fig. 3 A.The apparatus may include:
Instruction receiving unit 401 has and the same or similar function of command reception module 1364e1;
Judging unit 402 has and the same or similar function of judgment module 1364e2;
Parameter determination unit 403 has and the same or similar function of parameter determination module 1364e3;
Parameter modifying unit 404 has and the same or similar function of parameter adapting module 1364e4;
Administrative unit 405 has and the same or similar function of management module 1364e5;
Detection unit 406 has and the same or similar function of detection module 1364e6;
Hard disk groups determination unit 407 has and the same or similar function of hard disk groups determining module 1364e7.
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware It completes, relevant hardware can also be instructed to complete by program, the program can store in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.

Claims (10)

1. a kind of method for managing RAID, which is characterized in that within the storage system, the storage system includes for the method application At least two hard disk groups and controller, hard disk volume type parameter having the same included by each hard disk groups are described Volume type parameter is used to indicate the capacity of the hard disk;The method is executed by controller, comprising:
RAID management instruction is received, the management instruction includes the greatest member that the RAID at least two hard disk groups needs Disk number;
Judge whether the quantity for the hard disk that each hard disk groups are included meets greatest member's disk number;
It is determining with first hard disk when quantity of the hard disk included by the first hard disk groups is unsatisfactory for greatest member's disk number The volume type parameter of immediate second hard disk groups of volume type parameter of group, the volume type parameter of second hard disk groups Less than the volume type parameter of first hard disk groups;
The volume type parameter of first hard disk groups is revised as to the volume type parameter of second hard disk groups;
According to the modified volume type parameter, RAID management, the RAID are carried out at least two hard disk groups Management includes: to create RAID, delete the hard disk areas of RAID or creation comprising at least two hard disk groups.
2. the method according to claim 1, wherein when RAID management instruction is used to indicate creation RAID When, greatest member's disk number that the RAID at least two hard disk groups needs are as follows:
The member disk number that RAID to be created includes;
Alternatively,
The member disk number and the larger value of preset disk number threshold value between the two that RAID to be created includes.
3. the method according to claim 1, wherein deleting RAID when RAID management instruction is used to indicate When, greatest member's disk number that the RAID at least two hard disk groups needs are as follows:
After RAID to be deleted is deleted, the maximum of the corresponding member disk number of remaining RAID at least two hard disk groups Value;
Alternatively,
After RAID to be deleted is deleted, the maximum value of the corresponding member disk number of remaining RAID at least two hard disk groups With the larger value of preset disk number threshold value between the two.
4. the method according to claim 1, wherein including institute when RAID management instruction is used to indicate creation When stating the hard disk areas of at least two hard disk groups, greatest member's disk number that the RAID at least two hard disk groups needs is pre- If disk number threshold value.
5. method according to any one of claims 1 to 4, which is characterized in that in the hard disk for judging that each hard disk groups are included Quantity whether meet greatest member's disk number before, further includes:
It is positive integer that whether the group number m for detecting at least two hard disk groups, which is greater than preset group of number threshold value n, m and n,;
When m is greater than n, determine at least two hard disk groups, the big third hard disk groups of volume type parameter n-th;
By at least two hard disk groups, the volume type parameter of the maximum m-n hard disk groups of volume type parameter is revised as The capacity parameter of the third hard disk groups.
6. a kind of device for managing RAID, which is characterized in that within the storage system, the storage system includes for described device application At least two hard disk groups and controller, hard disk volume type parameter having the same included by each hard disk groups are described Volume type parameter is used to indicate the capacity of the hard disk;Described device includes:
Instruction receiving unit, for receiving RAID management instruction, the management instruction includes at least two hard disk groups Greatest member's disk number that RAID needs;
Judging unit, for judging whether the quantity of hard disk that each hard disk groups are included meets greatest member's disk Number;
Parameter determination unit, when the quantity for the hard disk included by the first hard disk groups is unsatisfactory for greatest member's disk number, The determining volume type parameter with immediate second hard disk groups of volume type parameter of first hard disk groups, described second is hard The volume type parameter of disk group is less than the volume type parameter of first hard disk groups;
Parameter modifying unit, for the volume type parameter of first hard disk groups to be revised as to the capacity of second hard disk groups Type parameter;
Administrative unit, for carrying out RAID at least two hard disk groups according to the modified volume type parameter Management, the RAID management include: to create the hard disk area that RAID, deletion RAID or creation include at least two hard disk groups Domain.
7. device according to claim 6, which is characterized in that when RAID management instruction is used to indicate creation RAID When, greatest member's disk number that the RAID at least two hard disk groups needs are as follows:
The member disk number that RAID to be created includes;
Alternatively,
The member disk number and the larger value of preset disk number threshold value between the two that RAID to be created includes.
8. device according to claim 6, which is characterized in that delete RAID when RAID management instruction is used to indicate When, greatest member's disk number that the RAID at least two hard disk groups needs are as follows:
After RAID to be deleted is deleted, the maximum of the corresponding member disk number of remaining RAID at least two hard disk groups Value;
Alternatively,
After RAID to be deleted is deleted, the maximum value of the corresponding member disk number of remaining RAID at least two hard disk groups With the larger value of preset disk number threshold value between the two.
9. device according to claim 6, which is characterized in that include institute when RAID management instruction is used to indicate creation When stating the hard disk areas of at least two hard disk groups, greatest member's disk number that the RAID at least two hard disk groups needs is pre- If disk number threshold value.
10. according to any device of claim 6 to 9, which is characterized in that described device further include:
Detection unit, for judge in the judging unit quantity for the hard disk that each hard disk groups are included whether meet it is described most Before major member's disk number, whether the group number m for detecting at least two hard disk groups, which is greater than preset group of number threshold value n, m and n, is positive Integer;
Hard disk groups determination unit, for determining at least two hard disk groups when m is greater than n, volume type parameter n-th is big Third hard disk groups;
The parameter modifying unit is also used at least two hard disk groups, the maximum m-n hard disk of volume type parameter The volume type parameter of group is revised as the capacity parameter of the third hard disk groups.
CN201511027145.1A 2015-12-31 2015-12-31 Manage the method and device of RAID Active CN106933496B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201511027145.1A CN106933496B (en) 2015-12-31 2015-12-31 Manage the method and device of RAID

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201511027145.1A CN106933496B (en) 2015-12-31 2015-12-31 Manage the method and device of RAID

Publications (2)

Publication Number Publication Date
CN106933496A CN106933496A (en) 2017-07-07
CN106933496B true CN106933496B (en) 2019-10-22

Family

ID=59441203

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201511027145.1A Active CN106933496B (en) 2015-12-31 2015-12-31 Manage the method and device of RAID

Country Status (1)

Country Link
CN (1) CN106933496B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109542342B (en) * 2018-11-09 2022-04-26 锐捷网络股份有限公司 Metadata management and data reconstruction method, equipment and storage medium
CN113126890A (en) * 2020-01-15 2021-07-16 伊姆西Ip控股有限责任公司 Method, apparatus and computer program product for storage

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7043605B2 (en) * 2004-02-18 2006-05-09 Hitachi, Ltd. Disk array apparatus
US7360030B1 (en) * 2004-06-01 2008-04-15 Sanbolic, Inc. Methods and apparatus facilitating volume management
CN101510146A (en) * 2009-03-27 2009-08-19 成都市华为赛门铁克科技有限公司 Virtual space establishing method, apparatus and system based on independent redundant magnetic disc array
CN101963941A (en) * 2009-07-22 2011-02-02 英业达股份有限公司 Capacity planning method of storage device and reading and storing correction method thereof
CN103631535A (en) * 2013-11-20 2014-03-12 华为技术有限公司 Method and device for achieving space distribution in storage pool

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7043605B2 (en) * 2004-02-18 2006-05-09 Hitachi, Ltd. Disk array apparatus
US7360030B1 (en) * 2004-06-01 2008-04-15 Sanbolic, Inc. Methods and apparatus facilitating volume management
CN101510146A (en) * 2009-03-27 2009-08-19 成都市华为赛门铁克科技有限公司 Virtual space establishing method, apparatus and system based on independent redundant magnetic disc array
CN101963941A (en) * 2009-07-22 2011-02-02 英业达股份有限公司 Capacity planning method of storage device and reading and storing correction method thereof
CN103631535A (en) * 2013-11-20 2014-03-12 华为技术有限公司 Method and device for achieving space distribution in storage pool

Also Published As

Publication number Publication date
CN106933496A (en) 2017-07-07

Similar Documents

Publication Publication Date Title
US20200267219A1 (en) Systems and methods for granular resource management in a storage network
US10977124B2 (en) Distributed storage system, data storage method, and software program
US9361034B2 (en) Transferring storage resources between snapshot storage pools and volume storage pools in a distributed network
US8805902B2 (en) Managing snapshot storage pools
US7895398B2 (en) System and method for dynamically adjusting the caching characteristics for each logical unit of a storage array
KR102478395B1 (en) Mechanism for ssds to efficiently manage background activity with notify
US7971025B2 (en) Method and apparatus for chunk allocation in a thin provisioning storage system
CN103761053B (en) A kind of data processing method and device
EP2261790A2 (en) Method and apparatus for controlling data volume creation in data storage system with dynamic chunk allocation capability
US10564865B2 (en) Lockless parity management in a distributed data storage system
JP2012506087A (en) Power and performance management using MAIDX and adaptive data placement
US11385828B2 (en) Method and apparatus for calculating storage system available capacity
US11422893B2 (en) Storage system spanning multiple failure domains
CN110134338A (en) A kind of distributed memory system and its data redundancy protection method and relevant device
CN110007858A (en) Memory allocation method and device
CN106933496B (en) Manage the method and device of RAID
US11188258B2 (en) Distributed storage system
JP2004127275A (en) Method of managing data storage array and computer system equipped with raid controller
JP7304215B2 (en) Storage system and history information management method
CN108769123B (en) Data system and data processing method
US8543784B1 (en) Backup application coordination with storage array power saving features
US11907551B2 (en) Performance efficient and resilient creation of network attached storage objects
CN116027991B (en) RAID array management method and device, RAID card and storage medium
EP2981965A1 (en) System for increasing storage media performance
JPWO2005006175A1 (en) Method for grouping a plurality of logical units, method for processing received requests, device for grouping a plurality of logical units, and device for processing received requests

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant