CN114816266A - Metadata repairing method, system, storage medium and equipment - Google Patents
Metadata repairing method, system, storage medium and equipment Download PDFInfo
- Publication number
- CN114816266A CN114816266A CN202210605731.3A CN202210605731A CN114816266A CN 114816266 A CN114816266 A CN 114816266A CN 202210605731 A CN202210605731 A CN 202210605731A CN 114816266 A CN114816266 A CN 114816266A
- Authority
- CN
- China
- Prior art keywords
- repair
- storage
- trees
- tree
- metadata
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000008439 repair process Effects 0.000 claims abstract description 119
- 238000012795 verification Methods 0.000 claims abstract description 24
- 230000008569 process Effects 0.000 claims abstract description 19
- 230000004044 response Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 8
- 230000005055 memory storage Effects 0.000 claims description 3
- 230000006870 function Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 8
- 238000013507 mapping Methods 0.000 description 6
- 238000011084 recovery Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000014509 gene expression Effects 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a method, a system, a storage medium and equipment for repairing metadata, wherein the method comprises the following steps: responding to a fault of the full flash storage system in the operation process to enable the storage pool and the storage volume to be offline, and judging whether storage volume configuration information exists in the storage pool or not; responding to the storage volume configuration information in the storage pool, performing full-disk scanning on the storage pool to extract a metadata repair object, and performing verification repair on all LP trees based on the root addresses of the LP trees in the metadata repair object; responding to the success of checking and repairing all LP trees, and directly performing PL tree pairing repairing; and responding to the success of PL tree pairing repair, informing that the storage pool and the storage volume are online, and recovering the service of the full flash storage system. The method and the device realize the quick repair of the metadata under different configuration scenes, effectively save the repair time of the metadata and improve the efficiency.
Description
Technical Field
The present invention relates to the field of storage technologies, and in particular, to a method, a system, a storage medium, and a device for metadata repair.
Background
When multiple failures occur (for example, hardware or software failures occur simultaneously in each controller) in the current full flash memory system, the storage pools and storage volumes in the storage system are offline due to data loss in the cache, and at this time, system service is also interrupted. After the failure occurs, in order to recover the system service as soon as possible, the data lost in the cache needs to be recovered as much as possible through the metadata recovery function, and then the storage pool and the storage volume of the system are notified to be online, so that the system service is recovered. The current metadata repair function is to repair based on the storage pool granularity, and when repairing, data repair can be completed only by sequentially performing three necessary stages of full-disk scanning, LP (mapping from LBA to PBA) and PL (mapping from PBA to LBA) tree verification repair, and LP and PL tree mutual pairing repair, and informing the storage pool and the storage volume to be online. LBA: logical Block Address, Logical Block Address; PBA: physics Block Address, physical Block Address.
Because factors such as special scenes and data dropping characteristics are not considered in the current repairing process, the system must sequentially go through the three stages during repairing, the full-disk scanning stage involves all disk reading operations, and meanwhile, a large number of operations such as asynchronous operations and cross-node query are performed in the two stages of verification repairing and pairing repairing, and the operations all take a long time, so that the time consumption of the metadata repairing function of the current system is long (for example, 1T data is repaired, and the time consumption is about 1 h).
Disclosure of Invention
In view of the above, the present invention is directed to a method, a system, a storage medium, and a device for metadata repair, which are used to solve the problem in the prior art that metadata repair in a full flash memory system takes a long time.
Based on the above purpose, the present invention provides a metadata repairing method, which includes the following steps:
responding to a fault of the full flash storage system in the operation process to enable the storage pool and the storage volume to be offline, and judging whether storage volume configuration information exists in the storage pool or not;
responding to the storage volume configuration information in the storage pool, performing full-disk scanning on the storage pool to extract a metadata repair object, and performing verification repair on all LP trees based on the root addresses of the LP trees in the metadata repair object;
responding to the success of checking and repairing all LP trees, and directly performing PL tree pairing repairing;
and responding to the success of PL tree pairing repair, informing that the storage pool and the storage volume are online, and recovering the service of the full flash storage system.
In some embodiments, the method further comprises:
in response to that all the LP trees are not successfully verified and repaired, continuously verifying and repairing all the PL trees;
responding to the completion of verification and repair of all PL trees, and entering a process of mutual pairing and repair of the LP tree and the PL tree;
and in response to the successful matching and repairing of the LP tree and the PL tree, informing the storage pool and the storage volume to be online, and recovering the service of the full flash storage system.
In some embodiments, performing a check repair on all LP trees based on a root address of the LP trees in the metadata repair object includes:
from the root address of the LP tree in the metadata repair object, all LP trees are verified and repaired.
In some embodiments, the method further comprises:
and responding to the fact that no storage volume configuration information exists in the storage volume, directly informing the storage volume to be online, and recovering the service of the full flash storage system.
In another aspect of the present invention, there is also provided a metadata repair system, including:
the judging module is configured to respond to the failure of the full flash storage system in the operation process to enable the storage pool and the storage volume to be offline, and judge whether the storage pool has storage volume configuration information;
the LP tree verifying and repairing module is configured to respond to the storage volume configuration information in the storage pool, perform full-disk scanning on the storage pool to extract a metadata repairing object, and verify and repair all LP trees based on the root address of the LP trees in the metadata repairing object;
the PL tree pairing and repairing module is configured for responding to successful verification and repair of all LP trees and directly performing PL tree pairing and repair; and
and the online module is configured to respond to the success of PL tree pairing repair, notify the storage pool and the storage volume to be online, and recover the service of the full flash storage system.
In some embodiments, the system further includes a PL tree check and repair module configured to continue to check and repair all the PL trees in response to all the LP trees not being successfully checked and repaired; responding to the completion of verification and repair of all PL trees, and entering a process of mutual pairing and repair of the LP tree and the PL tree; and responding to the successful matching and repairing of the LP tree and the PL tree, informing the storage pool and the storage volume to be online, and recovering the service of the full flash storage system.
In some embodiments, the LP tree check repair module includes a root address module configured to check repair all LP trees from a root address of the LP tree in the metadata repair object.
In some embodiments, the system further comprises a direct online module configured to directly notify the storage pool to be online and restore the service of the full flash storage system in response to no storage volume configuration information in the storage pool.
In yet another aspect of the present invention, a computer-readable storage medium is also provided, storing computer program instructions, which when executed by a processor, implement the above-described method.
In yet another aspect of the present invention, a computer device is further provided, which includes a memory and a processor, the memory storing a computer program, which when executed by the processor performs the above method.
The invention has at least the following beneficial technical effects:
the metadata repairing method can extract the metadata repairing object by judging whether the storage pool has storage volume configuration information or not and carrying out full-disc scanning on the storage pool when the storage pool has the storage volume configuration information after the storage pool and the storage volume are offline and the service is interrupted due to multiple faults of the full-flash storage system, and carries out verification repairing on all LP trees based on the root addresses of the LP trees in the metadata repairing object.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.
FIG. 1 is a diagram illustrating a metadata repair method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a metadata repair system provided in accordance with an embodiment of the present invention;
FIG. 3 is a schematic diagram of a computer-readable storage medium for implementing a metadata recovery method according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a hardware structure of a computer device for executing a metadata repair method according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two non-identical entities with the same name or different parameters, and it is understood that "first" and "second" are only used for convenience of expression and should not be construed as limiting the embodiments of the present invention. Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements does not include all of the other steps or elements inherent in the list.
In view of the above object, a first aspect of the embodiments of the present invention proposes an embodiment of a metadata repair method. Fig. 1 is a schematic diagram illustrating an embodiment of a metadata repair method provided by the present invention. As shown in fig. 1, the embodiment of the present invention includes the following steps:
step S10, responding to the failure of the full flash memory system in the operation process to take the storage pool and the storage volume off-line, and judging whether the storage pool has the storage volume configuration information;
step S20, responding to the storage pool having storage volume configuration information, performing full-disk scanning on the storage pool to extract metadata repair objects, and performing verification repair on all LP trees based on the root addresses of the LP trees in the metadata repair objects;
step S30, responding to the success of checking and repairing all LP trees, and directly performing PL tree pairing repairing;
and step S40, responding to the success of PL tree pairing repair, informing that the storage pool and the storage volume are on line, and recovering the service of the full flash storage system.
In the embodiment of the invention, the LP tree and the PL tree both adopt a data structure of a B + tree. A B + tree is a tree data structure that is an n-ary tree, each node typically having multiple children, and a B + tree that includes a root node, interior nodes, and leaf nodes. B + trees are commonly used in databases and file systems of operating systems. The B + tree is characterized in that data can be kept stable and orderly, and the insertion and modification of the B + tree have stable logarithmic time complexity. The B + tree is a variant form of the B + tree, leaf nodes on the B + tree store the keywords and the addresses of corresponding records, and the layers above the leaf nodes are used as indexes. An m-level B + tree is defined as (1) each node has at most m children; (2) except for the root node, each node has at least [ m/2] children, and the root node has at least two children; (3) a node with k children must have k keys. The search of the B + tree is different from the B tree, and when the key of a certain node in the index part is equal to the searched key, the search is not stopped, and the pointer on the left side of the key is continued to be downward until the leaf node where the key is located is searched.
LP represents mapping of LBA (Logical Block Address) to PBA (physical Block Address); PL denotes the PBA to LBA mapping. The LBA may mean an address of a certain data block or a data block to which a certain address points.
Metadata (metadata) is data describing data, mainly information describing data attributes, and is used to support functions such as indicating storage locations, history data, resource lookup, file records, and the like.
The metadata repairing method can extract the metadata repairing object by judging whether the storage volume configuration information exists in the storage pool or not and carrying out full-disc scanning on the storage pool when the storage volume configuration information exists in the storage pool after the storage pool and the storage volume are offline and the service is interrupted due to multiple faults of the full-flash storage system, and carry out verification repairing on all LP trees based on the root addresses of the LP trees in the metadata repairing object.
In some embodiments, performing a check repair on all LP trees based on a root address of the LP trees in the metadata repair object includes: from the root address of the LP tree in the metadata repair object, all LP trees are verified and repaired.
In the above embodiment, if there is storage volume configuration information in the storage pool, the storage pool is scanned in a full-disk manner, and metadata repair objects are extracted by reading and comparing data in the disks, where the repair objects mainly record information such as root addresses of all LPs and PL trees, and a disk drop timestamp, and time required at this stage is linearly related to the space size of the storage pool. And according to the root address of the LP tree in the metadata repair object, parallel establishing and verifying and repairing the LP tree from top to bottom until all the LP trees are verified and repaired. If all the LP trees are successfully verified and recovered (due to the fact that the LP trees are frequently dropped compared with the PL trees in the system design, the LP trees are verified and recovered in most cases), the PL trees are not needed to be verified and recovered, but the PL trees are directly subjected to pairing repair, pairing search is not needed in the repairing process, and therefore time is not long.
In some embodiments, the method further comprises: in response to that all the LP trees are not successfully verified and repaired, continuously verifying and repairing all the PL trees; responding to the completion of verification and repair of all PL trees, and entering a process of mutual pairing and repair of the LP tree and the PL tree; and in response to the successful matching and repairing of the LP tree and the PL tree, informing the storage pool and the storage volume to be online, and recovering the service of the full flash storage system.
In this embodiment, if the LP trees are not all successfully verified, the verification and repair of the PL trees are continued, and after all the PL trees are verified and recovered, the stage of repairing LP and PL trees by mutual configuration is entered.
In some embodiments, the method further comprises: and in response to the fact that no storage volume configuration information exists in the storage pool, directly informing the storage pool to be online, and recovering the service of the full flash storage system.
In this embodiment, because multiple failures occur in the full flash memory system during operation, both the storage pool and the storage volume in the system are offline, and the system service is interrupted, the lost data needs to be repaired by the metadata repair function, so that the system service is restored. When the metadata is repaired, whether the storage pool has storage volume configuration information is judged firstly, if not, the storage pool is directly informed to be on-line, and the system service is restored, so that the repairing function is completed.
In summary, after factors such as special scenes and metadata destaging characteristics are considered comprehensively, the metadata repairing method of the embodiment can realize quick online in a second level (the time consumption is less than 3s) in a non-volume scene, and can optimize a repairing process according to different data characteristics to effectively improve the repairing speed (1T data is repaired, the time consumption is less than 20min) in a normal volume scene, so that the high availability of the full flash memory storage system is improved.
In a second aspect of the embodiments of the present invention, a metadata repair system is further provided. Fig. 2 is a schematic diagram illustrating an embodiment of a metadata repair system provided by the present invention. As shown in fig. 2, a metadata repair system includes:
the judging module 10 is configured to respond to a failure of the full flash storage system in an operation process to enable the storage pool and the storage volume to be offline, and judge whether the storage volume configuration information exists in the storage pool;
the LP tree verification and repair module 20 is configured to respond to the storage volume configuration information in the storage pool, perform full-disk scanning on the storage pool to extract the metadata repair object, and perform verification and repair on all LP trees based on a root address of an LP tree in the metadata repair object;
a PL tree pair repair module 30 configured to directly perform PL tree pair repair in response to successful verification and repair of all LP trees; and
and the online module 40 is configured to notify the storage pool and the storage volume to be online in response to the successful PL tree pair repair, and recover the service of the full flash storage system.
In the embodiment of the invention, the LP tree and the PL tree both adopt a data structure of a B + tree. A B + tree is a tree data structure that is an n-ary tree, each node typically having multiple children, and a B + tree that includes a root node, interior nodes, and leaf nodes. B + trees are commonly used in databases and file systems of operating systems. The B + tree is characterized in that data can be kept stable and orderly, and the insertion and modification of the B + tree have stable logarithmic time complexity. The B + tree is a variant form of the B-tree, the leaf nodes on the B + tree store the keywords and the addresses of the corresponding records, and the layers above the leaf nodes are used as indexes.
LP represents mapping of LBA (Logical Block Address) to PBA (physical Block Address); PL denotes the PBA to LBA mapping. The LBA may mean an address of a certain data block or a data block to which a certain address points.
Metadata (metadata) is data describing data, mainly information describing data attributes, and is used to support functions such as indicating storage locations, history data, resource lookup, file records, and the like.
The metadata repair system provided by the embodiment of the invention can extract the metadata repair object by judging whether the storage volume configuration information exists in the storage pool or not and performing full-disc scanning on the storage pool when the storage volume configuration information exists in the storage pool after the storage pool and the storage volume are offline and the service is interrupted due to multiple faults of the full-flash storage system, and perform verification repair on all LP trees based on the root addresses of the LP trees in the metadata repair object.
In some embodiments, the LP tree check repair module 20 includes a root address module configured to check repair all LP trees from the root address of the LP trees in the metadata repair object.
In the above embodiment, if there is storage volume configuration information in the storage pool, the storage pool is scanned in a full-disk manner, and metadata repair objects are extracted by reading and comparing data in the disks, where the repair objects mainly record information such as root addresses of all LPs and PL trees, and a disk drop timestamp, and time required at this stage is linearly related to the space size of the storage pool. And according to the root address of the LP tree in the metadata repair object, parallel establishing and verifying and repairing the LP tree from top to bottom until all the LP trees are verified and repaired. If all the LP trees are successfully verified and recovered (due to the fact that the LP trees are frequently dropped compared with the PL trees in the system design, the LP trees are verified and recovered in most cases), the PL trees are not needed to be verified and recovered, but the PL trees are directly subjected to pairing repair, pairing search is not needed in the repairing process, and therefore time is not long.
In some embodiments, the system further includes a PL tree check and repair module configured to continue to check and repair all the PL trees in response to all the LP trees not being successfully checked and repaired; responding to the completion of verification and repair of all PL trees, and entering a process of mutual pairing and repair of the LP tree and the PL tree; and responding to the successful matching and repairing of the LP tree and the PL tree, informing the storage pool and the storage volume to be online, and recovering the service of the full flash storage system.
In this embodiment, if the LP trees are not all successfully verified, the verification and repair of the PL trees are continued, and after all the PL trees are verified and recovered, the stage of repairing LP and PL trees by mutual configuration is entered.
In some embodiments, the system further comprises a direct online module configured to directly notify the storage pool to be online and restore the service of the full flash storage system in response to no storage volume configuration information in the storage pool.
In this embodiment, because multiple failures occur in the full flash storage system during the operation process, both storage pools and storage volumes in the system are offline, and the system service is interrupted, the lost data needs to be repaired by the metadata repair function, so that the system service is recovered. When the metadata is repaired, whether the storage pool has storage volume configuration information is judged firstly, if not, the storage pool is directly informed to be on-line, and the system service is restored, so that the repairing function is completed.
In summary, after factors such as special scenes and metadata destaging characteristics are considered comprehensively, the metadata repair system of the embodiment can realize quick online in a second level (the time consumption is less than 3s) in a non-volume scene, and can optimize the repair process according to different data characteristics to effectively improve the repair speed (repair 1T data, the time consumption is less than 20min) in a normal volume scene, so that the high availability of the full flash memory storage system is improved.
In a third aspect of the embodiment of the present invention, a computer-readable storage medium is further provided, and fig. 3 is a schematic diagram of a computer-readable storage medium implementing a metadata recovery method according to an embodiment of the present invention. As shown in fig. 3, the computer-readable storage medium 3 stores computer program instructions 31. The computer program instructions 31 when executed by a processor implement the steps of:
responding to a fault of the full flash storage system in the operation process to enable the storage pool and the storage volume to be offline, and judging whether storage volume configuration information exists in the storage pool or not;
responding to the storage volume configuration information in the storage pool, performing full-disk scanning on the storage pool to extract a metadata repair object, and performing verification repair on all LP trees based on the root addresses of the LP trees in the metadata repair object;
responding to the success of checking and repairing all LP trees, and directly performing PL tree pairing repairing;
and responding to the success of PL tree pairing repair, informing that the storage pool and the storage volume are online, and recovering the service of the full flash storage system.
In some embodiments, the steps further comprise: in response to that all the LP trees are not successfully verified and repaired, continuously verifying and repairing all the PL trees; responding to the completion of verification and repair of all PL trees, and entering a process of mutual pairing and repair of the LP tree and the PL tree; and in response to the successful matching and repairing of the LP tree and the PL tree, informing the storage pool and the storage volume to be online, and recovering the service of the full flash storage system.
In some embodiments, performing a check repair on all LP trees based on a root address of the LP trees in the metadata repair object includes: from the root address of the LP tree in the metadata repair object, all LP trees are verified and repaired.
In some embodiments, the steps further comprise: and responding to the fact that no storage volume configuration information exists in the storage volume, directly informing the storage volume to be online, and recovering the service of the full flash storage system.
It is to be understood that all embodiments, features and advantages set forth above with respect to the metadata repair method according to the present invention are equally applicable to the metadata repair system and the storage medium according to the present invention, without conflicting therewith.
In a fourth aspect of the embodiments of the present invention, there is further provided a computer device, including a memory 402 and a processor 401 as shown in fig. 4, where the memory 402 stores therein a computer program, and the computer program, when executed by the processor 401, implements the method of any one of the above embodiments.
Fig. 4 is a schematic hardware structure diagram of an embodiment of a computer device for executing a metadata recovery method according to the present invention. Taking the computer device shown in fig. 4 as an example, the computer device includes a processor 401 and a memory 402, and may further include: an input device 403 and an output device 404. The processor 401, the memory 402, the input device 403 and the output device 404 may be connected by a bus or other means, and fig. 4 illustrates an example of a connection by a bus. The input device 403 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the metadata repair system. The output device 404 may include a display device such as a display screen.
The memory 402, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions/modules corresponding to the metadata recovery method in the embodiments of the present application. The memory 402 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created by use of a metadata repair method, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 402 may optionally include memory located remotely from processor 401, which may be connected to local modules via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The processor 401 executes various functional applications of the server and data processing by running nonvolatile software programs, instructions, and modules stored in the memory 402, that is, implements the metadata repair method of the above-described method embodiment.
Finally, it should be noted that the computer-readable storage medium (e.g., memory) herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example, and not limitation, nonvolatile memory can include Read Only Memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which can act as external cache memory. By way of example and not limitation, RAM is available in a variety of forms such as synchronous RAM (DRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments of the present invention.
The various illustrative logical blocks, modules, and circuits described in connection with the disclosure herein may be implemented or performed with the following components designed to perform the functions herein: a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of these components. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP, and/or any other such configuration.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items. The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of the embodiments of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.
Claims (10)
1. A metadata repair method, comprising the steps of:
responding to a fault of a full flash storage system in the operation process to enable a storage pool and a storage volume to be offline, and judging whether the storage pool has storage volume configuration information or not;
responding to the storage pool with the configuration information of the storage volume, performing full-disk scanning on the storage pool to extract a metadata repair object, and performing verification repair on all LP trees based on the root address of the LP trees in the metadata repair object;
responding to the success of checking and repairing all the LP trees, and directly performing PL tree pairing repairing;
and responding to the success of PL tree pairing repair, informing the storage pool and the storage volume to be online, and recovering the service of the full flash storage system.
2. The method of claim 1, further comprising:
responding to all the LP trees which are not successfully verified and repaired, and continuously verifying and repairing all the PL trees;
responding to the completion of the verification and repair of all the PL trees, and entering a mutual pairing and repair process of the LP tree and the PL trees;
and in response to the successful matching and repairing of the LP tree and the PL tree, informing the storage pool and the storage volume to be online, and recovering the service of the full flash storage system.
3. The method of claim 1, wherein performing a check repair on all LP trees based on a root address of an LP tree in the metadata repair object comprises:
and checking and repairing all LP trees from the root address of the LP trees in the metadata repairing object.
4. The method of claim 1, further comprising:
and in response to the fact that the storage volume configuration information does not exist in the storage pool, directly informing the storage pool to be online, and recovering the service of the full flash storage system.
5. A metadata repair system, comprising:
the judging module is configured to respond to the fact that the full flash memory storage system breaks down in the operation process to enable the storage pool and the storage volume to be offline, and judge whether the storage volume configuration information exists in the storage pool or not;
the LP tree checking and repairing module is configured to respond to the storage volume configuration information in the storage pool, perform full-disk scanning on the storage pool to extract metadata repairing objects, and check and repair all LP trees based on root addresses of the LP trees in the metadata repairing objects;
the PL tree pairing and repairing module is configured to respond to the successful verification and repair of all the LP trees and directly carry out PL tree pairing and repair; and
and the online module is configured to respond to the success of PL tree pairing repair, notify the storage pool and the storage volume to be online, and recover the service of the full flash storage system.
6. The system of claim 5, further comprising a PL-tree check-repair module configured to continue to check-repair all PL trees in response to all LP trees not being successfully checked-repaired; responding to the completion of the verification and repair of all the PL trees, and entering a mutual pairing and repair process of the LP tree and the PL trees; and in response to the successful matching and repairing of the LP tree and the PL tree, informing the storage pool and the storage volume to be online and recovering the service of the full flash storage system.
7. The system of claim 5, wherein the LP tree checking and repairing module comprises a root address module configured to check and repair all LP trees starting from a root address of an LP tree in the metadata repair object.
8. The system of claim 5, further comprising a direct online module configured to, in response to the absence of the storage volume configuration information in the storage pool, directly notify the storage pool to be online and resume traffic of the full flash storage system.
9. A computer-readable storage medium, characterized in that computer program instructions are stored which, when executed by a processor, implement the method according to any one of claims 1-4.
10. A computer device comprising a memory and a processor, characterized in that the memory has stored therein a computer program which, when executed by the processor, performs the method according to any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210605731.3A CN114816266A (en) | 2022-05-30 | 2022-05-30 | Metadata repairing method, system, storage medium and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210605731.3A CN114816266A (en) | 2022-05-30 | 2022-05-30 | Metadata repairing method, system, storage medium and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114816266A true CN114816266A (en) | 2022-07-29 |
Family
ID=82519030
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210605731.3A Pending CN114816266A (en) | 2022-05-30 | 2022-05-30 | Metadata repairing method, system, storage medium and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114816266A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115309591A (en) * | 2022-10-10 | 2022-11-08 | 浪潮电子信息产业股份有限公司 | Recovery method and related device of full flash memory system |
| CN116700635A (en) * | 2023-08-09 | 2023-09-05 | 深圳市威科伟业电子科技有限公司 | Solid state disk data recovery method and solid state disk |
-
2022
- 2022-05-30 CN CN202210605731.3A patent/CN114816266A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115309591A (en) * | 2022-10-10 | 2022-11-08 | 浪潮电子信息产业股份有限公司 | Recovery method and related device of full flash memory system |
| WO2024077863A1 (en) * | 2022-10-10 | 2024-04-18 | 浪潮电子信息产业股份有限公司 | Recovery method for all-flash storage system, and related apparatus |
| CN116700635A (en) * | 2023-08-09 | 2023-09-05 | 深圳市威科伟业电子科技有限公司 | Solid state disk data recovery method and solid state disk |
| CN116700635B (en) * | 2023-08-09 | 2024-01-30 | 深圳市威科伟业电子科技有限公司 | Solid state disk data recovery method and solid state disk |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114816266A (en) | Metadata repairing method, system, storage medium and equipment | |
| US9558196B2 (en) | Automatic correlation of dynamic system events within computing devices | |
| CN108491326B (en) | Test behavior a recombination process apparatus and storage medium | |
| CN115237444A (en) | Concurrent control method, device and equipment based on version number and storage medium | |
| CN111190915A (en) | Method for determining road tool identifier or role identifier, server and storage medium | |
| CN114265613B (en) | Method and system for differentially upgrading firmware of all electric control units of whole vehicle | |
| CN113687797B (en) | Disk management method, system, storage medium and equipment | |
| CN113885789A (en) | Method, system, device and medium for verifying data consistency after metadata repair | |
| CN113609160A (en) | B + tree traversal method, system, storage medium and equipment | |
| CN107315806B (en) | Embedded storage method and device based on file system | |
| CN111770158B (en) | Cloud platform recovery method and device, electronic equipment and computer readable storage medium | |
| CN110704412A (en) | Metadata repairing method, device, equipment and storage medium | |
| CN107797879A (en) | A kind of system configuration errors lookup method, device, equipment and storage medium | |
| CN112307022A (en) | Metadata repairing method and related device | |
| CN105069078A (en) | Method and apparatus for processing failure in merging of increment index | |
| CN106293897B (en) | Automatic scheduling system of subassembly | |
| CN113836051B (en) | Metadata space recovery method, device, equipment and storage medium | |
| CN110968267A (en) | Data management method, device, server and system | |
| CN109325496B (en) | Bullet screen checking method and device based on character removal, terminal and storage medium | |
| CN114020525B (en) | Fault isolation method, device, equipment and storage medium | |
| CN109086160B (en) | Table item checking device | |
| CN115543991B (en) | Data restoration method and device based on feature sampling and related equipment | |
| CN112445761B (en) | File checking method and device and storage medium | |
| CN107798002B (en) | Method for improving intelligent network charge interactive terminal data storage efficiency and security | |
| CN114090318A (en) | Fault processing method, device, server and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |