CN113553216A - Data recovery method and device, electronic equipment and storage medium - Google Patents
Data recovery method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113553216A CN113553216A CN202110719743.4A CN202110719743A CN113553216A CN 113553216 A CN113553216 A CN 113553216A CN 202110719743 A CN202110719743 A CN 202110719743A CN 113553216 A CN113553216 A CN 113553216A
- Authority
- CN
- China
- Prior art keywords
- usage information
- disk
- determining
- data
- source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000011084 recovery Methods 0.000 title claims abstract description 126
- 238000000034 method Methods 0.000 title claims abstract description 92
- 238000012545 processing Methods 0.000 claims abstract description 45
- 230000008569 process Effects 0.000 claims description 49
- 238000004590 computer program Methods 0.000 claims description 12
- 238000012217 deletion Methods 0.000 claims 1
- 230000037430 deletion Effects 0.000 claims 1
- 239000000126 substance Substances 0.000 claims 1
- 238000013473 artificial intelligence Methods 0.000 abstract description 11
- 238000010586 diagram Methods 0.000 description 13
- 238000005516 engineering process Methods 0.000 description 10
- 238000005457 optimization Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 230000001960 triggered effect Effects 0.000 description 8
- 230000000694 effects Effects 0.000 description 7
- 238000012544 monitoring process Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003924 mental process Effects 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1456—Hardware arrangements for backup
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present disclosure provides a data recovery method, an apparatus, an electronic device and a storage medium, and relates to the technical field of computers, in particular to the technical field of artificial intelligence such as cloud storage and big data processing. The specific implementation scheme is as follows: the method comprises the steps of determining current to-be-recovered homing group data in a distributed storage system, determining a source disk to which the homing group data belongs, determining first usage amount information corresponding to the source disk, determining second usage amount information corresponding to a target disk, and adding the current to-be-recovered homing group data into a data recovery queue if the first usage amount information and the second usage amount information meet set conditions.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to the field of artificial intelligence technologies such as cloud storage and big data processing, and in particular, to a data recovery method and apparatus, an electronic device, and a storage medium.
Background
Artificial intelligence is the subject of research that makes computers simulate some human mental processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), both at the hardware level and at the software level. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing, and the like; the artificial intelligence software technology mainly comprises a computer vision technology, a voice recognition technology, a natural language processing technology, machine learning/deep learning, a big data processing technology, a knowledge map technology and the like.
In the related art, when a disk is newly added to a distributed storage system, or after a certain disk is restarted due to a shutdown caused by power failure or the like, it is necessary to ensure that due data can be completely copied to the newly added disk.
Disclosure of Invention
The present disclosure provides a data recovery method, apparatus, electronic device, storage medium, and computer program product.
According to an aspect of the present disclosure, there is provided a data recovery method including: determining current to-be-recovered grouped data in the distributed storage system; determining a source disk to which the homing group data belongs; determining first usage information corresponding to the source disk, and determining second usage information corresponding to the target disk; and if the first usage information and the second usage information meet set conditions, adding the currently-to-be-recovered grouped data into a data recovery queue, wherein the added grouped data in the data recovery queue is used for being copied from the source disk to the target disk.
According to a second aspect of the present disclosure, there is provided a data recovery apparatus comprising: the first determination module is used for determining current to-be-recovered storage group data in the distributed storage system; a second determining module, configured to determine a source disk to which the homing group data belongs; a third determining module, configured to determine first usage information corresponding to the source disk, and determine second usage information corresponding to the target disk; and an adding module, configured to add the currently-to-be-restored grouped data to a data restoration queue when the first usage information and the second usage information satisfy a set condition, where the added grouped data in the data restoration queue is used to be copied from the source disk to the target disk.
According to a third aspect of the present disclosure, there is provided an electronic device comprising: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data recovery methods of the embodiments of the present disclosure.
According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the data recovery method disclosed by the embodiments of the present disclosure is presented.
According to a fifth aspect of the present disclosure, a computer program product is proposed, which comprises a computer program, which when executed by a processor implements the data recovery method disclosed in the embodiments of the present disclosure.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
FIG. 1 is a schematic diagram according to a first embodiment of the present disclosure;
FIG. 2 is a schematic diagram according to a second embodiment of the present disclosure;
FIG. 3 is a schematic diagram according to a third embodiment of the present disclosure;
FIG. 4 is a schematic diagram according to a fourth embodiment of the present disclosure;
FIG. 5 is a schematic diagram according to a fifth embodiment of the present disclosure;
FIG. 6 shows a schematic block diagram of an example electronic device that may be used to implement the data recovery methods of embodiments of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 is a schematic diagram according to a first embodiment of the present disclosure.
It should be noted that an execution main body of the data recovery method of this embodiment is a data recovery device, the device may be implemented by software and/or hardware, the device may be configured in an electronic device, and the electronic device may include, but is not limited to, a terminal, a server, and the like.
The embodiment of the disclosure relates to the technical field of artificial intelligence such as cloud storage and big data processing.
Wherein, Artificial Intelligence (Artificial Intelligence), english is abbreviated as AI. The method is a new technical science for researching and developing theories, methods, technologies and application systems for simulating, extending and expanding human intelligence.
Cloud Storage, a model of online Storage (CS), is to store data on multiple virtual servers, which are usually hosted by third parties.
The big data processing refers to a process of analyzing and processing large-scale data in an artificial intelligence mode, and the big data can be summarized into 5V, and has large data Volume (Volume), high speed (Velocity), multiple types (Velocity), Value (Value) and authenticity (Veracity).
As shown in fig. 1, the data recovery method includes:
s101: and determining the current to-be-recovered grouped data in the distributed storage system.
The distributed storage system is used for storing data on a plurality of independent devices in a distributed mode. The distributed network storage system adopts an expandable system structure, utilizes a plurality of storage servers to share the storage load, and utilizes the position server to position the storage information, thereby not only improving the reliability, the availability and the access efficiency of the system, but also being easy to expand.
In the distributed Storage system, each disk corresponds to an Object Storage Device (OSD) process, the OSD process is used for managing Object data on the disk, and the objects are stored by using place Group data (PG) as a Group. That is, a certain number (generally, more than 100) of the homing group data PG is contained in one object storage device OSD process, and the data of the user is stored into the object included in the homing group data PG.
In the embodiment of the present disclosure, the homing group data PG to be currently subjected to the recovery processing may be referred to as the homing group data to be currently recovered.
By way of example, whether an event exists may be listened to by a configuration module in the distributed storage system: currently, a disk needs to be newly added into the distributed storage system, or a certain disk is restarted due to outage and other reasons, and if the event is determined to exist, the homing group data PG to be recovered currently can be determined as the homing group data to be recovered currently.
For example, when determining the current to-be-recovered homing group data in the distributed storage system, it may specifically be to determine a disk identifier of the to-be-recovered disk, and locate the homing group data in the disk as the current to-be-recovered homing group data according to the disk identifier, which is not limited herein.
S102: and determining a source disk to which the homing group data belongs.
After determining the current to-be-recovered homing group data in the distributed storage system, the source disk to which the homing group data belongs may be determined, and the source disk may be an original disk corresponding to the scenario in which the homing group data PG is to be recovered to a newly added disk, or may be a disk that is restarted due to a shutdown caused by a power failure or the like in the scenario, or may be any other disk in the distributed storage system, which is not limited to this.
For example, when the configuration module in the distributed storage system determines the current homing group data to be restored, the configuration module may trigger the determination of the source disk to which the homing group data belongs in real time, determine the source disk identifier corresponding to the source disk, and then trigger the subsequent steps.
S103: and determining first usage information corresponding to the source disk and second usage information corresponding to the target disk.
In the embodiment of the disclosure, in the process of performing data recovery processing on a distributed storage system, a source disk to which currently-to-be-recovered homing group data belongs may be determined, then, first usage information corresponding to the source disk is triggered to be monitored, second usage information corresponding to a target disk is determined, and the first usage information and the second usage information are used to assist in determining the timing of the data recovery processing, so that the actual usage conditions of the source disk and the target disk can be effectively combined to assist in reasonably scheduling data recovery, an event that the disk rejects data recovery or rejects data writing is effectively avoided, and an event that the disk is completely written and stops being taken is effectively avoided.
The information describing the actual usage of the source disk may be referred to as first usage information, and the information describing the actual usage of the target disk may be referred to as second usage information, and the target disk may be a disk to which the currently-restored group data is to be restored, and the target disk may be, for example, a newly-added disk in the above scenario, or a disk that is restarted due to power failure or the like, which is not limited thereto.
The information of the actual usage situation may be, for example, the current remaining space amount of the disk, or the current used space amount, or relative information between the remaining space amount and the used space amount, which is not limited in this respect.
The first usage information and the second usage information may be configured adaptively according to actual data recovery scenarios, which is not limited to this.
In the embodiment of the disclosure, after determining the first usage information corresponding to the source disk and determining the second usage information corresponding to the target disk, it may be triggered to determine whether the first usage information and the second usage information satisfy the set condition, and then trigger the subsequent steps.
S104: and if the first usage information and the second usage information meet the set conditions, adding the currently-to-be-recovered grouped data into a data recovery queue, wherein the added grouped data in the data recovery queue is used for copying from the source disk to the target disk.
The setting condition may be a threshold value corresponding to the first usage amount information and the second usage amount information when the restoration processing is performed on the homing group data.
For example, when the first usage information and the second usage information satisfy the set condition, it may be determined that an event that the data recovery is rejected or the data writing is rejected by the disk may not occur when the homing group data is copied from the source disk to the target disk at this time, and when the first usage information and the second usage information do not satisfy the set condition, it may be determined that an event that the data recovery is rejected or the data writing is rejected by the disk may occur when the homing group data is copied from the source disk to the target disk at this time.
Based on the description of the above scenario, the setting condition may be set as: the first usage information indicates that the remaining space of the source disk is sufficient, and the second usage information indicates that the remaining space of the target disk is insufficient, which may be adaptively set according to the scene requirement of actual data recovery.
And the data recovery queue refers to a queue for storing the homing group data to be recovered, and the added homing group data in the data recovery queue can be used for being sequentially copied from the source disk to the target disk.
In this embodiment, by determining currently-to-be-recovered storage group data in a distributed storage system, determining a source disk to which the storage group data belongs, determining first usage information corresponding to the source disk, determining second usage information corresponding to a target disk, and adding the currently-to-be-recovered storage group data to a data recovery queue if the first usage information and the second usage information satisfy a set condition, where the added storage group data in the data recovery queue is used for being copied from the source disk to the target disk, and since data recovery is assisted by referring to the usage information of the source disk and the target disk, a disk full-write outage event can be effectively avoided, excessive disk resources are prevented from being occupied in a data recovery process, and efficiency of data recovery and a data recovery effect are effectively improved.
Fig. 2 is a schematic diagram according to a second embodiment of the present disclosure.
As shown in fig. 2, the data recovery method includes:
s201: and determining the current to-be-recovered grouped data in the distributed storage system.
By way of example, whether an event exists may be listened to by a configuration module in the distributed storage system: currently, a disk needs to be newly added into the distributed storage system, or a certain disk is restarted due to outage and other reasons, and if the event is determined to exist, the homing group data PG to be recovered currently can be determined as the homing group data to be recovered currently.
For example, when determining the current to-be-recovered homing group data in the distributed storage system, it may specifically be to determine a disk identifier of the to-be-recovered disk, and locate the homing group data in the disk as the current to-be-recovered homing group data according to the disk identifier, which is not limited herein.
S202: and determining a source disk to which the homing group data belongs.
After determining the current to-be-recovered homing group data in the distributed storage system, the source disk to which the homing group data belongs may be determined, and the source disk may be an original disk corresponding to the scenario in which the homing group data PG is to be recovered to a newly added disk, or may be a disk that is restarted due to a shutdown caused by a power failure or the like in the scenario, or may be any other disk in the distributed storage system, which is not limited to this.
For example, when the configuration module in the distributed storage system determines the current homing group data to be restored, the configuration module may trigger the determination of the source disk to which the homing group data belongs in real time, determine the source disk identifier corresponding to the source disk, and then trigger the subsequent steps.
S203: reference usage information for the distributed storage system is determined.
The information of the usage condition associated with the whole distributed storage system may be referred to as reference usage information, and the reference usage information may be, for example, a remaining space amount associated with the whole distributed storage system, or a current used space amount, or relative information between the remaining space amount and the used space amount, which is not limited in this respect.
In the embodiment of the present disclosure, statistical analysis may be performed on the usage information of each disk in the distributed storage system, so as to determine the information of the usage associated with the entire distributed storage system, as reference usage information, which may be used as a reference when a data recovery method is subsequently executed.
S204: and if the reference usage information is larger than the set threshold, determining first usage information corresponding to the source disk, and determining second usage information corresponding to the target disk.
The set threshold may be preset according to the storage performance of the distributed storage system, and when the reference usage information is greater than the set threshold, it indicates a cluster space corresponding to the distributed storage system, and the event may occur with a higher probability: currently, a disk needs to be newly added into a distributed storage system, or a certain disk is stopped and restarted due to power failure and other reasons.
Therefore, in the embodiment of the present disclosure, based on monitoring the information of the overall associated usage of the distributed storage system, when the reference usage information is greater than the set threshold, the optimization method of data recovery processing in the embodiment of the present disclosure may be directly triggered, timeliness of data recovery processing may be effectively guaranteed, and a trigger time of data recovery optimization processing may be determined by monitoring the information of the overall associated usage of the distributed storage system, which may also effectively avoid consumption of storage resources by the optimization processing logic, and improve rationality of data recovery optimization processing.
When the reference usage information of the distributed storage system is determined to be greater than the set threshold value based on the monitoring of the information of the overall associated usage of the distributed storage system, the determination of the first usage information corresponding to the source disk and the determination of the second usage information corresponding to the target disk may be triggered.
Optionally, in some embodiments, a source storage process corresponding to a source disk may be determined, a current usage rate of the source storage process may be determined, the current usage rate of the source storage process is used as first usage information, a target storage process corresponding to a target disk is determined, the current usage rate of the target storage process is determined, and the current usage rate of the target storage process is used as second usage information, so that accuracy and timeliness of determination of the first usage information and the second usage information may be effectively improved, and the current usage rate of the storage process corresponding to a disk is used as usage information of an affiliated disk, so that current usage information of the disk may be reasonably and accurately evaluated, and a higher reference value may be obtained, and an optimization effect of overall data recovery processing may be ensured.
The OSD process of the object storage device corresponding to the source disk may be referred to as a source storage process, the OSD process of the object storage device corresponding to the target disk may be referred to as a target storage process, a usage rate of the corresponding OSD process at the current time point may be referred to as a current usage rate, the current usage rate may be used to represent a situation that the OSD process corresponding to the disk is occupied at the current time point, and the current usage rate may be: the occupied space amount at the current time point is represented by the ratio of the whole space amount corresponding to the OSD process, and no limitation is made on the ratio.
S205: and determining the first residual amount of the residual storage space of the source disk according to the first usage amount information.
S206: and determining a second residual amount of the residual storage space of the target disk according to the second usage amount information.
After the first usage information corresponding to the source disk is determined and the second usage information corresponding to the target disk is determined, the first remaining amount of the remaining storage space of the source disk can be determined according to the first usage information, and the second remaining amount of the remaining storage space of the target disk can be determined according to the second usage information, so that a mode for reasonably determining the remaining storage space of the disk is provided.
For example, after determining the first usage information corresponding to the source disk and determining the second usage information corresponding to the target disk, the difference between the entire allowed storage space of the source disk and the first usage information may be used as the first remaining amount of the remaining storage space of the source disk, and the difference between the entire allowed storage space of the target disk and the second usage information may be used as the second remaining amount of the remaining storage space of the target disk, which is not limited herein.
S207: and if the first residual quantity is smaller than a first threshold value and the second residual quantity is larger than a second threshold value, determining that the first usage information and the second usage information meet the set condition, wherein the first threshold value and the second threshold value are different.
The above-mentioned determining, according to the first usage information, a first remaining amount of the remaining storage space of the source disk, and determining, according to the second usage information, a second remaining amount of the remaining storage space of the target disk, may compare the first remaining amount with a first threshold (the first threshold is a threshold for characterizing whether the remaining storage space of the source disk is relatively sufficient, and the first threshold is adaptively configurable), compare the second remaining amount with a second threshold (the second threshold is a threshold for characterizing whether the remaining storage space of the target disk is relatively sufficient, and the second threshold is adaptively configurable), if the first remaining amount is smaller than the first threshold and the second remaining amount is greater than the second threshold, it indicates that the remaining storage space of the source disk is relatively tight, and the remaining storage space of the target disk is relatively large, and at this time, the probability of the disk-full-writing and service-stopping event is small, therefore, the first usage information and the second usage information can be determined to meet the set conditions, and the subsequent steps can be triggered.
The first threshold value may be configured to be different from the second threshold value, for example, the first threshold value may be configured to be smaller than the second threshold value.
S208: and if the first usage information and the second usage information meet the set conditions, adding the currently-to-be-recovered grouped data into a data recovery queue, wherein the added grouped data in the data recovery queue is used for copying from the source disk to the target disk.
In this embodiment, it is supported that the filtered target OSD process belongs to the group data PG having more remaining space and the source OSD process belongs to the group data PG having less space remaining, and first, the group data PG is added into the data recovery queue to recover data, and it is also considered that after one group data PG is recovered, the backup of the group data PG on the source disk to which the source OSD process belongs is removed, and the space above the source OSD process is released to increase the remaining space, so that the cluster space corresponding to the distributed storage system is alleviated, and the space usage is increased in the data recovery process to cause the occurrence of the event that the target OSD process is full of data.
In addition, the embodiment of the present disclosure may also flexibly schedule the order in the data recovery queue according to the source OSD process of the source disk to which the to-be-recovered group data PG belongs at each time and the remaining space corresponding to the target OSD process of the target disk until the data recovery is completed.
Therefore, in the embodiment of the present disclosure, a first remaining amount of a remaining storage space of a source disk is determined according to first usage information, a second remaining amount of a remaining storage space of a target disk is determined according to second usage information, and if the first remaining amount is smaller than a first threshold and the second remaining amount is greater than a second threshold, it is determined that the first usage information and the second usage information satisfy a setting condition, where the first threshold and the second threshold are different, so that when the target disk in a distributed storage system indicates that the storage space thereof is relatively large, it may be directly triggered to write currently-to-be-restored grouped data into a data restoration queue, and schedule the currently-to-be-restored grouped data with reference to the usage information of the source disk and the target disk (the usage information may be determined with reference to a current usage rate of an OSD process corresponding to the disks), therefore, the reconstruction sequence of the reset group data corresponding to the OSD process is intelligently adjusted, and the occurrence of the event that partial disk is full and data cannot be written due to uneven disk space occupation is effectively avoided.
S209: and if the second residual quantity is smaller than a third threshold value, stopping the recovery processing of the currently to-be-recovered grouped data, wherein the third threshold value is smaller than the second threshold value.
In the embodiment of the present disclosure, a data recovery rollback mechanism is further provided, that is, whether a second remaining amount of a target OSD process corresponding to a target disk is smaller than a third threshold (the third threshold is a threshold used for characterizing whether a remaining storage space of the target disk is relatively sufficient, the third threshold is adaptively configurable, and the third threshold is smaller than the second threshold), and if the second remaining amount is smaller than the third threshold, it indicates that the remaining space corresponding to the target disk is insufficient, and the recovery processing on the currently to-be-recovered homing group data may be stopped.
S210: and deleting the recovered part of the homing group data in the target disk.
When the residual space corresponding to the target disk is judged to be insufficient, the recovery processing of the currently-to-be-recovered grouped data can be stopped, and the recovered partial grouped data in the target disk is deleted, so that when the disk full-write outage event is determined to be about to occur, the resources of the target disk can be preferentially released, the recovery processing of the grouped data is waited to be tried next time, the space is released, and the occurrence of resource deadlock events is avoided.
S211: and acquiring a plurality of third usage information respectively corresponding to a plurality of candidate disks in the distributed storage system.
That is, when it is determined that the remaining space corresponding to the target disk is insufficient, the recovery processing on the currently-to-be-recovered homing group data may be stopped, and after a portion of the homing group data that has been recovered in the target disk is deleted, the target disk may be reselected from the distributed storage system to support the processing logic for recovering the homing group data anew.
In the embodiment of the present disclosure, a plurality of usage amount information (the plurality of usage amount information may be referred to as third usage amount information, and a specific obtaining manner may refer to the above embodiment together, which is not limited to this), which respectively correspond to a plurality of candidate disks in a distributed storage system, may be obtained, and then a new target disk with a sufficient remaining space is selected based on the plurality of usage amount information.
S212: and selecting a new target disk from the candidate disks according to the third usage information, and taking the new target disk as the target disk.
The new target disk may be a disk with sufficient remaining space in the distributed storage system, which is not limited to this, and then, the new target disk may be used as a target disk for restoring the homing group data to support the processing logic for restoring the homing group data.
Therefore, by acquiring the third usage information corresponding to the candidate disks in the distributed storage system, selecting a new target disk from the candidate disks according to the third usage information, and taking the new target disk as the target disk, the orderly execution of the grouped data recovery processing logic is guaranteed, and the accuracy of data recovery processing and the data recovery processing effect are guaranteed.
In the embodiment, the data recovery is assisted by referring to the usage information of the source disk and the target disk, so that a disk full-writing outage event can be effectively avoided, excessive disk resources are prevented from being occupied in the data recovery process, and the data recovery efficiency and the data recovery effect are effectively improved. Based on monitoring the information of the integrally associated use condition of the distributed storage system, when the reference use amount information is greater than a set threshold, the optimization method for data recovery processing in the embodiment of the disclosure can be directly triggered, so that the timeliness of the data recovery processing can be effectively guaranteed, the trigger time of the data recovery optimization processing is determined by monitoring the information of the integrally associated use condition of the distributed storage system, the consumption of the optimization processing logic on the storage resources can be effectively avoided, and the rationality of the data recovery optimization processing is improved. The accuracy and timeliness of the determination of the first usage information and the second usage information can be effectively improved, the current utilization rate of the storage process corresponding to the disk is used as the usage information of the disk, the current usage information of the disk can be reasonably and accurately evaluated, and the method has high reference value, so that the optimization effect of the whole data recovery processing can be guaranteed. When the residual space corresponding to the target disk is judged to be insufficient, the recovery processing of the currently-to-be-recovered grouped data can be stopped, and the recovered partial grouped data in the target disk is deleted, so that when the disk full-write outage event is determined to be about to occur, the resources of the target disk are preferentially released, the recovery processing of the grouped data is waited to be tried next time, the space is released, and the occurrence of resource deadlock events is avoided.
Fig. 3 is a schematic diagram according to a third embodiment of the present disclosure.
As shown in fig. 3, the data recovery method includes:
s301: and determining the current to-be-recovered grouped data in the distributed storage system.
S302: and determining a source disk to which the homing group data belongs.
S303: and determining first usage information corresponding to the source disk and second usage information corresponding to the target disk.
S304: and if the first usage information and the second usage information meet the set conditions, adding the currently-to-be-recovered grouped data into a data recovery queue, wherein the added grouped data in the data recovery queue is used for copying from the source disk to the target disk.
For the examples of S301 to S304, reference may be made to the above embodiments, which are not described herein again.
S305: and reading the added homing group data from the data recovery queue, and copying the read added homing group data into the target disk.
Wherein a queue is a special linear table that allows a delete operation at the front end (front) of the table and an insert operation at the back end (rear) of the table, as in a stack, a queue is a linear table with restricted operations, the end where an insert operation is performed is called the tail of the queue and the end where a delete operation is performed is called the head of the queue.
In the embodiment of the present disclosure, after the current homing group data to be recovered is added to the data recovery queue according to the usage information of the source disk and the target disk, each added homing group data may be scheduled from the data recovery queue by a scheduling algorithm, the read added homing group data may be copied to the target disk according to the ranking order, and then the subsequent steps may be triggered.
S306: and deleting the currently-to-be-restored homing group data from the source disk.
The added homing group data is scheduled from the data recovery queue by the scheduling algorithm, the read added homing group data is copied to the target disk according to the arrangement sequence, and then the current homing group data to be recovered can be deleted from the source disk, so that the integrity and the continuity of data recovery processing logic are realized, the recovery scheduling of the homing group data is controlled from the dimension of the service conditions of the source disk and the target disk, the data recovery queue is used for ensuring the orderly data recovery, the operation storage resources occupied by the current homing group data to be recovered in the source disk can be timely and effectively released, and the efficiency of data recovery is greatly improved.
In this embodiment, by determining currently-to-be-recovered storage group data in a distributed storage system, determining a source disk to which the storage group data belongs, determining first usage information corresponding to the source disk, determining second usage information corresponding to a target disk, and adding the currently-to-be-recovered storage group data to a data recovery queue if the first usage information and the second usage information satisfy a set condition, where the added storage group data in the data recovery queue is used for being copied from the source disk to the target disk, and since data recovery is assisted by referring to the usage information of the source disk and the target disk, a disk full-write outage event can be effectively avoided, excessive disk resources are prevented from being occupied in a data recovery process, and efficiency of data recovery and a data recovery effect are effectively improved. The integrity and the continuity of data recovery processing logic are realized, the recovery scheduling of the homing group data is controlled from the dimension of the service conditions of the source disk and the target disk, the data recovery queue is used for ensuring the orderly data recovery, the operation storage resources occupied by the current homing group data to be recovered in the source disk can be timely and effectively released, and the data recovery efficiency is greatly improved.
Fig. 4 is a schematic diagram according to a fourth embodiment of the present disclosure.
As shown in fig. 4, the data recovery apparatus 40 includes:
a first determining module 401, configured to determine currently-to-be-restored homing group data in the distributed storage system;
a second determining module 402, configured to determine a source disk to which the homing group data belongs;
a third determining module 403, configured to determine first usage information corresponding to the source disk, and determine second usage information corresponding to the target disk; and
an adding module 404, configured to add the currently-to-be-recovered grouped data to a data recovery queue when the first usage information and the second usage information satisfy a set condition, where the added grouped data in the data recovery queue is used to be copied from the source disk to the target disk.
In some embodiments of the present disclosure, as shown in fig. 5, fig. 5 is a schematic diagram according to a fifth embodiment of the present disclosure, the data recovery apparatus 50 includes: a first determining module 501, a second determining module 502, a third determining module 503, and an adding module 504, wherein the third determining module 503 is specifically configured to:
determining reference usage information for the distributed storage system;
and if the reference usage information is larger than a set threshold, determining first usage information corresponding to the source disk.
In some embodiments of the present disclosure, the third determining module 503 is specifically configured to:
determining a source storage process corresponding to the source disk;
determining the current utilization rate of the source storage process, and taking the current utilization rate of the source storage process as the first usage information;
determining a target storage process corresponding to the target disk; and
and determining the current utilization rate of the target storage process, and taking the current utilization rate of the target storage process as the second usage information.
In some embodiments of the present disclosure, the data recovery apparatus 50 further includes:
a fourth determining module 505, configured to determine, according to the first usage information, a first remaining amount of the remaining storage space of the source disk after determining the first usage information corresponding to the source disk and determining the second usage information corresponding to the target disk;
a fifth determining module 506, configured to determine a second remaining amount of the remaining storage space of the target disk according to the second usage information;
a sixth determining module 507, configured to determine that the first usage information and the second usage information meet the setting condition when the first remaining amount is smaller than a first threshold and the second remaining amount is greater than a second threshold, where the first threshold is different from the second threshold.
In some embodiments of the present disclosure, the data recovery apparatus 50 further includes:
a reading module 508, configured to read added homing group data from the data recovery queue, and copy the read added homing group data to the target disk;
a first deleting module 509, configured to delete the currently to-be-restored homing group data from the source disk.
In some embodiments of the present disclosure, the data recovery apparatus 50 further includes:
a stopping module 510, configured to stop, when the second remaining amount is smaller than a third threshold, a recovery process on the currently-to-be-recovered homing group data, where the third threshold is smaller than the second threshold;
a second deleting module 511, configured to delete the recovered part of the homing data in the target disk.
In some embodiments of the present disclosure, the data recovery apparatus 50 further includes:
an obtaining module 512, configured to obtain, after the part of the storage group data restored in the target disk is deleted, a plurality of third usage amounts information respectively corresponding to a plurality of candidate disks in the distributed storage system;
a selecting module 513, configured to select a new target disk from the multiple candidate disks according to the multiple third usage information, and use the new target disk as the target disk.
It is understood that the data recovery apparatus 50 in fig. 5 of the present embodiment and the data recovery apparatus 40 in the foregoing embodiment, the first determining module 501 and the first determining module 401 in the foregoing embodiment, the second determining module 502 and the second determining module 402 in the foregoing embodiment, the third determining module 503 and the third determining module 403 in the foregoing embodiment, and the adding module 504 and the adding module 404 in the foregoing embodiment may have the same functions and structures.
It should be noted that the explanation of the data recovery method described above is also applicable to the data recovery apparatus of the present embodiment, and is not repeated here.
In the embodiment, by determining currently-to-be-recovered storage group data in a distributed storage system, determining a source disk to which the storage group data belongs, determining first usage information corresponding to the source disk, determining second usage information corresponding to a target disk, and adding the currently-to-be-recovered storage group data to a data recovery queue if the first usage information and the second usage information meet set conditions, due to the fact that data recovery is assisted by referring to the usage information of the source disk and the target disk, a disk write-over and servo-down event can be effectively avoided, excessive disk resources are avoided being occupied in a data recovery process, and data recovery efficiency and data recovery effect are effectively improved.
The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.
FIG. 6 shows a schematic block diagram of an example electronic device that may be used to implement the data recovery methods of embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 6, the apparatus 600 includes a computing unit 601, which can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)602 or a computer program loaded from a storage unit 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the device 600 can also be stored. The calculation unit 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
A number of components in the device 600 are connected to the I/O interface 605, including: an input unit 606 such as a keyboard, a mouse, or the like; an output unit 607 such as various types of displays, speakers, and the like; a storage unit 608, such as a magnetic disk, optical disk, or the like; and a communication unit 609 such as a network card, modem, wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The computing unit 601 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The calculation unit 601 performs the respective methods and processes described above, such as the data recovery method. For example, in some embodiments, the data recovery method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 600 via the ROM 602 and/or the communication unit 609. When the computer program is loaded into the RAM 603 and executed by the computing unit 601, one or more steps of the data recovery method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to perform the data recovery method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), the internet, and blockchain networks.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The Server can be a cloud Server, also called a cloud computing Server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service ("Virtual Private Server", or simply "VPS"). The server may also be a server of a distributed system, or a server incorporating a blockchain.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and the present disclosure is not limited herein.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.
Claims (17)
1. A method of data recovery, comprising:
determining current to-be-recovered grouped data in the distributed storage system;
determining a source disk to which the homing group data belongs;
determining first usage information corresponding to the source disk, and determining second usage information corresponding to the target disk; and
and if the first usage information and the second usage information meet set conditions, adding the currently-to-be-recovered grouped data into a data recovery queue, wherein the added grouped data in the data recovery queue is used for being copied from the source disk to the target disk.
2. The method of claim 1, wherein the determining the first usage information corresponding to the source disk comprises:
determining reference usage information for the distributed storage system;
and if the reference usage information is larger than a set threshold, determining first usage information corresponding to the source disk.
3. The method of claim 1, wherein the determining first usage information corresponding to the source disk and determining second usage information corresponding to the target disk comprises:
determining a source storage process corresponding to the source disk;
determining the current utilization rate of the source storage process, and taking the current utilization rate of the source storage process as the first usage information;
determining a target storage process corresponding to the target disk; and
and determining the current utilization rate of the target storage process, and taking the current utilization rate of the target storage process as the second usage information.
4. The method according to claim 1, after determining the first usage information corresponding to the source disk and determining the second usage information corresponding to the target disk, further comprising:
determining a first residual amount of the residual storage space of the source disk according to the first usage amount information;
determining a second residual amount of the residual storage space of the target disk according to the second usage amount information;
and if the first residual quantity is smaller than a first threshold value and the second residual quantity is larger than a second threshold value, determining that the first usage information and the second usage information meet the set condition, wherein the first threshold value and the second threshold value are different.
5. The method of claim 1, further comprising:
reading added homing group data from the data recovery queue, and copying the read added homing group data into the target disk;
and deleting the current to-be-recovered homing group data from the source disk.
6. The method of claim 4, further comprising:
if the second residual quantity is smaller than a third threshold value, stopping the recovery processing of the currently to-be-recovered grouped data, wherein the third threshold value is smaller than the second threshold value;
and deleting the recovered part of the homing group data in the target disk.
7. The method of claim 6, further comprising, after the deleting the recovered portion of the homing group data in the target disk:
acquiring a plurality of third usage information respectively corresponding to a plurality of candidate disks in the distributed storage system;
and selecting a new target disk from the candidate disks according to the third usage information, and taking the new target disk as the target disk.
8. A data recovery apparatus comprising:
the first determination module is used for determining current to-be-recovered storage group data in the distributed storage system;
a second determining module, configured to determine a source disk to which the homing group data belongs;
a third determining module, configured to determine first usage information corresponding to the source disk, and determine second usage information corresponding to the target disk; and
and an adding module, configured to add the currently-to-be-recovered grouped data to a data recovery queue when the first usage information and the second usage information satisfy a set condition, where the added grouped data in the data recovery queue is used to be copied from the source disk to the target disk.
9. The apparatus of claim 8, wherein the third determining module is specifically configured to:
determining reference usage information for the distributed storage system;
and if the reference usage information is larger than a set threshold, determining first usage information corresponding to the source disk.
10. The apparatus of claim 8, wherein the third determining module is specifically configured to:
determining a source storage process corresponding to the source disk;
determining the current utilization rate of the source storage process, and taking the current utilization rate of the source storage process as the first usage information;
determining a target storage process corresponding to the target disk; and
and determining the current utilization rate of the target storage process, and taking the current utilization rate of the target storage process as the second usage information.
11. The apparatus of claim 8, further comprising:
a fourth determining module, configured to determine, according to the first usage information, a first remaining amount of a remaining storage space of the source disk after determining the first usage information corresponding to the source disk and determining the second usage information corresponding to the target disk;
a fifth determining module, configured to determine, according to the second usage information, a second remaining amount of the remaining storage space of the target disk;
a sixth determining module, configured to determine that the first usage information and the second usage information satisfy the setting condition when the first remaining amount is smaller than a first threshold and the second remaining amount is larger than a second threshold, where the first threshold is different from the second threshold.
12. The apparatus of claim 8, further comprising:
the reading module is used for reading the added homing group data from the data recovery queue and copying the read added homing group data into the target disk;
and the first deleting module is used for deleting the current to-be-recovered storage group data from the source disk.
13. The apparatus of claim 11, further comprising:
a stopping module, configured to stop recovery processing on the current to-be-recovered homing group data when the second remaining amount is smaller than a third threshold, where the third threshold is smaller than the second threshold;
and the second deleting module is used for deleting the recovered part of the homing group data in the target disk.
14. The apparatus of claim 13, further comprising:
an obtaining module, configured to obtain, after the deletion of the recovered part of the grouped data in the target disk, a plurality of pieces of third usage information respectively corresponding to a plurality of candidate disks in the distributed storage system;
and the selecting module is used for selecting a new target disk from the candidate disks according to the third usage information and taking the new target disk as the target disk.
15. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.
16. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-7.
17. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110719743.4A CN113553216B (en) | 2021-06-28 | 2021-06-28 | Data recovery method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110719743.4A CN113553216B (en) | 2021-06-28 | 2021-06-28 | Data recovery method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113553216A true CN113553216A (en) | 2021-10-26 |
| CN113553216B CN113553216B (en) | 2024-06-28 |
Family
ID=78131020
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110719743.4A Active CN113553216B (en) | 2021-06-28 | 2021-06-28 | Data recovery method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113553216B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114221975A (en) * | 2021-11-30 | 2022-03-22 | 浙江大华技术股份有限公司 | Cloud storage data recovery method and device based on SMR disk and electronic equipment |
| CN117762892A (en) * | 2023-12-22 | 2024-03-26 | 柏域信息科技（上海）有限公司 | Data distribution control method, device, terminal and medium of distributed storage system |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006030339A2 (en) * | 2004-09-13 | 2006-03-23 | Koninklijke Philips Electronics N.V. | Method of managing a distributed storage system |
| CN102750195A (en) * | 2012-06-07 | 2012-10-24 | 浪潮电子信息产业股份有限公司 | Method for cluster file system data fault tolerance |
| CN104067237A (en) * | 2012-01-25 | 2014-09-24 | 惠普发展公司，有限责任合伙企业 | Storage system device management |
| CN106528328A (en) * | 2016-10-10 | 2017-03-22 | 乐视控股（北京）有限公司 | Data recovery method, device and system based on distributed storage system |
| CN108197159A (en) * | 2017-12-11 | 2018-06-22 | 厦门集微科技有限公司 | Digital independent, wiring method and device based on distributed file system |
| US20190042345A1 (en) * | 2017-08-07 | 2019-02-07 | International Business Machines Corporation | Fault detection and recovery in a distributed storage network |
| CN109614268A (en) * | 2018-12-10 | 2019-04-12 | 浪潮(北京)电子信息产业有限公司 | A kind of restoration methods of cloud Backup Data, apparatus and system |
| CN111290880A (en) * | 2020-01-21 | 2020-06-16 | 苏州浪潮智能科技有限公司 | OSD data recovery method, device, equipment and medium |
| CN111625402A (en) * | 2020-05-28 | 2020-09-04 | 北京金山云网络技术有限公司 | Data recovery method and device, electronic equipment and computer readable storage medium |
| CN112328173A (en) * | 2020-10-27 | 2021-02-05 | 中国建设银行股份有限公司 | Distributed storage system disk fault repairing method and device |
| CN112433881A (en) * | 2020-10-29 | 2021-03-02 | 苏州浪潮智能科技有限公司 | Data recovery method and device for distributed storage system |
| CN112506710A (en) * | 2020-12-16 | 2021-03-16 | 深信服科技股份有限公司 | Distributed file system data repair method, device, equipment and storage medium |
| CN112882863A (en) * | 2021-02-23 | 2021-06-01 | 中国工商银行股份有限公司 | Method, device and system for recovering data and electronic equipment |
-
2021
- 2021-06-28 CN CN202110719743.4A patent/CN113553216B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006030339A2 (en) * | 2004-09-13 | 2006-03-23 | Koninklijke Philips Electronics N.V. | Method of managing a distributed storage system |
| CN104067237A (en) * | 2012-01-25 | 2014-09-24 | 惠普发展公司，有限责任合伙企业 | Storage system device management |
| CN102750195A (en) * | 2012-06-07 | 2012-10-24 | 浪潮电子信息产业股份有限公司 | Method for cluster file system data fault tolerance |
| CN106528328A (en) * | 2016-10-10 | 2017-03-22 | 乐视控股（北京）有限公司 | Data recovery method, device and system based on distributed storage system |
| US20190042345A1 (en) * | 2017-08-07 | 2019-02-07 | International Business Machines Corporation | Fault detection and recovery in a distributed storage network |
| CN108197159A (en) * | 2017-12-11 | 2018-06-22 | 厦门集微科技有限公司 | Digital independent, wiring method and device based on distributed file system |
| CN109614268A (en) * | 2018-12-10 | 2019-04-12 | 浪潮(北京)电子信息产业有限公司 | A kind of restoration methods of cloud Backup Data, apparatus and system |
| CN111290880A (en) * | 2020-01-21 | 2020-06-16 | 苏州浪潮智能科技有限公司 | OSD data recovery method, device, equipment and medium |
| CN111625402A (en) * | 2020-05-28 | 2020-09-04 | 北京金山云网络技术有限公司 | Data recovery method and device, electronic equipment and computer readable storage medium |
| CN112328173A (en) * | 2020-10-27 | 2021-02-05 | 中国建设银行股份有限公司 | Distributed storage system disk fault repairing method and device |
| CN112433881A (en) * | 2020-10-29 | 2021-03-02 | 苏州浪潮智能科技有限公司 | Data recovery method and device for distributed storage system |
| CN112506710A (en) * | 2020-12-16 | 2021-03-16 | 深信服科技股份有限公司 | Distributed file system data repair method, device, equipment and storage medium |
| CN112882863A (en) * | 2021-02-23 | 2021-06-01 | 中国工商银行股份有限公司 | Method, device and system for recovering data and electronic equipment |
Non-Patent Citations (2)
| Title |
|---|
| 丛伟;盛亚如;咸国富;程云祥;尹丰钊;张丽强;: "基于智能配电终端的分布式供电恢复方法", 电力系统自动化, no. 15, 10 August 2018 (2018-08-10) * |
| 刘冰星;邓玉辉;: "一种网络编码分布式存储系统中的数据更新策略", 小型微型计算机系统, no. 03, 15 March 2017 (2017-03-15) * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114221975A (en) * | 2021-11-30 | 2022-03-22 | 浙江大华技术股份有限公司 | Cloud storage data recovery method and device based on SMR disk and electronic equipment |
| CN114221975B (en) * | 2021-11-30 | 2024-01-30 | 浙江大华技术股份有限公司 | Cloud storage data recovery method and device based on SMR disk and electronic equipment |
| CN117762892A (en) * | 2023-12-22 | 2024-03-26 | 柏域信息科技（上海）有限公司 | Data distribution control method, device, terminal and medium of distributed storage system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113553216B (en) | 2024-06-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10261874B2 (en) | Enabling a cloud controller to communicate with power systems | |
| CN113553216B (en) | Data recovery method and device, electronic equipment and storage medium | |
| CN112540731B (en) | Data append writing method, device, equipment, medium and program product | |
| CN113364877B (en) | Data processing method, device, electronic equipment and medium | |
| CN112667403B (en) | Scheduling method and device of server and electronic equipment | |
| CN115150471A (en) | Data processing method, device, equipment, storage medium and program product | |
| CN115291806A (en) | Processing method, processing device, electronic equipment and storage medium | |
| CN113590329A (en) | Resource processing method and device | |
| CN112783447A (en) | Method, apparatus, device, medium, and article of manufacture for processing snapshots | |
| CN114518848B (en) | Method, device, equipment and medium for processing stored data | |
| US12007965B2 (en) | Method, device and storage medium for deduplicating entity nodes in graph database | |
| CN115981808A (en) | Scheduling method, scheduling device, computer equipment and storage medium | |
| CN114500443A (en) | Message pushing method, device, system, electronic equipment and storage medium | |
| CN114564149A (en) | Data storage method, device, equipment and storage medium | |
| CN115454344A (en) | Data storage method and device, electronic equipment and storage medium | |
| CN115454958A (en) | Data processing method, device, equipment, system and medium based on artificial intelligence | |
| CN112860796B (en) | Method, apparatus, device and storage medium for synchronizing data | |
| CN109189746B (en) | Method, device, equipment and storage medium for realizing universal stream type Shuffle engine | |
| CN113722389B (en) | Data management method, device, electronic equipment and computer readable storage medium | |
| CN115604354B (en) | Transaction processing method, device and equipment based on block chain and storage medium | |
| CN114546705B (en) | Operation response method, operation response device, electronic apparatus, and storage medium | |
| CN117082046A (en) | Data uploading method, device, equipment and storage medium | |
| CN113220233A (en) | Data reading method, device and system | |
| CN115390992A (en) | Virtual machine creating method, device, equipment and storage medium | |
| CN113282571A (en) | Data transfer method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |