WO2015101084A1 - Procédé, serveur et système de récupération de données - Google Patents

Procédé, serveur et système de récupération de données Download PDF

Info

Publication number
WO2015101084A1
WO2015101084A1 PCT/CN2014/088962 CN2014088962W WO2015101084A1 WO 2015101084 A1 WO2015101084 A1 WO 2015101084A1 CN 2014088962 W CN2014088962 W CN 2014088962W WO 2015101084 A1 WO2015101084 A1 WO 2015101084A1
Authority
WO
WIPO (PCT)
Prior art keywords
log file
recovery log
server
data
information
Prior art date
Application number
PCT/CN2014/088962
Other languages
English (en)
Chinese (zh)
Inventor
郝志敏
李红
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2015101084A1 publication Critical patent/WO2015101084A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1471—Saving, restoring, recovering or retrying involving logging of persistent data for recovery

Definitions

  • the present invention relates to the field of information technology, and in particular, to a method, a server, and a system for recovering data.
  • the first method is to scan the file system by the fsck command to find the data to be recovered and restore the data to be recovered.
  • the second method is: reading the log information of the data to be restored in the system operation log through the metadata server, and controlling the data server to perform the operation on the data according to the read log information of the data to be restored, thereby restoring the data.
  • the third method is: reading the log information of the data to be restored through the metadata server, and controlling the data server to perform the operation on the data according to the read log information to be restored, thereby restoring the data.
  • the first way is to scan all the data, causing a waste of system resources.
  • the second and third methods require the metadata server to recover data, while the metadata server recovers data at a slower rate, resulting in less efficient data recovery.
  • the embodiment of the invention provides a method, a server and a system for restoring data, which can solve the problems of the prior art.
  • the technical solution is as follows:
  • a method for recovering data is provided, the method being applied to a primary server of a storage system, the storage system including a primary server and a secondary server, both the primary server and the secondary server are configured to store the same data
  • the primary server is the first server that successfully stores data, and the method includes:
  • the primary server When any one of the storage systems fails to store data, the primary server is Each of the storage systems sends a log obtaining request, where the log obtaining request carries the data identifier to be restored;
  • each first recovery log file records location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier
  • the second recovery log file is generated by the primary server, and records location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier.
  • the method before the sending a log obtaining request to the server in the storage system, the method further includes:
  • the total write status information sent by the client includes the write failure information, determining that the data sent by the client is the data to be restored, and generating the second location information and the operation information for recording the data to be restored. Restore the log file.
  • the performing the data to be restored according to the latest operation information in the operation information recorded by all the first recovery log file and the second recovery log file Operations including:
  • the index information includes a recovery log file identifier, an offset information, and data length information, where the preset structure stores index information and an operation time;
  • the determining whether the index information of the currently read recovery log file is in a preset structure also includes:
  • the operation time of the currently read recovery log file and the operation time of the index information corresponding to the currently read recovery log file in the preset structure Compare;
  • the operation time of the currently read recovery log file is later than the operation time of the index information corresponding to the currently read recovery log file in the preset structure, the operation time of the currently read recovery log file is replaced with the preset structure and The operation time corresponding to the index information of the currently read recovery log file, and the step of continuing to read the next recovery log file.
  • obtaining the preset The index information in the structure and the recovery log file corresponding to the operation time, including:
  • index information of the recovery log file that is currently read is the same as the index information of the currently read recovery log file, compare the operation time of the currently read recovery log file with the currently read recovery log in the preset structure.
  • the operation time of the index information of the file is the same as the index information of the currently read recovery log file
  • the currently read recovery log file is added to the filtered Restore the log file and read the next recovery log file;
  • the recovering the information corresponding to the index information and the operation time in the preset structure After the complex log file is used as the filtered recovery log file, it also includes:
  • the filtered recovery log file is sent to each slave server, and the data to be recovered is restored by each slave server according to the filtered recovery log file.
  • a method for recovering data is provided, the method being applied to a primary server of a storage system, the storage system including the primary server and a secondary server, the primary server and the secondary server are both used for storage The same data, the primary server is the first server to successfully store data, and the method includes:
  • a first recovery log file according to the log obtaining request, and causing the primary server to recover the to-be-recovered data according to the first recovery log file and the second recovery log file generated by the primary server;
  • the first recovery log file and the second recovery log file respectively record location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier.
  • the method before the returning the first recovery log file to the primary server according to the log obtaining request, the method further includes:
  • Second write status information including an identification identifier of the data, where the second write status information includes write success information or write failure information;
  • the total write status information sent by the client includes the write failure information, determining that the data sent by the client is the data to be restored, and generating the first location information and the operation information for recording the data to be restored. Complex log file.
  • the method further includes:
  • a server for recovering data is provided, the server being a primary server applied to a storage system, the storage system including the primary server and a secondary server, the primary server and the secondary server are both used The same data is stored, and the primary server is the first server that successfully stores data, and the server includes:
  • a first sending module configured to send a log obtaining request to each of the slave servers in the storage system when the storage of the data in the storage system fails, where the log obtaining request carries the data identifier to be restored;
  • a first receiving module configured to receive a first recovery log file returned by each slave server according to the log obtaining request, where each first recovery log file records location information of the to-be-recovered data identified by the to-be-recovered data identifier and Operational information;
  • a recovery module configured to perform, according to the latest operation information in the operation information recorded by the first recovery log file and the second recovery log file, the data to be restored according to the location information of the data to be restored
  • the second recovery log file is generated by the primary server, and the location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier are recorded.
  • the server further includes:
  • a storage module configured to receive and store data sent by the client
  • a returning module configured to return, to the client, first write state information that includes an identifier of the data, where the first write state information includes write success information or write failure information;
  • a second receiving module configured to receive total write status information sent by the client, where the total write status information includes first write status information returned by the primary server to the client, and each slave server Second write status information returned to the client;
  • a generating module configured to: when the total write status information sent by the client includes the write failure information, determine that the data sent by the client is the data to be restored, and generate location information that records the to-be-recovered data and The second recovery log file of the operation information.
  • the recovery module includes:
  • a first reading unit configured to sequentially read each of the first recovery log file and the second recovery log file
  • a determining unit configured to determine whether the index information of the currently read recovery log file is in a preset structure
  • the index information includes a recovery log file identifier, an offset information, and data length information, where the preset structure is used to store index information and an operation time;
  • An adding unit configured to add index information and an operation time of the currently read recovery log file to the preset structure when the index information of the currently read recovery log file is not in the preset structure
  • a second reading unit configured to continue to read the next recovery log file
  • a processing unit configured to process the read next recovery log file in a manner of processing the currently read recovery log file, until the last recovery log file is processed, to obtain a preset structure for storing the duplicate index information and the operation time;
  • An obtaining unit configured to acquire a recovery log file corresponding to the index information and the operation time in the preset structure, and use the recovery log file corresponding to the index information and the operation time in the preset structure as the filtered recovery Log file
  • a recovery unit configured to operate on the restored data according to the operation information in the filtered recovery log file.
  • the recovery module further includes:
  • a comparison unit configured to: when the index information of the currently read recovery log file is in the preset structure, the operation time of the currently read recovery log file and the correspondingly read recovery log file in the preset structure The operation time of the index information is compared;
  • a replacement unit configured to replace the operation time of the currently read recovery log file when the operation time of the currently read recovery log file is later than the operation time of the index information corresponding to the currently read recovery log file in the preset structure The operation time in the preset structure corresponding to the index information of the currently read recovery log file;
  • the second reading unit is further configured to perform the step of continuing to read the next recovery log file.
  • the acquiring unit includes :
  • a first reading subunit configured to sequentially read the first recovery log file and a second recovery log file corresponding to the to-be-recovered data identifier
  • the comparison subunit is configured to compare the index information of the currently read recovery log file with the index information in the preset structure
  • a comparison subunit configured to: when the index information of the recovery log file currently read is the same as the index information of the currently read recovery log file, compare the operation time of the currently read recovery log file with the preset structure The operation time of the index information of the currently read recovery log file;
  • Adding a subunit configured to: when the operation time of the index information corresponding to the currently read recovery log file is the same as the operation time of the currently read recovery log file in the preset structure, the currently read recovery log The file is added to the filtered recovery log file;
  • the second read subunit is configured to read the next recovery log file; and so on, until the last recovery log file is compared, and the recovery log file corresponding to each index information in the preset structure is obtained.
  • the server further includes:
  • the second sending module is configured to send the filtered recovery log file to each slave server, and the slave servers recover the data to be restored according to the filtered recovery log file.
  • a fourth aspect provides a server for recovering data, the server being a slave server applied to a storage system, the storage system including a master server and the slave server, the master server and the slave server are both used The same data is stored, and the primary server is the first server that successfully stores data, and the server includes:
  • a first receiving module configured to receive a log obtaining request sent by the primary server, where the log obtaining request carries a data identifier to be restored;
  • a first returning module configured to return a first recovery log file to the primary server according to the log obtaining request, so that the primary server generates a second recovery log file according to the first recovery log file and the primary server Recovering the data to be recovered;
  • a second receiving module configured to receive the filtered recovery log file sent by the primary server
  • a recovery module configured to perform operation on the restored data according to the operation information recorded by the filtered recovery log file
  • the first recovery log file and the second recovery log file respectively record location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier.
  • the server further includes:
  • a storage module configured to receive and store data sent by the client
  • a second returning module configured to return, to the client, a second write that includes the identification identifier of the data Entering status information, the second write status information includes write success information or write failure information;
  • a third receiving module configured to receive total write status information sent by the client, where the total write status information includes the second write status information returned from the server to the client, and the primary server First write status information returned to the client;
  • a generating module configured to: when the total write status information sent by the client includes the write failure information, determine that the data sent by the client is the data to be restored, and generate location information that records the to-be-recovered data and The first recovery log file for operational information.
  • a system for recovering data comprising: a primary server and at least one secondary server;
  • the primary server is the first type of server as described above
  • the secondary server is the second type of server as described above.
  • the primary server After the primary server sends a log obtaining request to each slave server in the storage system, the first recovery log file returned by each slave server is received, and the first recovery log file and the second recovery log file generated by the master server are restored to be restored. Data, so you don't need to scan all the data, you can restore data without using a metadata server, and improve the efficiency of restoring data.
  • FIG. 1 is a flowchart of a method for restoring data according to Embodiment 1 of the present invention
  • FIG. 2 is a flowchart of another method for restoring data according to Embodiment 1 of the present invention.
  • FIG. 3 is a flowchart of a method for restoring data according to Embodiment 2 of the present invention.
  • Embodiment 4 is a schematic diagram of an interaction process provided by Embodiment 2 of the present invention.
  • FIG. 5 is a schematic structural diagram of a server for restoring data according to Embodiment 3 of the present invention.
  • FIG. 6 is a schematic structural diagram of a server for recovering data according to Embodiment 4 of the present invention.
  • FIG. 7 is a schematic structural diagram of a system for restoring data according to Embodiment 5 of the present invention.
  • An embodiment of the present invention provides a method for recovering data, where the method is applied to a primary server of a storage system, where the storage system includes a primary server and a secondary server, and the primary server and the secondary server are both used to store the same data, and the primary server is the first
  • the server of the embodiment of the present invention includes:
  • the primary server sends a log obtaining request to each of the secondary servers in the storage system, and the log obtaining request carries the data identifier to be restored.
  • the method before sending a log obtaining request to each slave server in the storage system, the method further includes:
  • the client Receiving and storing the data sent by the client, and returning, to the client, the first write status information that includes the identification identifier of the data, where the first write status information is a write success information or a write failure information;
  • the total write status information sent by the client includes the write failure information, it is determined that the data sent by the client is the data to be restored, and the second recovery log file that records the location information of the data to be restored and the operation information is generated.
  • Step 102 Receive a first recovery log file returned by each slave server according to the log obtaining request, where each first recovery log file records location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier;
  • the primary server performs and records location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier.
  • the data is to be restored according to the latest operation information in the operation information recorded by all the first recovery log files and the second recovery log file, including:
  • the recovery log file identifier, the offset information, and the data length information are used, and the preset structure is used to store the index information and the operation time;
  • the index information of the currently read recovery log file is not in the preset structure, the index information and the operation time of the currently read recovery log file are added to the preset structure;
  • the method further includes:
  • the operation time of the currently read recovery log file is later than the operation time of the index information corresponding to the currently read recovery log file in the preset structure, the operation time of the currently read recovery log file is replaced with the preset structure and The operation time corresponding to the index information of the currently read recovery log file, and the step of continuing to read the next recovery log file.
  • the recovery log file corresponding to the index information and the operation time in the preset structure is obtained, including:
  • the first recovery log file and the second recovery log file corresponding to the to-be-recovered data identifier are sequentially read, and the index information of the currently-recovered recovery log file is sequentially compared with the index information in the preset structure.
  • the currently read recovery log file is added to the filtered recovery log. File and read the next recovery log file;
  • the method further includes:
  • the filtered recovery log file is sent to each slave server, and each slave server recovers the data to be restored according to the filtered recovery log file.
  • the method is applied to the primary server of the storage system.
  • the storage system includes a primary server and a secondary server.
  • the primary server and the secondary server are used to store the same data.
  • the primary server is the first server that successfully stores data.
  • the method flow provided by the embodiment of the invention includes:
  • Each slave server receives a log obtaining request sent by the primary server, where the log obtaining request carries the data identifier to be restored;
  • the first recovery log file and the second recovery log file record the location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier.
  • the method before returning the first recovery log file to the primary server according to the log obtaining request, the method further includes:
  • Second write status information including an identification identifier of the data, where the second write status information includes write success information or write failure information;
  • the total write status information sent by the client includes the write failure information, it is determined that the data sent by the client is the data to be restored, and the first recovery log file that records the location information and the operation information of the data to be restored is generated.
  • the method provided by the embodiment of the present invention after the primary server sends a log obtaining request to each slave server in the storage system, according to the first recovery log file returned by each slave server, and generated according to all the first recovery log files and the primary server.
  • the second recovery log file recovers the data to be recovered, thereby eliminating the need to scan all the data and recovering the data without using a metadata server, thereby improving the efficiency of restoring data.
  • the embodiment of the present invention provides a method for restoring data.
  • the storage system includes a primary server and at least two secondary servers.
  • the primary server is the first server that successfully stores data
  • the secondary server is a server other than the primary server in the storage system. Referring to FIG. 3, the method process provided by this embodiment includes:
  • the primary server and the secondary server respectively receive and store data sent by the client, and the primary server returns, to the client, first write status information including the identification identifier of the data, and returns a second identifier containing the identification identifier of the data from the server to the client.
  • Write status information, the first write status information and the second write status information include write success information or write failure information;
  • the client obtains the data in advance.
  • the manner in which the client obtains data is not specifically limited in this embodiment.
  • the user can write data to the client through the APP (Application), and then the client sends the data to each server.
  • APP Application
  • other methods may be used, which are not specifically limited in this embodiment.
  • the primary server and the secondary server store data through interaction with the client.
  • the interaction process between the primary server and the secondary server and the client adopts a two-phase transaction submission method, which is a preparation phase and a submission phase.
  • the primary server stores the data sent by the client, and returns the first write status information containing the identification identifier of the data to the client, stores the data sent by the client from the server, and returns the identification identifier containing the data to the client.
  • the second write status information that is, step 301 corresponds to the preparation phase.
  • FIG. 4 For ease of understanding, the interaction process shown in FIG. 4 is taken as an example for description.
  • the user writes the data 1 to the client through the APP, the client creates a transaction, and sends the data 1 written by the user to the server 1 to the server 3 respectively.
  • Server 1 to server 3 respectively receive and store data 1 sent by the client, that is, server 1 to server 3 store the same data 1; server 1 and server 2 store data 1 successfully, server 3 fails to store data 1; server 1 and server 2 Returning the write status information including the identifier of the data 1 to the client, the write status information is the write success information; the server 3 returns the write status information including the identifier of the data 1 to the client, where the write status information is a write failure information.
  • the server 1 is the first server that successfully stores the data 1, the server 1 is used as the primary server, and the write status information returned by the server 1 to the client is the first write status information;
  • the server other than the primary server, that is, the server 2 and the server 3 are used as the secondary server, and the write status information returned by the server 2 and the server 3 to the client is used as the second write status information.
  • the primary server and the secondary server respectively receive total write status information sent by the client, and the total write status information includes first write status information returned by the primary server to the client, and second return from each server to the client. Write status information;
  • the primary server Since the primary server returns the first write status information including the identification identifier of the data to the client, the second write status information including the identification identifier of the data is returned from the server to the client, and the client receives the information sent by each server. Writing the total write status information of the status information and the second write status information, and transmitting the total write status information including the write failure information to the server whose write status information is the write success information, thereby causing each server Ability to receive the total write status information sent by the client.
  • the primary server and the secondary server respectively receive the total write status information sent by the client, that is, step 302 corresponds to the submission phase.
  • the interaction process shown in FIG. 4 is still taken as an example for description.
  • the primary server and the secondary server respectively determine that the data sent by the client is data to be restored, and the primary server generates location information and operation information for recording the data to be restored.
  • a second recovery log file, and a first recovery log file for recording location information of the data to be restored and operation information from the server;
  • the total write status information sent by the client includes the write failure information, it indicates that at least one server fails to store data.
  • the primary server and the secondary server respectively determine that the data sent by the client is the data to be restored. .
  • the location information of the data to be recovered recorded in the recovery log file may be offset information, data length information, etc., used to determine the location of the data to be restored; the operation information may be writing data information, deleting data information. Etc., used to describe the operation of the data, this embodiment does not restore the log
  • the location information of the data to be recovered recorded in the file and the content of the operation information are specifically limited.
  • the interaction process shown in FIG. 4 is still taken as an example for description.
  • There are three servers in the storage system namely server 1, server 2 and server 3. Since the server 1, the server 2, and the server 3 receive the total write status information sent by the client including the write failure information, the server 1, the server 2, and the server 3 determine that the data 1 is the data to be restored, and generates the record write data.
  • Recovery log file for location information and operational information. For example, if the server 1 is a master server and the server 2 and the server 3 are slave servers, the server 1 generates a second recovery log file that records location information and operation information of the data to be restored.
  • the server 2 and the server 3 record the error log through the data brush, that is, generate the first recovery log file that records the location information of the data to be restored and the operation information.
  • the interaction process between the client and each server reflects the process of storing data and generating recovery log files for each server.
  • the primary server sends a log obtaining request to each of the secondary servers in the storage system, and the log obtaining request carries the data identifier to be restored.
  • the manner of triggering the primary server to send a log obtaining request to each of the secondary servers in the storage system is not specifically limited in this embodiment.
  • the server periodically checks the recovery log file and starts data recovery, thereby triggering the primary server to send to each slave server in the storage system.
  • the log gets the request.
  • other methods can be employed.
  • the server 1 and the server 2 still store the data 1 successfully, and the server 3 stores the data 1 failure as an example.
  • the server 1 is the main server.
  • the server 1 to the server 3 periodically check the recorded recovery log file, and it is found that the data 1 needs to be restored by checking.
  • a log acquisition request carrying the data identification of the data 1 is transmitted by the server 1 to the server 2 and the server 3.
  • the slave server can directly receive the log obtaining request sent by the master server to the slave server in the storage system.
  • the slave server can directly receive the log obtaining request sent by the master server.
  • the recovery log file is returned according to the to-be-recovered data identifier in the log obtaining request.
  • the server 1 and the server 2 still store the data 1 successfully, and the server 3 stores the data 1 failure as an example.
  • the server 1 is the main server.
  • Server 2 and server 3 Receiving a log obtaining request sent by the server 1, where the log obtaining request carries the data identifier of the data 1.
  • the slave server returns a first recovery log file to the primary server according to the log obtaining request, where the first recovery log file records location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier.
  • the log obtaining request carries the to-be-recovered data identifier
  • the slave server can search for the recovery log file corresponding to the to-be-recovered data identifier in the recorded recovery log file according to the to-be-recovered data identifier, and return the found recovery log to the primary server. file.
  • the manner in which the recovery log file is searched from the server is not specifically limited in this embodiment.
  • the recorded recovery log file may be sequentially read, and the data identifier in the read recovery log file is compared with the to-be-recovered data identifier carried in the log obtaining request; if the recovered recovery log file is read
  • the data identifier is the same as the to-be-recovered data identifier carried in the log obtaining request.
  • the recovered log file is used as the first recovered log file and returned to the primary server.
  • other methods can be used.
  • the server 1 and the server 2 still store the data 1 successfully, and the server 3 stores the data 1 failure as an example.
  • the server 1 is the main server.
  • the server 2 and the server 3 sequentially read the recovery log file. If the data identifier in the recovered recovery log file 1 is the same as the identifier of the data 1, the recovery log file 1 is used as the first recovery log file found, and Server 1 returns recovery log file 1.
  • the primary server receives the first recovery log file returned by each slave server according to the log obtaining request, and each recovery log file records location information and operation information of the data to be restored.
  • the primary server can directly receive the first recovery log file returned by each secondary server according to the log acquisition request.
  • the server 1 and the server 2 still store the data 1 successfully, and the server 3 stores the data 1 failure as an example.
  • the server 1 is the main server.
  • the server 1 receives the first recovery log file corresponding to the data 1 identifier returned by the server 2 and the server 3 according to the log acquisition request, and each of the first recovery log files records the location information and the operation information of the data 1.
  • the primary server operates, according to the latest operation information in the operation information recorded by the first recovery log file and the second recovery log file, the second recovery log file is generated by the primary server, and the data identifier to be restored is recorded. Location information and operation information of the identified data to be recovered;
  • the server may find the to-be-recovered according to the location information of the data to be restored in each recovery log file.
  • the data is processed according to the latest operation information in the operation information recorded in each recovery log file, thereby realizing data recovery for the data to be restored.
  • the method provided in this embodiment includes, but is not limited to, operating on the data to be restored according to the latest operation information in the operation information recorded by all the first recovery log files and the second recovery log file.
  • index information of the currently read recovery log file is in a preset structure, the index information includes a recovery log file identifier, an offset information, and a data length information, and the preset structure is configured to store the index information and the operation time; If the index information of the currently read recovery log file is not in the preset structure, execute (a3); if the index information of the currently read recovery log file is in the preset structure, execute (a4);
  • the preset structure is an empty structure.
  • the index information and the operation time of the recovery log file that meet the above comparison and comparison requirements are added to the preset structure, so that the preset structure includes the index information and operation of the filtered recovery log file.
  • the time, that is, the obtained preset structure is a preset structure in which the information without the repeated index and the operation time is stored, that is, the index information stored in the preset structure and the operation time do not overlap. Therefore, the recovery log file determined according to the preset structure will be a recovery log file with no repetitive operations.
  • the preset structure By filtering the recovery log file by using the preset structure, the efficiency of the recovery log file filtering is improved, and the workload of restoring the data to be restored according to the filtered recovery log file in the subsequent steps is reduced, and the speed of recovering the data is accelerated.
  • the specific form of the preset structure is not specifically limited in this embodiment.
  • the preset structure includes, but is not limited to, a hash table, a red black tree, and the like.
  • the server 1 is the main server, the first recovery log file 21 and the first recovery log file 22 returned by the server 2, and the first recovery log file 31 returned by the server 3 are taken as an example for description.
  • the first recovery log file 21 records the write data 1, the index information is a1+a2+a3, the operation time is December 12, 2013, 13:22;
  • the first recovery log file 22 records the deletion data 1, the index information For a1+a2+a3, the operation time is December 12, 2013, 13:49;
  • the first recovery log file 31 records the write data 1, the index information is a1+a2+a3, and the operation time is December 2013. 12, 13:22.
  • a1 is the recovery log file identifier
  • a2 is the offset information
  • a3 is the data length information.
  • the server 1 generates a second recovery log file 11 and a second recovery log file 12;
  • the second recovery log file 11 records the written data 1, the index information is a1+a2+a3, and the operation time is December 12, 2013. , 13:22;
  • the second recovery log file 12 records the deletion data 1, the index information is a1+a2+a3, and the operation time is December 12, 2013, 13:49.
  • the server 1 reads the second recovery log file 11. Since the recovery log file filtering has not been performed at this time, the preset structure is an empty structure, and the index information a1+a2+a3 of the second recovery log file 11 and the operation time 2013 are directly directly.
  • the content of the recovery log file operation with a late operation time will overwrite the contents of the recovery log file operation operation time earlier. In this case, it is necessary to perform the operation time later.
  • the log file can be recovered, and it is not necessary to perform an operation log recovery file early.
  • the operation time corresponding to the index information and the index information in the preset structure is unchanged, that is, the operation information corresponding to the index information a1+a2+a3 and the index information a1+a2+a3 is December 12, 2013. 13:49.
  • the client writes a piece of data A to generate a recovery log file; after a period of time, the client deletes a piece of data A previously written, and generates a recovery log file.
  • the operation time of the first recovery log file 22 is On December 12, 2013, 13:49 is compared with the operation time of the index information a1+a2+a3 in the preset structure on December 12, 2013, 13:49; by comparison, the first recovery log file 22 is Operation time December 12, 2013, 13:49
  • the operation time corresponding to the index information a1+a2+a3 in the preset structure is the same on December 12, 2013, 13:49, and continues to read the next first. Restore the log file.
  • the operation time corresponding to the index information and the index information in the preset structure is unchanged, that is, the operation information corresponding to the index information a1+a2+a3 and the index information a1+a2+a3 is December 12, 2013. 13:49.
  • the first recovery log file 31 is read, and the index information a1+a2+a3 of the first recovery log file 31 is determined to be in the preset structure, and the operation time of the first recovery log file 31 is December 12, 2013, 13: 22 is compared with the operation time of the index information a1+a2+a3 in the preset structure on December 12, 2013, 13:49; by comparison, the operation time of the first recovery log file 31 is December 12, 2013, 13:22
  • the operation time corresponding to the index information a1+a2+a3 in the preset structure is December 12, 2013, 13:49, and the next first recovery log file is continuously read. So far, the received first recovery log files 21, 22, 31 and the second recovery log files 11, 12 generated by the server 1 corresponding to the data 1 identification have been processed.
  • the preset structure includes the index information a1+a2+a3 and the operation time corresponding to the index information a1+a2+a3 on December 12, 2013, 13:49.
  • the recovery log file corresponding to the index information and the operation time in the preset structure is obtained in (a7), including but not limited to:
  • the operation time corresponding to the index information a1+a2+a3 and the index information a1+a2+a3 in the preset structure is December 12, 2013, 13:49 as an example.
  • the second recovery log file 11 is read, and the index information a1+a2+a3 of the second recovery log file 11 is compared with the index information a1+a2+a3 in the preset structure, and it is known that the preset structure exists and the second Restoring the same index information of the index information a1+a2+a3 of the log file 11; continuing to compare the operations of the second recovery log file 11 At the time of December 12, 2013, 13:22 and the operation time of the index information a1+a2+a3 in the preset structure, December 12, 2013, 13:49, by comparison, it is known that the preset structure does not exist and The operation time of the recovery log file 11 is the same operation time on December 12, 2013, 13:22, and the next recovery log file is continuously read.
  • the second recovery log file 12 is read, and the index information a1+a2+a3 of the second recovery log file 12 is compared with the index information a1+a2+a3 in the preset structure, and it is known that the preset structure exists and the second Restoring the same index information of the index information a1+a2+a3 of the log file 12; continuing to compare the operation time of the second recovery log file 12 on December 12, 2013, 13:49 with the index information a1+a2+ in the preset structure
  • the operation time of a3 is December 12, 2013, 13:49.
  • the second recovery log file 12 is added to the filtered recovery log file and continues to read the next recovery log file.
  • the index information and the operation time of the first recovery log files 21, 22, and 31 are compared with the index information and the operation time in the preset structure, and the first recovery log file is not obtained. Therefore, only The second recovery log file 12 is used as the filtered recovery log file.
  • the data to be restored may be operated according to the operation information recorded in the filtered recovery log file.
  • the manner of restoring data is not specifically limited in this embodiment.
  • the data may be re-operated by the primary server according to the operation information of the data to be recovered recorded in the recovery log file.
  • other methods can be employed.
  • a plurality of log information of the data to be restored may be recorded in a recovery log file. For this case, each log information of the data to be restored may be sequentially read by the primary server, and according to each log information of the data to be restored. The operational information re-operates on the data.
  • the filtered log file is a recovery log file 12 as an example.
  • the operation of deleting the data 1 is recorded in the recovery log file 12, and the server 1 can perform the operation of deleting the data 1 to complete the data recovery.
  • the primary server sends the filtered recovery log file to each slave server, and each slave server operates the data to be restored according to the operation information in the filtered recovery log file.
  • the method provided in this embodiment further includes, but is not limited to, the primary server sending the filtered recovery log file to each slave server, in order to improve the speed of restoring data in the storage system.
  • each slave server is based on the filtered recovery log.
  • the file is restored in parallel with the recovered data, so that the data can be recovered without the metadata server, which not only reduces the load of the metadata server, but also improves the speed of data recovery.
  • the filtered recovery log file is the second recovery log file 12 as an example.
  • the server 1 transmits the second recovery log file 12 to the server 2 and the server 3, and the server 2 and the server 3 restore the data 1 based on the second recovery log file 12.
  • the method provided in this embodiment further includes, but is not limited to, the primary server deleting all the first recovery log files and the second recovery log files, and notifying each of the secondary servers to delete all the first recovery log files and the first Second recovery log file;
  • the primary server Since the primary server has completed data recovery, there is no need to record the recovery log file for the recovered data, and in order to save the storage resources in the primary server, the primary server deletes all the first recovery log files and the second recovery log files.
  • the primary server will notify each slave server to delete all the first recovery log files and the second recovery log files for recovering the data to be restored after successfully recovering the data.
  • the embodiment is not specifically limited.
  • the slave server may be notified by sending a delete message to the slave server.
  • other methods can be employed.
  • the slave server may perform the recovery data according to the filtered recovery log file. restore.
  • the manner of restoring data refer to the manner in which the primary server recovers the data to be restored according to the filtered recovery log file in the foregoing step 308, and details are not described herein again.
  • the method provided in this embodiment further includes, but is not limited to, receiving, from the server, a notification sent by the primary server to delete all the first recovery log files and the second recovery log file, and deleting all the first recovery according to the notification.
  • the log file and the second recovery log file are not limited to, receiving, from the server, a notification sent by the primary server to delete all the first recovery log files and the second recovery log file, and deleting all the first recovery according to the notification.
  • the secondary server may receive a notification sent by the primary server to delete all the first recovery log files and the second recovery log files, thereby triggering the notification according to the notification. After successfully recovering the data, delete all the first recovery log files and the second recovery log files.
  • the method provided in this embodiment sends the date to each slave server in the storage system through the primary server. Acquiring the request, receiving the first recovery log file returned by each slave server, and restoring the data to be recovered to recover the data to be recovered according to all the first recovery log files and the second recovery log file generated by the main server, thereby eliminating the need to scan all data, Recover data without using a metadata server, improving the efficiency of restoring data.
  • an embodiment of the present invention provides a server for recovering data, which is a primary server applied to a storage system, where the storage system includes a primary server and a secondary server, and both the primary server and the secondary server are used to store the same data.
  • the server is the first server to successfully store data, and the server includes:
  • the first sending module 401 is configured to send a log obtaining request to each slave server in the storage system when the storage server fails to store data in the storage system, where the log obtaining request carries the data identifier to be restored;
  • the first receiving module 402 is configured to receive a first recovery log file returned by each slave server according to the log obtaining request, where each first recovery log file records location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier;
  • the recovery module 403 is configured to perform operation on the restored data according to the latest operation information in the operation information recorded by all the first recovery log files and the second recovery log file, and the data to be restored is searched according to the location information of the data to be restored, and the second The recovery log file is generated by the primary server, and records the location information and operation information of the data to be recovered identified by the data identifier to be restored.
  • the server further includes:
  • a storage module configured to receive and store data sent by the client
  • a returning module configured to return, to the client, first write state information that includes an identification identifier of the data, where the first write state information includes a write success information or a write failure information;
  • a second receiving module configured to receive total write status information sent by the client, where the total write status information includes first write status information returned by the primary server to the client, and second write returned from the server to the client. Status information;
  • a generating module configured to: when the total write status information sent by the client includes the write failure information, determine that the data sent by the client is the data to be restored, and generate a second recovery of the location information and the operation information for recording the data to be restored. Log file.
  • the recovery module 403 includes:
  • a first reading unit configured to sequentially read each of the first recovery log file and the second recovery log file
  • the determining unit is configured to determine whether the index information of the currently read recovery log file is in a preset structure, the index information includes a recovery log file identifier, an offset information, and a data length information, and the preset structure stores the index information and the operation time. ;
  • a second reading unit configured to continue to read the next recovery log file
  • a processing unit configured to process the read next recovery log file in a manner of processing the currently read recovery log file, until the last recovery log file is processed, to obtain a preset structure for storing the duplicate index information and the operation time;
  • the obtaining unit is configured to obtain a recovery log file corresponding to the index information and the operation time in the preset structure, and use the recovery log file corresponding to the index information and the operation time in the preset structure as the filtered recovery log file;
  • a recovery unit configured to operate on the restored data according to the operation information in the filtered recovery log file.
  • the recovery module 403 further includes:
  • a comparison unit configured to: when the index information of the currently read recovery log file is in the preset structure, the operation time of the currently read recovery log file and the index information of the currently read recovery log file in the preset structure Comparison of operating time;
  • a replacement unit configured to replace the operation time of the currently read recovery log file when the operation time of the currently read recovery log file is later than the operation time of the index information corresponding to the currently read recovery log file in the preset structure The operation time in the preset structure corresponding to the index information of the currently read recovery log file;
  • the second reading unit is further configured to perform the step of continuing to read the next recovery log file.
  • the obtaining unit includes:
  • a first reading subunit configured to sequentially read the first recovery log file and the second recovery log file corresponding to the to-be-recovered data identifier
  • the comparison subunit is configured to compare the index information of the currently read recovery log file with the index information in the preset structure
  • Comparison subunit for indexing information in the default structure that exists with the currently read recovery log file When the same index information is used, the operation time of the currently read recovery log file and the operation time of the index information corresponding to the currently read recovery log file in the preset structure are compared;
  • the second read subunit is configured to read the next recovery log file; and so on until the last recovery log file is compared, and the recovery log file corresponding to each index information in the preset structure is obtained.
  • the server further includes:
  • the second sending module is configured to send the filtered recovery log file to each slave server, and each slave server recovers the data to be restored according to the filtered recovery log file.
  • the server further includes:
  • the notification module is configured to notify each of the slave servers to delete all the first recovery log files and the second recovery log files.
  • the server provided by the embodiment of the present invention receives the first recovery log file returned by each slave server by sending a log acquisition request to each slave server in the storage system, and generates a second recovery according to all the first recovery log files and the primary server.
  • the log file recovers the data to be recovered, so that it is not necessary to scan all the data, and the metadata server can be used to recover the data, which improves the efficiency of restoring data.
  • an embodiment of the present invention provides a server for recovering data, which is a slave server applied to a storage system, where the storage system includes a primary server and a secondary server, and both the primary server and the secondary server are used to store the same data.
  • the server is the first server to successfully store data, and the server includes:
  • the first receiving module 501 is configured to receive a log obtaining request sent by the primary server, where the log obtaining request carries the data identifier to be restored;
  • the first returning module 502 is configured to return a first recovery log file to the primary server according to the log obtaining request, so that the primary server recovers the to-be-recovered data according to the first recovery log file and the second recovery log file generated by the primary server;
  • the second receiving module 503 is configured to receive the filtered recovery log file sent by the primary server.
  • the recovery module 504 is configured to perform operation on the restored data according to the operation information recorded by the filtered recovery log file;
  • the first recovery log file and the second recovery log file record the location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier.
  • the server further includes:
  • a storage module configured to receive and store data sent by the client
  • a second returning module configured to return, to the client, second writing state information that includes an identification identifier of the data, where the second writing state information includes a writing success information or a writing failure information;
  • a third receiving module configured to receive total write status information sent by the client, where the total write status information includes second write status information returned from the server to the client, and a first write status returned by the primary server to the client information;
  • a generating module configured to: when the total write status information sent by the client includes the write failure information, determine that the data sent by the client is the data to be restored, and generate the first recovery of the location information and the operation information of the data to be restored. Log file.
  • the server further includes:
  • a fourth receiving module configured to receive a notification sent by the primary server to delete all the first recovery log files and the second recovery log files
  • the deleting module is configured to delete all the first recovery log files and the second recovery log files according to the notification.
  • the server provided in this embodiment receives the log obtaining request sent by the primary server, and returns a first recovery log file to the primary server according to the log obtaining request, so that the primary server generates the second recovery log according to the first recovery log file and the primary server.
  • the file recovers the data to be recovered, so that it is not necessary to scan all the data, and the metadata server can be used to recover the data, which improves the efficiency of restoring data.
  • an embodiment of the present invention provides a system for recovering data, where the system includes a main server 701 and at least one slave server 702.
  • the master server 701 is a server for recovering data provided by the foregoing third embodiment.
  • the server 702 is the server for restoring data provided in the above-mentioned fourth embodiment.
  • the system provided by this embodiment sends the date to each slave server in the storage system through the primary server. Acquire the request, receive the first recovery log file returned from each server, and recover the data to be restored according to all the first recovery log files and the second recovery log file generated by the primary server, thereby eliminating the need to scan all data and use metadata
  • the server can recover data and improve the efficiency of data recovery.
  • the embodiment of the present invention provides a server for recovering data, which is a primary server applied to a storage system, where the storage system includes a primary server and a secondary server, and the primary server and the secondary server are both used to store the same data, and the primary server is the first server.
  • a server that successfully stores data the server including a transmitter, a receiver, and a processor;
  • the transmitter is configured to send a log obtaining request to each slave server in the storage system when the server fails to store data in the storage system, and the log obtaining request carries the data identifier to be restored.
  • a receiver configured to receive a first recovery log file returned by each slave server according to the log obtaining request, where each first recovery log file records location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier;
  • a processor configured to perform, according to the latest operation information in the operation information recorded by the first recovery log file and the second recovery log file, the data to be restored is searched according to the location information of the data to be restored, and the second recovery is performed.
  • the log file is generated by the primary server, and records the location information and operation information of the data to be recovered identified by the data identifier to be restored.
  • the processor is further configured to receive and store data sent by the client;
  • the transmitter is further configured to return, to the client, first write status information that includes an identification identifier of the data, where the first write status information includes write success information or write failure information;
  • the receiver is further configured to receive total write status information sent by the client, where the total write status information includes first write status information returned by the primary server to the client, and second write each returned from the server to the client. status information;
  • the processor is further configured to: when the total write status information sent by the client includes the write failure information, determine the data as the data to be restored, and generate a second recovery log file that records the location information and the operation information of the data to be restored.
  • the processor is configured to sequentially read each of the first recovery log file and the second recovery log file, and determine whether the index information of the currently read recovery log file is in a preset structure.
  • the index information includes a recovery log file identifier, an offset information, and a data length information, and the preset structure is used to store the index information and the operation time; when the index information of the currently read recovery log file is not in the preset structure, Adding the index information and operation time of the currently read recovery log file to the preset structure; continuing to read the next recovery log file; processing the next recovery log file read in the same manner as processing the currently read recovery log file Until the last recovery log file is processed, obtaining a preset structure for storing the duplicate index information and the operation time; acquiring the recovery log file corresponding to the index information and the operation time in the preset structure, and the preset structure is The index information and the recovery log file corresponding to the operation time are used as the filtered recovery log file, and the data to be restored is operated according to the operation information in the filtered
  • the processor is further configured to: when the index information of the currently read recovery log file is in the preset structure, compare the operation time of the currently read recovery log file with the current current in the preset structure. The operation time of the index information of the read recovery log file is compared; when the operation time of the currently read recovery log file is later than the operation time of the index information corresponding to the currently read recovery log file in the preset structure, the current The operation time of the read recovery log file replaces the operation time in the preset structure corresponding to the index information of the currently read recovery log file; and the step of continuing to read the next recovery log file is performed.
  • the processor is configured to sequentially read the first recovery log file and the second recovery log file corresponding to the to-be-recovered data identifier; and sequentially, the index information of the currently read recovery log file is The index information in the structure is compared; when there is the same index information in the preset structure as the index information of the currently read recovery log file, the operation time of the currently read recovery log file is compared with the preset structure.
  • the operation time of the index information of the currently read recovery log file when there is an operation time corresponding to the operation time of the currently read recovery log file in the preset structure corresponding to the index information of the currently read recovery log file, The currently read recovery log file is added to the filtered recovery log file; the next recovery log file is read; and so on, until the last recovery log file is compared, and each index information in the preset structure is obtained.
  • Recovery log file when there is an operation time corresponding to the operation time of the currently read recovery log file in the preset structure corresponding to the index information of the currently read recovery log file, The currently read recovery log file is added to the filtered recovery log file; the next recovery log file is read; and so on, until the last recovery log file is compared, and each index information in the preset structure is obtained.
  • the transmitter is further configured to send the filtered recovery log file to each slave server, and each slave server recovers the data to be restored according to the filtered recovery log file.
  • the processor is further configured to delete all the first recovery log files and the second recovery log files; notify each of the slave servers to delete all the first recovery log files and the second recovery log. file.
  • the server provided by the embodiment of the present invention receives the first recovery log file returned by each slave server in the storage system according to the log obtaining request sent by the primary server, and according to all the first recovery log files and the second recovery log generated by the primary server.
  • the file recovers the data to be recovered, so that it is not necessary to scan all the data, and the metadata server can be used to recover the data, which improves the efficiency of restoring data.
  • the embodiment of the invention provides a server for recovering data
  • the server is a slave server applied to the storage system
  • the storage system includes a master server and a slave server
  • the master server and the slave server are both used to store the same data
  • the master server is the first server.
  • a server that successfully stores data the server including a transmitter, a receiver, and a processor;
  • the receiver is configured to receive a log obtaining request sent by the primary server, where the log obtaining request carries the data identifier to be restored;
  • a transmitter configured to return a first recovery log file to the primary server according to the log obtaining request, so that the primary server recovers the to-be-recovered data according to the first recovery log file and the second recovery log file generated by the primary server;
  • the receiver is further configured to receive the filtered recovery log file sent by the primary server;
  • a processor configured to perform operation on the restored data according to the operation information recorded by the filtered recovery log file
  • Each of the first recovery log file and the second recovery log file records location information and operation information of the to-be-recovered data identified by the to-be-recovered data identifier.
  • the processor is further configured to receive and store data sent by the client;
  • the transmitter is further configured to return, to the client, second write status information that includes an identification identifier of the data, where the second write status information includes write success information or write failure information;
  • the receiver is further configured to receive total write status information sent by the client, where the total write status information includes second write status information returned from the server to the client, and first write status information returned by the primary server to the client. ;
  • the processor is further configured to: when the total write status information sent by the client includes the write failure information, determine that the data sent by the client is the data to be restored, and generate the first location information and operation information for recording the data to be restored. Restore the log file.
  • the receiver is further configured to receive all the first deletions sent by the primary server. Notification of recovery log file and second recovery log file;
  • the processor is further configured to delete all the first recovery log files and the second recovery log files according to the notification.
  • the server provided by the embodiment of the present invention receives the log obtaining request sent by the primary server, and returns a first recovery log file to the primary server according to the log obtaining request, so that the primary server generates the second recovery according to the first recovery log file and the primary server.
  • the log file recovers the data to be recovered, so that it is not necessary to scan all the data, and the metadata server can be used to recover the data, which improves the efficiency of restoring data.
  • the server for restoring data provided by the foregoing embodiment is only illustrated by dividing the foregoing functional modules. In actual applications, the function allocation may be completed by different functional modules as needed. The internal structure of the server is divided into different functional modules to complete all or part of the functions described above.
  • the server for restoring data and the method for restoring data provided by the foregoing embodiments are in the same concept, and the specific implementation process is described in detail in the method embodiment, and details are not described herein again.
  • a person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium.
  • the storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

La présente invention concerne le domaine des technologies de l'information. La présente invention se rapporte à un procédé, à un serveur et à un système pour la récupération de données. Le procédé comprend les étapes suivantes : un serveur maître reçoit des premiers fichiers journaux de récupération renvoyés par des serveurs esclaves dans un système de mémorisation, en fonction d'une requête d'acquisition de journaux envoyée par le serveur maître, puis réalise une opération sur les données à récupérer, en fonction des informations d'opération les plus récentes enregistrées dans l'ensemble des premiers fichiers journaux de récupération et dans un second fichier journal de récupération généré par le serveur maître, les premiers fichiers journaux de récupération et le second fichier journal de récupération enregistrant des informations d'emplacement et des informations d'opération des données à récupérer identifiées par un identifiant des données à récupérer. Selon la présente invention, le serveur maître envoie une requête d'acquisition de journaux aux serveurs esclaves dans le système de mémorisation, puis récupère les données à récupérer en fonction de l'ensemble des premiers fichiers journaux de récupération renvoyés par les serveurs esclaves et d'un second fichier journal de récupération généré par le serveur maître, de sorte que la récupération de données puisse être réalisée sans balayer l'ensemble des données ni utiliser de serveur de métadonnées. L'efficacité de récupération des données est améliorée.
PCT/CN2014/088962 2013-12-31 2014-10-20 Procédé, serveur et système de récupération de données WO2015101084A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310754520.7A CN103761161B (zh) 2013-12-31 2013-12-31 恢复数据的方法、服务器及系统
CN201310754520.7 2013-12-31

Publications (1)

Publication Number Publication Date
WO2015101084A1 true WO2015101084A1 (fr) 2015-07-09

Family

ID=50528403

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/088962 WO2015101084A1 (fr) 2013-12-31 2014-10-20 Procédé, serveur et système de récupération de données

Country Status (2)

Country Link
CN (1) CN103761161B (fr)
WO (1) WO2015101084A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170212856A1 (en) * 2015-04-30 2017-07-27 Hewlett Packard Enterprise Development Lp Peripheral device server access
CN109901799A (zh) * 2019-02-28 2019-06-18 新华三信息安全技术有限公司 一种日志读写方法及装置
CN111611258A (zh) * 2020-05-27 2020-09-01 杭州海康威视系统技术有限公司 流数据的恢复方法和存储设备

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103761161B (zh) * 2013-12-31 2017-01-04 华为技术有限公司 恢复数据的方法、服务器及系统
CN104536852B (zh) * 2014-12-31 2017-01-25 华为技术有限公司 数据恢复方法及装置
CN105426273B (zh) * 2015-12-30 2018-08-10 联想(北京)有限公司 恢复物理存储单元数据的方法和服务器
CN107220142B (zh) * 2016-03-22 2020-10-09 阿里巴巴集团控股有限公司 执行数据恢复操作的方法及装置
CN107528872B (zh) 2016-06-22 2020-07-24 杭州海康威视数字技术股份有限公司 一种数据恢复方法、装置及云存储系统
CN106776130B (zh) * 2016-11-30 2020-07-28 华为技术有限公司 一种日志恢复方法、存储装置和存储节点
CN109947730B (zh) * 2017-07-25 2024-02-02 中兴通讯股份有限公司 元数据恢复方法、装置、分布式文件系统及可读存储介质
CN109960601B (zh) * 2017-12-26 2023-03-24 航天信息股份有限公司 一种业务数据的恢复方法、装置和电子设备
CN109978290A (zh) * 2017-12-27 2019-07-05 中国移动通信集团广东有限公司 一种业务流程回退处理方法、流程引擎和业务系统
CN108599982B (zh) * 2018-03-14 2021-02-12 华为技术有限公司 数据恢复方法及相关设备
CN111488238B (zh) * 2020-06-24 2020-09-18 南京鹏云网络科技有限公司 一种块存储节点数据修复方法及存储介质
CN111680010B (zh) * 2020-08-14 2020-12-22 北京东方通软件有限公司 适用于JavaEE应用服务器的日志系统的设计方法
CN116266175A (zh) * 2021-12-16 2023-06-20 华为技术有限公司 一种数据恢复方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7676502B2 (en) * 2006-05-22 2010-03-09 Inmage Systems, Inc. Recovery point data view shift through a direction-agnostic roll algorithm
CN102523105A (zh) * 2011-11-30 2012-06-27 广东电子工业研究院有限公司 一种数据存储的故障恢复方法及其适用的数据分布架构
CN103324553A (zh) * 2013-06-21 2013-09-25 华为技术有限公司 数据恢复方法、系统及装置
CN103761161A (zh) * 2013-12-31 2014-04-30 华为技术有限公司 恢复数据的方法、服务器及系统

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7043504B1 (en) * 2000-04-10 2006-05-09 International Business Machines Corporation System and method for parallel primary and secondary backup reading in recovery of multiple shared database data sets
US8074107B2 (en) * 2009-10-26 2011-12-06 Amazon Technologies, Inc. Failover and recovery for replicated data instances
CN103345470B (zh) * 2013-05-31 2016-05-25 深圳市沃信科技有限公司 一种数据库容灾方法、系统及服务器

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7676502B2 (en) * 2006-05-22 2010-03-09 Inmage Systems, Inc. Recovery point data view shift through a direction-agnostic roll algorithm
CN102523105A (zh) * 2011-11-30 2012-06-27 广东电子工业研究院有限公司 一种数据存储的故障恢复方法及其适用的数据分布架构
CN103324553A (zh) * 2013-06-21 2013-09-25 华为技术有限公司 数据恢复方法、系统及装置
CN103761161A (zh) * 2013-12-31 2014-04-30 华为技术有限公司 恢复数据的方法、服务器及系统

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170212856A1 (en) * 2015-04-30 2017-07-27 Hewlett Packard Enterprise Development Lp Peripheral device server access
US10318459B2 (en) * 2015-04-30 2019-06-11 Hewlett Packard Enterprise Development Lp Peripheral device server access
CN109901799A (zh) * 2019-02-28 2019-06-18 新华三信息安全技术有限公司 一种日志读写方法及装置
CN111611258A (zh) * 2020-05-27 2020-09-01 杭州海康威视系统技术有限公司 流数据的恢复方法和存储设备
CN111611258B (zh) * 2020-05-27 2023-09-19 杭州海康威视系统技术有限公司 流数据的恢复方法和存储设备

Also Published As

Publication number Publication date
CN103761161B (zh) 2017-01-04
CN103761161A (zh) 2014-04-30

Similar Documents

Publication Publication Date Title
WO2015101084A1 (fr) Procédé, serveur et système de récupération de données
JP6522812B2 (ja) 分散型データベースシステム用高速クラッシュ回復
JP6538780B2 (ja) 分散型データベースシステムのシステム全体のチェックポイント回避
US8689047B2 (en) Virtual disk replication using log files
US10831741B2 (en) Log-shipping data replication with early log record fetching
US20150213100A1 (en) Data synchronization method and system
CA2893304C (fr) Procede de stockage de donnees, appareil de stockage de donnees, et dispositif de stockage
US10853157B2 (en) Compact binary event log generation
US9223797B2 (en) Reparse point replication
WO2008119292A1 (fr) Procédé, dispositif et système de secours informatique de données stockées
CN103516736A (zh) 分布式缓存系统的数据恢复方法及装置
US11748215B2 (en) Log management method, server, and database system
WO2021208400A1 (fr) Système et procédé de récupération de sauvegarde pour application moderne
CN106528338B (zh) 一种远程数据复制方法、存储设备及存储系统
US11797397B2 (en) Hybrid NVRAM logging in filesystem namespace
US20180121531A1 (en) Data Updating Method, Device, and Related System
CN112380067A (zh) 一种Hadoop环境下基于元数据的大数据备份系统及方法
WO2013091183A1 (fr) Procédé et dispositif pour une opération de paire clé/valeur
CN113672436B (zh) 一种容灾备份方法、装置、设备及存储介质
WO2019109257A1 (fr) Procédé de gestion de journal, serveur et système de base de données
CN111522688A (zh) 分布式系统的数据备份方法及装置
US20230214301A1 (en) Copy Data Management System and Method for Modern Application
CN111026764B (zh) 一种数据存储方法、装置、电子产品及存储介质
CN112416885A (zh) 一种文件的实时同步方法
CN118277336A (zh) 元数据管理方法、元数据管理装置以及计算机存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14876674

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14876674

Country of ref document: EP

Kind code of ref document: A1