CN109117312A - Data reconstruction method and device - Google Patents

Data reconstruction method and device Download PDF

Info

Publication number
CN109117312A
CN109117312A CN201810969624.2A CN201810969624A CN109117312A CN 109117312 A CN109117312 A CN 109117312A CN 201810969624 A CN201810969624 A CN 201810969624A CN 109117312 A CN109117312 A CN 109117312A
Authority
CN
China
Prior art keywords
user
data
tables
log
written
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810969624.2A
Other languages
Chinese (zh)
Other versions
CN109117312B (en
Inventor
田竞云
张森
周应超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Intelligent Technology Co Ltd
Original Assignee
Beijing Xiaomi Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Intelligent Technology Co Ltd filed Critical Beijing Xiaomi Intelligent Technology Co Ltd
Priority to CN201810969624.2A priority Critical patent/CN109117312B/en
Publication of CN109117312A publication Critical patent/CN109117312A/en
Application granted granted Critical
Publication of CN109117312B publication Critical patent/CN109117312B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1464Management of the backup or restore process for networked environments
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1469Backup restoration techniques

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The disclosure is directed to data reconstruction method and devices.Method includes: that traversal reads all data recorded in log, obtains the user data of each user, there are two the user data of the above user for record in log;By the user data of each user, it is respectively written into tables of data corresponding to each user.After all data that the disclosure records in reading log, directly by the user data of each user recorded in log, it is respectively written into tables of data corresponding to each user, to reduce the read-write operation number to disk, reduce the pressure to bottom storage system, it can be obviously shortened failure recovery time, fault recovery is avoided to fail, improve the overall usability of distributed data base system.

Description

Data reconstruction method and device
Technical field
This disclosure relates to technical field of data storage more particularly to data reconstruction method and device.
Background technique
Distributed data base, which refers to, is connected the multiple data storage cells physically dispersed using information autobahn Get up the unified database in logic of composition one.The basic thought of distributed data base is to lead to data dispersion storage to multiple It crosses on the data memory node of network connection, to obtain bigger memory capacity and higher concurrent amount of access.In recent years, with The rapid growth of data volume, distributed data base technique have also obtained quick development.
In general, the data storage procedure of distributed data base system may include: also will while writing data into memory Data are written in log (Log), and disk can be periodically written in the data in memory;Occur when due to distributed data base system Failure and when leading to the loss of data in the memory of memory node, need to carry out data recovery by Log.
In the related technology, distributed data base is when carrying out fault recovery, playback Log first, and it is right to generate each user institute The sub- Log answered, i.e. temporary file;Then Log corresponding to each user is played back again, by what is recorded in Log corresponding to each user Data are respectively written into tables of data corresponding to each user.
Summary of the invention
To overcome the problems in correlation technique, the embodiment of the present disclosure provides a kind of data reconstruction method and device.Institute It is as follows to state technical solution:
According to the first aspect of the embodiments of the present disclosure, a kind of data reconstruction method is provided, method includes:
Traversal reads all data recorded in log, obtains the user data of each user, and record has two in the log The user data of a above user;
By the user data of each user, it is respectively written into tables of data corresponding to each user.
In one embodiment, the user data by each user, is respectively written into corresponding to each user Tables of data, comprising:
According to the user data of each user, data file corresponding to each user is generated respectively;
The data text of tables of data corresponding to each user is loaded in the tables of data corresponding to each user respectively Part.
In one embodiment, the method also includes: when detecting that the first memory node breaks down, obtain and institute State the corresponding log of the first memory node;
Correspondingly, the user data by each user is respectively written into tables of data corresponding to each user, packet It includes: the user data of each user is respectively written into the second memory node in tables of data corresponding to each user.
In one embodiment, the user data by each user, is respectively written into corresponding to each user Tables of data, comprising:
When reading the target data recorded in the log, user information corresponding with the target data is obtained;
According to the user information, the target data is written in data file corresponding with the user information;
And the corresponding tables of data of the user information in load data file corresponding with the user information.
According to the second aspect of an embodiment of the present disclosure, a kind of Data Recapture Unit is provided, comprising:
First obtains module, for traversing all data for reading and recording in log, obtains the user data of each user, institute State the user data recorded in log there are two the above user;
Writing module, for being respectively written into tables of data corresponding to each user for the user data of each user.
In one embodiment, the writing module, comprising:
It generates submodule and generates number corresponding to each user respectively for the user data according to each user According to file;
First load submodule, it is right for loading each user institute in the tables of data corresponding to each user respectively The data file for the tables of data answered.
In one embodiment, described device further include:
Second obtains module, saves for obtaining when detecting that the first memory node breaks down with first storage The corresponding log of point;
The user data of each user is respectively written into the second memory node corresponding to each user by writing module In tables of data.
In one embodiment, the writing module, comprising:
Acquisition submodule, for obtaining and the target data when reading the target data recorded in the log Corresponding user information;
Submodule is write, for the target data being written corresponding with the user information according to the user information In data file;
Second load submodule, for the load in tables of data corresponding with the user information and the user information pair The data file answered.
According to the third aspect of an embodiment of the present disclosure, a kind of Data Recapture Unit is provided, comprising:
Processor;
Memory for storage processor executable instruction;
Wherein, the processor is configured to:
Traversal reads all data recorded in log, obtains the user data of each user, and record has two in the log The user data of a above user;
By the user data of each user, it is respectively written into tables of data corresponding to each user.
According to a fourth aspect of embodiments of the present disclosure, a kind of computer readable storage medium is provided, calculating is stored thereon with The step of machine instruction, which realizes any one of above-mentioned first aspect the method embodiment when being executed by processor.
The technical scheme provided by this disclosed embodiment can include the following benefits: the technical solution is by reading After all data recorded in log, directly by the user data of each user recorded in log, it is respectively written into each user institute In corresponding tables of data, to reduce the read-write operation number to disk, the pressure to bottom storage system is reduced, it can be obvious Shorten failure recovery time, avoids fault recovery from failing, improve the overall usability of distributed data base system.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not The disclosure can be limited.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure Example, and together with specification for explaining the principles of this disclosure.
Fig. 1 is the flow chart of data reconstruction method shown according to an exemplary embodiment.
Fig. 2 is the flow chart of data reconstruction method shown according to an exemplary embodiment.
Fig. 3 is the flow chart of data reconstruction method shown according to an exemplary embodiment.
Fig. 4 is the block diagram of Data Recapture Unit shown according to an exemplary embodiment.
Fig. 5 is the block diagram of Data Recapture Unit shown according to an exemplary embodiment.
Fig. 6 is the block diagram of Data Recapture Unit shown according to an exemplary embodiment.
Fig. 7 is the block diagram of Data Recapture Unit shown according to an exemplary embodiment.
Fig. 8 is the block diagram of Data Recapture Unit shown according to an exemplary embodiment.
Fig. 9 is the block diagram of device shown according to an exemplary embodiment.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all implementations consistent with this disclosure.On the contrary, they be only with it is such as appended The example of the consistent device and method of some aspects be described in detail in claims, the disclosure.
In the related technology, when carrying out fault recovery after breaking down, playback Log first is generated each distributed data base Then sub- Log, i.e. temporary file corresponding to user the data of temporary file are written in tables of data, specifically, the relevant technologies Middle failover procedure actually needs to read entire Log from disk first, and the sub- Log of generation is respectively written into disk In, then, then Log corresponding to each user is played back, every sub- Log, and the data that will be recorded in each Log are read from disk It is respectively written into disk in tables of data corresponding to each user;As it can be seen that the relevant technologies need continually to be written and read behaviour to disk Make, this just causes larger pressure to bottom storage system, so as to cause fault recovery is slow or even fault recovery failure, reduces The overall usability of distributed data base system.
To solve the above-mentioned problems, the embodiment of the present disclosure provides a kind of data reconstruction method, and method includes: that traversal is read All data recorded in log obtain the user data of each user, and there are two the user data of the above user for record in log; By the user data of each user, it is respectively written into tables of data corresponding to each user.The embodiment of the present disclosure passes through in reading log After all data of record, directly by the user data of each user recorded in log, it is respectively written into corresponding to each user In tables of data, to reduce the read-write operation number to disk, the pressure to bottom storage system is reduced, event can be obviously shortened Hinder recovery time, avoids fault recovery from failing, improve the overall usability of distributed data base system.
On the basis of above-mentioned analysis, embodiments of the present disclosure is described below.
Fig. 1 is a kind of flow chart of data reconstruction method shown according to an exemplary embodiment;The execution master of this method Body can be server;As shown in Figure 1, this approach includes the following steps 101-102:
In a step 101, traversal reads all data for recording in log, obtains the user data of each user, in log There are two the user data of the above user for record.
It is exemplary, when broken down due to distributed data base system and lead to memory node memory in loss of data When, by playing back Log, all data recorded in log are read from traversal in disk, obtain the user data of each user.
In a step 102, by the user data of each user, it is respectively written into tables of data corresponding to each user.
It is exemplary, according to the user data of each user, data file corresponding to each user is generated respectively;? The data file of tables of data corresponding to each user is loaded in tables of data corresponding to each user respectively.It needs to illustrate , the data file of above-mentioned generation is identical as the format of data file under the catalogue of tables of data in distributed data base.
Optionally, it by data file corresponding to each user, is stored respectively to data corresponding to each user Under the catalogue of table;In the tables of data for needing to read user, the data that are loaded directly under the catalogue of tables of data corresponding to user File.
It is exemplary, when detecting that the first memory node breaks down, in the number stored in memory of the first memory node According to that can lose, at this point, obtaining the log corresponding with first memory node, record has the first memory node in log Data stored in memory;Traversal reads all data recorded in log, obtains the user data of each user;By each use The user data at family is respectively written into the disk of the second memory node in tables of data corresponding to each user, so far, data Recovery process is completed.
The technical solution that the embodiment of the present disclosure provides, after all data for recording in reading log, direct general The user data of each user recorded in log is respectively written into tables of data corresponding to each user, to reduce to disk Read-write operation number reduces the pressure to bottom storage system, can be obviously shortened failure recovery time, fault recovery is avoided to lose It loses, improves the overall usability of distributed data base system.
Fig. 2 is a kind of flow chart of data reconstruction method shown according to an exemplary embodiment.As shown in Fig. 2, in Fig. 1 On the basis of illustrated embodiment, this disclosure relates to data reconstruction method may comprise steps of 201-203:
In step 201, traversal reads all data for recording in log, obtains the user data of each user, in log There are two the user data of the above user for record.
In step 202, according to the user data of each user, the text of data corresponding to each user is generated respectively Part.
In step 203, number corresponding to each user is loaded respectively in the tables of data corresponding to each user According to the data file of table.
It is exemplary, data file corresponding to each user is stored respectively to data corresponding to each user Under the catalogue of table, the data being loaded directly under the catalogue of tables of data corresponding to user in the tables of data for needing to read user are literary Part.
The technical solution that the embodiment of the present disclosure provides, after all data for recording in reading log, direct root According to the user data of each user, the data file in database in tables of data is generated, and is placed in tables of data corresponding to user Catalogue under, so that failover procedure be greatly decreased to the read-write operation number of disk, reduce the pressure to bottom storage system Power can be obviously shortened failure recovery time, fault recovery is avoided to fail, and the entirety for improving distributed data base system is available Property.
Fig. 3 is a kind of flow chart of data reconstruction method shown according to an exemplary embodiment.As shown in figure 3, in Fig. 1 On the basis of illustrated embodiment, this disclosure relates to data reconstruction method may comprise steps of 301-304:
In step 301, traversal reads all data recorded in log.
In step 302, it when reading the target data recorded in the log, obtains corresponding with the target data User information.
In step 303, according to the user information, number corresponding with the user information is written into the target data According in file.
In step 304, and the corresponding tables of data of the user information in load number corresponding with the user information According to file.
The technical solution that the embodiment of the present disclosure provides, after all data for recording in reading log, direct general In the data file of the user data write-in user of user, the data file with the user is loaded in the tables of data of user, Failover procedure is greatly decreased to the read-write operation number of disk, reduces the pressure to bottom storage system, can obviously contract Short failure recovery time, avoids fault recovery from failing, and improves the overall usability of distributed data base system.
Following is embodiment of the present disclosure, can be used for executing embodiments of the present disclosure.
Fig. 4 is a kind of block diagram of Data Recapture Unit shown according to an exemplary embodiment;The device can be using each Kind of mode is implemented, such as all components of implementing device in the server, alternatively, implementing in a coupled manner in server side Component in device;The device can by software, hardware or both be implemented in combination with it is above-mentioned this disclosure relates to method, such as Shown in Fig. 4, which includes: the first acquisition module 401 and writing module 402, in which:
First acquisition module 401 is configured as traversal and reads all data recorded in log, obtains the user of each user Data, there are two the user data of the above user for record in the log;
Writing module 402 is configured as the user data of each user being respectively written into number corresponding to each user According to table.
The device that the embodiment of the present disclosure provides can be used in executing the technical solution of embodiment illustrated in fig. 1, executive mode Similar with beneficial effect, details are not described herein again.
In a kind of possible embodiment, as shown in figure 5, the Data Recapture Unit shown in Fig. 4 can also include that handle is write Module 402 is configured to include: to generate submodule 501 and the first load submodule 502, in which:
It generates submodule 501 and is configured as the user data according to each user, it is right to generate each user institute respectively The data file answered;
First load submodule 502 is configured as loading each use in the tables of data corresponding to each user respectively The data file of tables of data corresponding to family.
In a kind of possible embodiment, described first loads submodule 502 for data corresponding to each user File is stored respectively to the catalogue of tables of data corresponding to each user.
In a kind of possible embodiment, as shown in fig. 6, the Data Recapture Unit shown in Fig. 4 can also include: second Module 601 is obtained, is configured as when detecting that the first memory node breaks down, is obtained corresponding with first memory node The log;
The user data of each user it is right to be respectively written into each user institute in the second memory node by writing module 402 In the tables of data answered.
In a kind of possible embodiment, as shown in fig. 7, the Data Recapture Unit shown in Fig. 4 can also include that handle is write It includes: acquisition submodule 701 that module 402, which is configured to, writes submodule 702 and the second load submodule 703, in which:
Acquisition submodule 701 is configured as when reading the target data recorded in the log, is obtained and the mesh Mark the corresponding user information of data;
It writes submodule 702 to be configured as according to the user information, by target data write-in and the user information In corresponding data file;
Second load submodule 703 is configured as load and the user in tables of data corresponding with the user information The corresponding data file of information.
Fig. 8 is a kind of block diagram of Data Recapture Unit 800 shown according to an exemplary embodiment, Data Recapture Unit 800 are suitable for server, and Data Recapture Unit 800 includes:
Processor 801;
Memory 802 for storage processor executable instruction;
Wherein, processor 801 is configured as:
Traversal reads all data recorded in log, obtains the user data of each user, and record has two in the log The user data of a above user;
By the user data of each user, it is respectively written into tables of data corresponding to each user.
In one embodiment, above-mentioned processor 801 is also configured to:
According to the user data of each user, data file corresponding to each user is generated respectively;
The data text of tables of data corresponding to each user is loaded in the tables of data corresponding to each user respectively Part.
In one embodiment, above-mentioned processor 801 is also configured to:
When detecting that the first memory node breaks down, the log corresponding with first memory node is obtained;
By the user data of each user, it is respectively written into tables of data corresponding to each user in the second memory node In.
In one embodiment, above-mentioned processor 801 is also configured to:
When reading the target data recorded in the log, user information corresponding with the target data is obtained;
According to the user information, the target data is written in data file corresponding with the user information;
And the corresponding tables of data of the user information in load data file corresponding with the user information.
About the device in above-described embodiment, wherein modules execute the concrete mode of operation in related this method Embodiment in be described in detail, no detailed explanation will be given here.
Fig. 9 is a kind of block diagram of device shown according to an exemplary embodiment.For example, device 900 may be provided as One server.Device 900 includes processing component 902, further comprises one or more processors, and by memory 903 Representative memory resource, can be by the instruction of the execution of processing component 902, such as application program for storing.Memory 903 The application program of middle storage may include it is one or more each correspond to one group of instruction module.In addition, processing Component 902 is configured as executing instruction, to execute the above method.
Device 900 can also include the power management that a power supply module 906 is configured as executive device 900, and one has Line or radio network interface 905 are configured as device 900 being connected to network and input and output (I/O) interface 908.Dress Setting 900 can operate based on the operating system for being stored in memory 903, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM or similar.
A kind of non-transitorycomputer readable storage medium, when the instruction in storage medium is held by the processor of device 900 When row, so that device 900 is able to carry out following method:
Traversal reads all data recorded in log, obtains the user data of each user, and record has two in the log The user data of a above user;
By the user data of each user, it is respectively written into tables of data corresponding to each user.
In one embodiment, the user data by each user, is respectively written into corresponding to each user Tables of data, comprising:
According to the user data of each user, data file corresponding to each user is generated respectively;
The data text of tables of data corresponding to each user is loaded in the tables of data corresponding to each user respectively Part.
In one embodiment, the method also includes: when detecting that the first memory node breaks down, obtain and institute State the corresponding log of the first memory node;
Correspondingly, the user data by each user is respectively written into tables of data corresponding to each user, packet It includes: the user data of each user is respectively written into the second memory node in tables of data corresponding to each user.
In one embodiment, the user data by each user, is respectively written into corresponding to each user Tables of data, comprising:
When reading the target data recorded in the log, user information corresponding with the target data is obtained;
According to the user information, the target data is written in data file corresponding with the user information;
And the corresponding tables of data of the user information in load data file corresponding with the user information.
Those skilled in the art will readily occur to its of the disclosure after considering specification and practicing disclosure disclosed herein Its embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by following Claim is pointed out.
It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present disclosure is only limited by the accompanying claims.

Claims (10)

1. a kind of data reconstruction method characterized by comprising
Traversal reads all data for recording in log, obtains the user data of each user, in the log record there are two with The user data of upper user;
By the user data of each user, it is respectively written into tables of data corresponding to each user.
2. the method according to claim 1, wherein the user data by each user, is respectively written into Tables of data corresponding to each user, comprising:
According to the user data of each user, data file corresponding to each user is generated respectively;
The data file of tables of data corresponding to each user is loaded in the tables of data corresponding to each user respectively.
3. the method according to claim 1, wherein the method also includes: when detecting the first memory node When breaking down, the log corresponding with first memory node is obtained;
Correspondingly, the user data by each user, is respectively written into tables of data corresponding to each user, comprising: The user data of each user is respectively written into the second memory node in tables of data corresponding to each user.
4. the method according to claim 1, wherein the user data by each user, is respectively written into Tables of data corresponding to each user, comprising:
When reading the target data recorded in the log, user information corresponding with the target data is obtained;
According to the user information, the target data is written in data file corresponding with the user information;
And the corresponding tables of data of the user information in load data file corresponding with the user information.
5. a kind of Data Recapture Unit characterized by comprising
First obtains module, for traversing all data for reading and recording in log, obtains the user data of each user, the day The user data there are two the above user is recorded in will;
Writing module, for being respectively written into tables of data corresponding to each user for the user data of each user.
6. device according to claim 5, which is characterized in that the writing module, comprising:
Submodule is generated, for the user data according to each user, generates the text of data corresponding to each user respectively Part;
First load submodule, for being loaded corresponding to each user respectively in the tables of data corresponding to each user The data file of tables of data.
7. device according to claim 5, which is characterized in that described device further include:
Second obtains module, for obtaining and first memory node pair when detecting that the first memory node breaks down The log answered;
The user data of each user is respectively written into data corresponding to each user in the second memory node by writing module In table.
8. device according to claim 5, which is characterized in that the writing module, comprising:
Acquisition submodule, for obtaining corresponding with the target data when reading the target data recorded in the log User information;
Submodule is write, for according to the user information, data corresponding with the user information to be written in the target data In file;
Second load submodule, for and the corresponding tables of data of the user information in load it is corresponding with the user information Data file.
9. a kind of Data Recapture Unit characterized by comprising
Processor;
Memory for storage processor executable instruction;
Wherein, the processor is configured to:
Traversal reads all data for recording in log, obtains the user data of each user, in the log record there are two with The user data of upper user;
By the user data of each user, it is respectively written into tables of data corresponding to each user.
10. a kind of computer readable storage medium, is stored thereon with computer instruction, which is characterized in that the instruction is by processor The step of any one of claim 1-4 the method is realized when execution.
CN201810969624.2A 2018-08-23 2018-08-23 Data recovery method and device Active CN109117312B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810969624.2A CN109117312B (en) 2018-08-23 2018-08-23 Data recovery method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810969624.2A CN109117312B (en) 2018-08-23 2018-08-23 Data recovery method and device

Publications (2)

Publication Number Publication Date
CN109117312A true CN109117312A (en) 2019-01-01
CN109117312B CN109117312B (en) 2022-03-01

Family

ID=64860972

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810969624.2A Active CN109117312B (en) 2018-08-23 2018-08-23 Data recovery method and device

Country Status (1)

Country Link
CN (1) CN109117312B (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101714169A (en) * 2009-12-01 2010-05-26 广州从兴电子开发有限公司 Method and system for transmitting data on multiple nodes
US20150019909A1 (en) * 2013-07-11 2015-01-15 International Business Machines Corporation Speculative recovery using storage snapshot in a clustered database
CN104301360A (en) * 2013-07-19 2015-01-21 阿里巴巴集团控股有限公司 Method, log server and system for recording log data
CN105373448A (en) * 2015-10-27 2016-03-02 北京百度网讯科技有限公司 Method and system for recovering failure data in database
CN106254100A (en) * 2016-07-27 2016-12-21 腾讯科技(深圳)有限公司 A kind of data disaster tolerance methods, devices and systems
CN106339279A (en) * 2016-08-24 2017-01-18 杭州华三通信技术有限公司 Service restoration method and device
CN106547646A (en) * 2015-09-23 2017-03-29 阿里巴巴集团控股有限公司 A kind of data backup and restoration methods, data backup and recovery device
CN106599006A (en) * 2015-10-20 2017-04-26 阿里巴巴集团控股有限公司 Data recovery method and device
US20170132091A1 (en) * 2013-09-25 2017-05-11 Amazon Technologies, Inc. Log-structured distributed storage using a single log sequence number space
CN106899648A (en) * 2016-06-20 2017-06-27 阿里巴巴集团控股有限公司 A kind of data processing method and equipment

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101714169A (en) * 2009-12-01 2010-05-26 广州从兴电子开发有限公司 Method and system for transmitting data on multiple nodes
US20150019909A1 (en) * 2013-07-11 2015-01-15 International Business Machines Corporation Speculative recovery using storage snapshot in a clustered database
CN104301360A (en) * 2013-07-19 2015-01-21 阿里巴巴集团控股有限公司 Method, log server and system for recording log data
US20170132091A1 (en) * 2013-09-25 2017-05-11 Amazon Technologies, Inc. Log-structured distributed storage using a single log sequence number space
CN106547646A (en) * 2015-09-23 2017-03-29 阿里巴巴集团控股有限公司 A kind of data backup and restoration methods, data backup and recovery device
CN106599006A (en) * 2015-10-20 2017-04-26 阿里巴巴集团控股有限公司 Data recovery method and device
CN105373448A (en) * 2015-10-27 2016-03-02 北京百度网讯科技有限公司 Method and system for recovering failure data in database
CN106899648A (en) * 2016-06-20 2017-06-27 阿里巴巴集团控股有限公司 A kind of data processing method and equipment
CN106254100A (en) * 2016-07-27 2016-12-21 腾讯科技(深圳)有限公司 A kind of data disaster tolerance methods, devices and systems
CN106339279A (en) * 2016-08-24 2017-01-18 杭州华三通信技术有限公司 Service restoration method and device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
徐安令: ""MySQL数据库的备份与恢复探讨"", 《信息与电脑(理论版)》 *
柴晟 等主编: "《网络数据库应用技术》", 31 August 2013, 北京:北京航空航天大学出版社 *

Also Published As

Publication number Publication date
CN109117312B (en) 2022-03-01

Similar Documents

Publication Publication Date Title
CN109542342B (en) Metadata management and data reconstruction method, equipment and storage medium
CN103415840B (en) Mistake management across hardware layer and software layer
KR101259557B1 (en) Cluster data management system and method for data recovery using parallel processing in cluster data management system
CN103019890B (en) Block-level disk data protection system and method thereof
US8015374B2 (en) Method, system and computer program for backing-up data with centralized control
CN104750755B (en) A kind of data covering method and system after database active-standby switch
WO2015106656A1 (en) Cross-data-center data synchronization method
CN111708738A (en) Method and system for realizing data inter-access between hdfs of hadoop file system and s3 of object storage
CN109376046A (en) A kind of method for testing hard disk, device, equipment and computer readable storage medium
CN113849124B (en) Disk array capacity expansion method and device
CN106095330B (en) A kind of storage method and device of metadata
CN102024021A (en) Method for logging metadata in logical file system
CN114860654A (en) Method and system for dynamically changing Iceberg table Schema based on Flink data stream
CN100570579C (en) system fault locating method
WO2022156369A1 (en) Storage block management information synchronous recording method and system, and terminal and storage medium
CN109117312A (en) Data reconstruction method and device
US10289326B2 (en) Optimized data layout for object store system
CN105488047B (en) Metadata reading/writing method and device
CN107436826B (en) A kind of cold data processing method and terminal
CN107193558B (en) Log file generation method and device
CN109800212A (en) Support the method and middleware of the middleware access HDFS system of affairs form
CN114356768A (en) Method and device for reducing transaction read-write conflict through placeholder
CN103235747B (en) The restoration methods of metadata and system
CN106557385A (en) Data snapshot method and storage device
CN105988917A (en) Method and device for obtaining abnormal information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant