CN109117312A - Data reconstruction method and device - Google Patents
Data reconstruction method and device Download PDFInfo
- Publication number
- CN109117312A CN109117312A CN201810969624.2A CN201810969624A CN109117312A CN 109117312 A CN109117312 A CN 109117312A CN 201810969624 A CN201810969624 A CN 201810969624A CN 109117312 A CN109117312 A CN 109117312A
- Authority
- CN
- China
- Prior art keywords
- user
- data
- tables
- log
- written
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1469—Backup restoration techniques
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Debugging And Monitoring (AREA)
Abstract
The disclosure is directed to data reconstruction method and devices.Method includes: that traversal reads all data recorded in log, obtains the user data of each user, there are two the user data of the above user for record in log;By the user data of each user, it is respectively written into tables of data corresponding to each user.After all data that the disclosure records in reading log, directly by the user data of each user recorded in log, it is respectively written into tables of data corresponding to each user, to reduce the read-write operation number to disk, reduce the pressure to bottom storage system, it can be obviously shortened failure recovery time, fault recovery is avoided to fail, improve the overall usability of distributed data base system.
Description
Technical field
This disclosure relates to technical field of data storage more particularly to data reconstruction method and device.
Background technique
Distributed data base, which refers to, is connected the multiple data storage cells physically dispersed using information autobahn
Get up the unified database in logic of composition one.The basic thought of distributed data base is to lead to data dispersion storage to multiple
It crosses on the data memory node of network connection, to obtain bigger memory capacity and higher concurrent amount of access.In recent years, with
The rapid growth of data volume, distributed data base technique have also obtained quick development.
In general, the data storage procedure of distributed data base system may include: also will while writing data into memory
Data are written in log (Log), and disk can be periodically written in the data in memory;Occur when due to distributed data base system
Failure and when leading to the loss of data in the memory of memory node, need to carry out data recovery by Log.
In the related technology, distributed data base is when carrying out fault recovery, playback Log first, and it is right to generate each user institute
The sub- Log answered, i.e. temporary file;Then Log corresponding to each user is played back again, by what is recorded in Log corresponding to each user
Data are respectively written into tables of data corresponding to each user.
Summary of the invention
To overcome the problems in correlation technique, the embodiment of the present disclosure provides a kind of data reconstruction method and device.Institute
It is as follows to state technical solution:
According to the first aspect of the embodiments of the present disclosure, a kind of data reconstruction method is provided, method includes:
Traversal reads all data recorded in log, obtains the user data of each user, and record has two in the log
The user data of a above user;
By the user data of each user, it is respectively written into tables of data corresponding to each user.
In one embodiment, the user data by each user, is respectively written into corresponding to each user
Tables of data, comprising:
According to the user data of each user, data file corresponding to each user is generated respectively;
The data text of tables of data corresponding to each user is loaded in the tables of data corresponding to each user respectively
Part.
In one embodiment, the method also includes: when detecting that the first memory node breaks down, obtain and institute
State the corresponding log of the first memory node;
Correspondingly, the user data by each user is respectively written into tables of data corresponding to each user, packet
It includes: the user data of each user is respectively written into the second memory node in tables of data corresponding to each user.
In one embodiment, the user data by each user, is respectively written into corresponding to each user
Tables of data, comprising:
When reading the target data recorded in the log, user information corresponding with the target data is obtained;
According to the user information, the target data is written in data file corresponding with the user information;
And the corresponding tables of data of the user information in load data file corresponding with the user information.
According to the second aspect of an embodiment of the present disclosure, a kind of Data Recapture Unit is provided, comprising:
First obtains module, for traversing all data for reading and recording in log, obtains the user data of each user, institute
State the user data recorded in log there are two the above user;
Writing module, for being respectively written into tables of data corresponding to each user for the user data of each user.
In one embodiment, the writing module, comprising:
It generates submodule and generates number corresponding to each user respectively for the user data according to each user
According to file;
First load submodule, it is right for loading each user institute in the tables of data corresponding to each user respectively
The data file for the tables of data answered.
In one embodiment, described device further include:
Second obtains module, saves for obtaining when detecting that the first memory node breaks down with first storage
The corresponding log of point;
The user data of each user is respectively written into the second memory node corresponding to each user by writing module
In tables of data.
In one embodiment, the writing module, comprising:
Acquisition submodule, for obtaining and the target data when reading the target data recorded in the log
Corresponding user information;
Submodule is write, for the target data being written corresponding with the user information according to the user information
In data file;
Second load submodule, for the load in tables of data corresponding with the user information and the user information pair
The data file answered.
According to the third aspect of an embodiment of the present disclosure, a kind of Data Recapture Unit is provided, comprising:
Processor;
Memory for storage processor executable instruction;
Wherein, the processor is configured to:
Traversal reads all data recorded in log, obtains the user data of each user, and record has two in the log
The user data of a above user;
By the user data of each user, it is respectively written into tables of data corresponding to each user.
According to a fourth aspect of embodiments of the present disclosure, a kind of computer readable storage medium is provided, calculating is stored thereon with
The step of machine instruction, which realizes any one of above-mentioned first aspect the method embodiment when being executed by processor.
The technical scheme provided by this disclosed embodiment can include the following benefits: the technical solution is by reading
After all data recorded in log, directly by the user data of each user recorded in log, it is respectively written into each user institute
In corresponding tables of data, to reduce the read-write operation number to disk, the pressure to bottom storage system is reduced, it can be obvious
Shorten failure recovery time, avoids fault recovery from failing, improve the overall usability of distributed data base system.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not
The disclosure can be limited.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure
Example, and together with specification for explaining the principles of this disclosure.
Fig. 1 is the flow chart of data reconstruction method shown according to an exemplary embodiment.
Fig. 2 is the flow chart of data reconstruction method shown according to an exemplary embodiment.
Fig. 3 is the flow chart of data reconstruction method shown according to an exemplary embodiment.
Fig. 4 is the block diagram of Data Recapture Unit shown according to an exemplary embodiment.
Fig. 5 is the block diagram of Data Recapture Unit shown according to an exemplary embodiment.
Fig. 6 is the block diagram of Data Recapture Unit shown according to an exemplary embodiment.
Fig. 7 is the block diagram of Data Recapture Unit shown according to an exemplary embodiment.
Fig. 8 is the block diagram of Data Recapture Unit shown according to an exemplary embodiment.
Fig. 9 is the block diagram of device shown according to an exemplary embodiment.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all implementations consistent with this disclosure.On the contrary, they be only with it is such as appended
The example of the consistent device and method of some aspects be described in detail in claims, the disclosure.
In the related technology, when carrying out fault recovery after breaking down, playback Log first is generated each distributed data base
Then sub- Log, i.e. temporary file corresponding to user the data of temporary file are written in tables of data, specifically, the relevant technologies
Middle failover procedure actually needs to read entire Log from disk first, and the sub- Log of generation is respectively written into disk
In, then, then Log corresponding to each user is played back, every sub- Log, and the data that will be recorded in each Log are read from disk
It is respectively written into disk in tables of data corresponding to each user;As it can be seen that the relevant technologies need continually to be written and read behaviour to disk
Make, this just causes larger pressure to bottom storage system, so as to cause fault recovery is slow or even fault recovery failure, reduces
The overall usability of distributed data base system.
To solve the above-mentioned problems, the embodiment of the present disclosure provides a kind of data reconstruction method, and method includes: that traversal is read
All data recorded in log obtain the user data of each user, and there are two the user data of the above user for record in log;
By the user data of each user, it is respectively written into tables of data corresponding to each user.The embodiment of the present disclosure passes through in reading log
After all data of record, directly by the user data of each user recorded in log, it is respectively written into corresponding to each user
In tables of data, to reduce the read-write operation number to disk, the pressure to bottom storage system is reduced, event can be obviously shortened
Hinder recovery time, avoids fault recovery from failing, improve the overall usability of distributed data base system.
On the basis of above-mentioned analysis, embodiments of the present disclosure is described below.
Fig. 1 is a kind of flow chart of data reconstruction method shown according to an exemplary embodiment;The execution master of this method
Body can be server;As shown in Figure 1, this approach includes the following steps 101-102:
In a step 101, traversal reads all data for recording in log, obtains the user data of each user, in log
There are two the user data of the above user for record.
It is exemplary, when broken down due to distributed data base system and lead to memory node memory in loss of data
When, by playing back Log, all data recorded in log are read from traversal in disk, obtain the user data of each user.
In a step 102, by the user data of each user, it is respectively written into tables of data corresponding to each user.
It is exemplary, according to the user data of each user, data file corresponding to each user is generated respectively;?
The data file of tables of data corresponding to each user is loaded in tables of data corresponding to each user respectively.It needs to illustrate
, the data file of above-mentioned generation is identical as the format of data file under the catalogue of tables of data in distributed data base.
Optionally, it by data file corresponding to each user, is stored respectively to data corresponding to each user
Under the catalogue of table;In the tables of data for needing to read user, the data that are loaded directly under the catalogue of tables of data corresponding to user
File.
It is exemplary, when detecting that the first memory node breaks down, in the number stored in memory of the first memory node
According to that can lose, at this point, obtaining the log corresponding with first memory node, record has the first memory node in log
Data stored in memory;Traversal reads all data recorded in log, obtains the user data of each user;By each use
The user data at family is respectively written into the disk of the second memory node in tables of data corresponding to each user, so far, data
Recovery process is completed.
The technical solution that the embodiment of the present disclosure provides, after all data for recording in reading log, direct general
The user data of each user recorded in log is respectively written into tables of data corresponding to each user, to reduce to disk
Read-write operation number reduces the pressure to bottom storage system, can be obviously shortened failure recovery time, fault recovery is avoided to lose
It loses, improves the overall usability of distributed data base system.
Fig. 2 is a kind of flow chart of data reconstruction method shown according to an exemplary embodiment.As shown in Fig. 2, in Fig. 1
On the basis of illustrated embodiment, this disclosure relates to data reconstruction method may comprise steps of 201-203:
In step 201, traversal reads all data for recording in log, obtains the user data of each user, in log
There are two the user data of the above user for record.
In step 202, according to the user data of each user, the text of data corresponding to each user is generated respectively
Part.
In step 203, number corresponding to each user is loaded respectively in the tables of data corresponding to each user
According to the data file of table.
It is exemplary, data file corresponding to each user is stored respectively to data corresponding to each user
Under the catalogue of table, the data being loaded directly under the catalogue of tables of data corresponding to user in the tables of data for needing to read user are literary
Part.
The technical solution that the embodiment of the present disclosure provides, after all data for recording in reading log, direct root
According to the user data of each user, the data file in database in tables of data is generated, and is placed in tables of data corresponding to user
Catalogue under, so that failover procedure be greatly decreased to the read-write operation number of disk, reduce the pressure to bottom storage system
Power can be obviously shortened failure recovery time, fault recovery is avoided to fail, and the entirety for improving distributed data base system is available
Property.
Fig. 3 is a kind of flow chart of data reconstruction method shown according to an exemplary embodiment.As shown in figure 3, in Fig. 1
On the basis of illustrated embodiment, this disclosure relates to data reconstruction method may comprise steps of 301-304:
In step 301, traversal reads all data recorded in log.
In step 302, it when reading the target data recorded in the log, obtains corresponding with the target data
User information.
In step 303, according to the user information, number corresponding with the user information is written into the target data
According in file.
In step 304, and the corresponding tables of data of the user information in load number corresponding with the user information
According to file.
The technical solution that the embodiment of the present disclosure provides, after all data for recording in reading log, direct general
In the data file of the user data write-in user of user, the data file with the user is loaded in the tables of data of user,
Failover procedure is greatly decreased to the read-write operation number of disk, reduces the pressure to bottom storage system, can obviously contract
Short failure recovery time, avoids fault recovery from failing, and improves the overall usability of distributed data base system.
Following is embodiment of the present disclosure, can be used for executing embodiments of the present disclosure.
Fig. 4 is a kind of block diagram of Data Recapture Unit shown according to an exemplary embodiment;The device can be using each
Kind of mode is implemented, such as all components of implementing device in the server, alternatively, implementing in a coupled manner in server side
Component in device;The device can by software, hardware or both be implemented in combination with it is above-mentioned this disclosure relates to method, such as
Shown in Fig. 4, which includes: the first acquisition module 401 and writing module 402, in which:
First acquisition module 401 is configured as traversal and reads all data recorded in log, obtains the user of each user
Data, there are two the user data of the above user for record in the log;
Writing module 402 is configured as the user data of each user being respectively written into number corresponding to each user
According to table.
The device that the embodiment of the present disclosure provides can be used in executing the technical solution of embodiment illustrated in fig. 1, executive mode
Similar with beneficial effect, details are not described herein again.
In a kind of possible embodiment, as shown in figure 5, the Data Recapture Unit shown in Fig. 4 can also include that handle is write
Module 402 is configured to include: to generate submodule 501 and the first load submodule 502, in which:
It generates submodule 501 and is configured as the user data according to each user, it is right to generate each user institute respectively
The data file answered;
First load submodule 502 is configured as loading each use in the tables of data corresponding to each user respectively
The data file of tables of data corresponding to family.
In a kind of possible embodiment, described first loads submodule 502 for data corresponding to each user
File is stored respectively to the catalogue of tables of data corresponding to each user.
In a kind of possible embodiment, as shown in fig. 6, the Data Recapture Unit shown in Fig. 4 can also include: second
Module 601 is obtained, is configured as when detecting that the first memory node breaks down, is obtained corresponding with first memory node
The log;
The user data of each user it is right to be respectively written into each user institute in the second memory node by writing module 402
In the tables of data answered.
In a kind of possible embodiment, as shown in fig. 7, the Data Recapture Unit shown in Fig. 4 can also include that handle is write
It includes: acquisition submodule 701 that module 402, which is configured to, writes submodule 702 and the second load submodule 703, in which:
Acquisition submodule 701 is configured as when reading the target data recorded in the log, is obtained and the mesh
Mark the corresponding user information of data;
It writes submodule 702 to be configured as according to the user information, by target data write-in and the user information
In corresponding data file;
Second load submodule 703 is configured as load and the user in tables of data corresponding with the user information
The corresponding data file of information.
Fig. 8 is a kind of block diagram of Data Recapture Unit 800 shown according to an exemplary embodiment, Data Recapture Unit
800 are suitable for server, and Data Recapture Unit 800 includes:
Processor 801;
Memory 802 for storage processor executable instruction;
Wherein, processor 801 is configured as:
Traversal reads all data recorded in log, obtains the user data of each user, and record has two in the log
The user data of a above user;
By the user data of each user, it is respectively written into tables of data corresponding to each user.
In one embodiment, above-mentioned processor 801 is also configured to:
According to the user data of each user, data file corresponding to each user is generated respectively;
The data text of tables of data corresponding to each user is loaded in the tables of data corresponding to each user respectively
Part.
In one embodiment, above-mentioned processor 801 is also configured to:
When detecting that the first memory node breaks down, the log corresponding with first memory node is obtained;
By the user data of each user, it is respectively written into tables of data corresponding to each user in the second memory node
In.
In one embodiment, above-mentioned processor 801 is also configured to:
When reading the target data recorded in the log, user information corresponding with the target data is obtained;
According to the user information, the target data is written in data file corresponding with the user information;
And the corresponding tables of data of the user information in load data file corresponding with the user information.
About the device in above-described embodiment, wherein modules execute the concrete mode of operation in related this method
Embodiment in be described in detail, no detailed explanation will be given here.
Fig. 9 is a kind of block diagram of device shown according to an exemplary embodiment.For example, device 900 may be provided as
One server.Device 900 includes processing component 902, further comprises one or more processors, and by memory 903
Representative memory resource, can be by the instruction of the execution of processing component 902, such as application program for storing.Memory 903
The application program of middle storage may include it is one or more each correspond to one group of instruction module.In addition, processing
Component 902 is configured as executing instruction, to execute the above method.
Device 900 can also include the power management that a power supply module 906 is configured as executive device 900, and one has
Line or radio network interface 905 are configured as device 900 being connected to network and input and output (I/O) interface 908.Dress
Setting 900 can operate based on the operating system for being stored in memory 903, such as Windows ServerTM, Mac OS XTM,
UnixTM, LinuxTM, FreeBSDTM or similar.
A kind of non-transitorycomputer readable storage medium, when the instruction in storage medium is held by the processor of device 900
When row, so that device 900 is able to carry out following method:
Traversal reads all data recorded in log, obtains the user data of each user, and record has two in the log
The user data of a above user;
By the user data of each user, it is respectively written into tables of data corresponding to each user.
In one embodiment, the user data by each user, is respectively written into corresponding to each user
Tables of data, comprising:
According to the user data of each user, data file corresponding to each user is generated respectively;
The data text of tables of data corresponding to each user is loaded in the tables of data corresponding to each user respectively
Part.
In one embodiment, the method also includes: when detecting that the first memory node breaks down, obtain and institute
State the corresponding log of the first memory node;
Correspondingly, the user data by each user is respectively written into tables of data corresponding to each user, packet
It includes: the user data of each user is respectively written into the second memory node in tables of data corresponding to each user.
In one embodiment, the user data by each user, is respectively written into corresponding to each user
Tables of data, comprising:
When reading the target data recorded in the log, user information corresponding with the target data is obtained;
According to the user information, the target data is written in data file corresponding with the user information;
And the corresponding tables of data of the user information in load data file corresponding with the user information.
Those skilled in the art will readily occur to its of the disclosure after considering specification and practicing disclosure disclosed herein
Its embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or
Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure
Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by following
Claim is pointed out.
It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and
And various modifications and changes may be made without departing from the scope thereof.The scope of the present disclosure is only limited by the accompanying claims.
Claims (10)
1. a kind of data reconstruction method characterized by comprising
Traversal reads all data for recording in log, obtains the user data of each user, in the log record there are two with
The user data of upper user;
By the user data of each user, it is respectively written into tables of data corresponding to each user.
2. the method according to claim 1, wherein the user data by each user, is respectively written into
Tables of data corresponding to each user, comprising:
According to the user data of each user, data file corresponding to each user is generated respectively;
The data file of tables of data corresponding to each user is loaded in the tables of data corresponding to each user respectively.
3. the method according to claim 1, wherein the method also includes: when detecting the first memory node
When breaking down, the log corresponding with first memory node is obtained;
Correspondingly, the user data by each user, is respectively written into tables of data corresponding to each user, comprising:
The user data of each user is respectively written into the second memory node in tables of data corresponding to each user.
4. the method according to claim 1, wherein the user data by each user, is respectively written into
Tables of data corresponding to each user, comprising:
When reading the target data recorded in the log, user information corresponding with the target data is obtained;
According to the user information, the target data is written in data file corresponding with the user information;
And the corresponding tables of data of the user information in load data file corresponding with the user information.
5. a kind of Data Recapture Unit characterized by comprising
First obtains module, for traversing all data for reading and recording in log, obtains the user data of each user, the day
The user data there are two the above user is recorded in will;
Writing module, for being respectively written into tables of data corresponding to each user for the user data of each user.
6. device according to claim 5, which is characterized in that the writing module, comprising:
Submodule is generated, for the user data according to each user, generates the text of data corresponding to each user respectively
Part;
First load submodule, for being loaded corresponding to each user respectively in the tables of data corresponding to each user
The data file of tables of data.
7. device according to claim 5, which is characterized in that described device further include:
Second obtains module, for obtaining and first memory node pair when detecting that the first memory node breaks down
The log answered;
The user data of each user is respectively written into data corresponding to each user in the second memory node by writing module
In table.
8. device according to claim 5, which is characterized in that the writing module, comprising:
Acquisition submodule, for obtaining corresponding with the target data when reading the target data recorded in the log
User information;
Submodule is write, for according to the user information, data corresponding with the user information to be written in the target data
In file;
Second load submodule, for and the corresponding tables of data of the user information in load it is corresponding with the user information
Data file.
9. a kind of Data Recapture Unit characterized by comprising
Processor;
Memory for storage processor executable instruction;
Wherein, the processor is configured to:
Traversal reads all data for recording in log, obtains the user data of each user, in the log record there are two with
The user data of upper user;
By the user data of each user, it is respectively written into tables of data corresponding to each user.
10. a kind of computer readable storage medium, is stored thereon with computer instruction, which is characterized in that the instruction is by processor
The step of any one of claim 1-4 the method is realized when execution.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810969624.2A CN109117312B (en) | 2018-08-23 | 2018-08-23 | Data recovery method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810969624.2A CN109117312B (en) | 2018-08-23 | 2018-08-23 | Data recovery method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109117312A true CN109117312A (en) | 2019-01-01 |
CN109117312B CN109117312B (en) | 2022-03-01 |
Family
ID=64860972
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810969624.2A Active CN109117312B (en) | 2018-08-23 | 2018-08-23 | Data recovery method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109117312B (en) |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101714169A (en) * | 2009-12-01 | 2010-05-26 | 广州从兴电子开发有限公司 | Method and system for transmitting data on multiple nodes |
US20150019909A1 (en) * | 2013-07-11 | 2015-01-15 | International Business Machines Corporation | Speculative recovery using storage snapshot in a clustered database |
CN104301360A (en) * | 2013-07-19 | 2015-01-21 | 阿里巴巴集团控股有限公司 | Method, log server and system for recording log data |
CN105373448A (en) * | 2015-10-27 | 2016-03-02 | 北京百度网讯科技有限公司 | Method and system for recovering failure data in database |
CN106254100A (en) * | 2016-07-27 | 2016-12-21 | 腾讯科技(深圳)有限公司 | A kind of data disaster tolerance methods, devices and systems |
CN106339279A (en) * | 2016-08-24 | 2017-01-18 | 杭州华三通信技术有限公司 | Service restoration method and device |
CN106547646A (en) * | 2015-09-23 | 2017-03-29 | 阿里巴巴集团控股有限公司 | A kind of data backup and restoration methods, data backup and recovery device |
CN106599006A (en) * | 2015-10-20 | 2017-04-26 | 阿里巴巴集团控股有限公司 | Data recovery method and device |
US20170132091A1 (en) * | 2013-09-25 | 2017-05-11 | Amazon Technologies, Inc. | Log-structured distributed storage using a single log sequence number space |
CN106899648A (en) * | 2016-06-20 | 2017-06-27 | 阿里巴巴集团控股有限公司 | A kind of data processing method and equipment |
-
2018
- 2018-08-23 CN CN201810969624.2A patent/CN109117312B/en active Active
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101714169A (en) * | 2009-12-01 | 2010-05-26 | 广州从兴电子开发有限公司 | Method and system for transmitting data on multiple nodes |
US20150019909A1 (en) * | 2013-07-11 | 2015-01-15 | International Business Machines Corporation | Speculative recovery using storage snapshot in a clustered database |
CN104301360A (en) * | 2013-07-19 | 2015-01-21 | 阿里巴巴集团控股有限公司 | Method, log server and system for recording log data |
US20170132091A1 (en) * | 2013-09-25 | 2017-05-11 | Amazon Technologies, Inc. | Log-structured distributed storage using a single log sequence number space |
CN106547646A (en) * | 2015-09-23 | 2017-03-29 | 阿里巴巴集团控股有限公司 | A kind of data backup and restoration methods, data backup and recovery device |
CN106599006A (en) * | 2015-10-20 | 2017-04-26 | 阿里巴巴集团控股有限公司 | Data recovery method and device |
CN105373448A (en) * | 2015-10-27 | 2016-03-02 | 北京百度网讯科技有限公司 | Method and system for recovering failure data in database |
CN106899648A (en) * | 2016-06-20 | 2017-06-27 | 阿里巴巴集团控股有限公司 | A kind of data processing method and equipment |
CN106254100A (en) * | 2016-07-27 | 2016-12-21 | 腾讯科技(深圳)有限公司 | A kind of data disaster tolerance methods, devices and systems |
CN106339279A (en) * | 2016-08-24 | 2017-01-18 | 杭州华三通信技术有限公司 | Service restoration method and device |
Non-Patent Citations (2)
Title |
---|
徐安令: ""MySQL数据库的备份与恢复探讨"", 《信息与电脑(理论版)》 * |
柴晟 等主编: "《网络数据库应用技术》", 31 August 2013, 北京:北京航空航天大学出版社 * |
Also Published As
Publication number | Publication date |
---|---|
CN109117312B (en) | 2022-03-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109542342B (en) | Metadata management and data reconstruction method, equipment and storage medium | |
CN103415840B (en) | Mistake management across hardware layer and software layer | |
KR101259557B1 (en) | Cluster data management system and method for data recovery using parallel processing in cluster data management system | |
CN103019890B (en) | Block-level disk data protection system and method thereof | |
US8015374B2 (en) | Method, system and computer program for backing-up data with centralized control | |
CN104750755B (en) | A kind of data covering method and system after database active-standby switch | |
WO2015106656A1 (en) | Cross-data-center data synchronization method | |
CN111708738A (en) | Method and system for realizing data inter-access between hdfs of hadoop file system and s3 of object storage | |
CN109376046A (en) | A kind of method for testing hard disk, device, equipment and computer readable storage medium | |
CN113849124B (en) | Disk array capacity expansion method and device | |
CN106095330B (en) | A kind of storage method and device of metadata | |
CN102024021A (en) | Method for logging metadata in logical file system | |
CN114860654A (en) | Method and system for dynamically changing Iceberg table Schema based on Flink data stream | |
CN100570579C (en) | system fault locating method | |
WO2022156369A1 (en) | Storage block management information synchronous recording method and system, and terminal and storage medium | |
CN109117312A (en) | Data reconstruction method and device | |
US10289326B2 (en) | Optimized data layout for object store system | |
CN105488047B (en) | Metadata reading/writing method and device | |
CN107436826B (en) | A kind of cold data processing method and terminal | |
CN107193558B (en) | Log file generation method and device | |
CN109800212A (en) | Support the method and middleware of the middleware access HDFS system of affairs form | |
CN114356768A (en) | Method and device for reducing transaction read-write conflict through placeholder | |
CN103235747B (en) | The restoration methods of metadata and system | |
CN106557385A (en) | Data snapshot method and storage device | |
CN105988917A (en) | Method and device for obtaining abnormal information |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |