WO2017049965A1 - 数据备份的方法和数据处理系统 - Google Patents
数据备份的方法和数据处理系统 Download PDFInfo
- Publication number
- WO2017049965A1 WO2017049965A1 PCT/CN2016/085608 CN2016085608W WO2017049965A1 WO 2017049965 A1 WO2017049965 A1 WO 2017049965A1 CN 2016085608 W CN2016085608 W CN 2016085608W WO 2017049965 A1 WO2017049965 A1 WO 2017049965A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- storage
- time point
- backup
- files
- storage file
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1461—Backup scheduling policy
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
- G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/835—Timestamp
Definitions
- the present invention relates to the field of databases, and in particular, to a data backup method and a data processing system.
- the distributed database When the distributed database writes data, the data is stored in one or more sub-tables of the user table. When certain conditions are met, the data is backed up to ensure the reliability of the data.
- the present application provides a data backup method and a data processing system. By recording a data backup time point, determining backup incremental data, shortening the time of incremental data backup, and reducing the consumption of network data and disk resources by incremental data backup. .
- the application provides a method for data backup, the method comprising:
- the second storage file is merged into at least two third storage files, wherein the second storage includes the first storage file and the newly generated storage file after the first time point to the current time point; At least one third storage file thereafter is incrementally backed up.
- the incremental backup of the at least one third storage file after the first time point includes: obtaining a time stamp range of the merged at least two third storage files; according to each third storage The timestamp range of the file, with the first time point as the demarcation point, determines the third storage file after the first time point, and performs an incremental backup.
- the first storage file is backed up according to a preset rule.
- obtaining a time stamp range of at least two third storage files includes: obtaining a time stamp range from a metadata block of each third storage file.
- the method further includes: recording a second time point of the incremental backup operation, to use Merge or back up the newly generated storage file according to the second time point.
- the application provides a data processing system, the system comprising:
- a backup module configured to back up the first storage file stored on the first storage medium at a first time point, and record a first time point of the backup operation
- a merge module configured to be the second storage file on the first storage medium When the quantity meets the preset threshold, the second storage file is merged into at least two third storage files by the first time point of the record, wherein the second storage includes the first storage file and after the first time point The newly generated storage file at the current time point; the backup module is further configured to back up at least one third storage file after the first time point.
- the data processing system further includes: an obtaining module, configured to obtain a time stamp range of the merged at least two third storage files; a determining module, a time stamp range for each third storage file, The third storage file after the first time point is determined by using the first time point as a demarcation point, and the backup module performs an incremental backup on the third storage file after the first time point determined by the determining module.
- the backup module is specifically configured to back up the first storage file according to a preset condition.
- the obtaining module is specifically configured to obtain a time stamp range from a metadata block of each third storage file.
- the backup module is further configured to record a second time point of the incremental backup operation for merging or backing up the newly generated storage file according to the second time point.
- the present application provides a data processing system including a processor and a memory, the processor is configured to back up a first storage file stored in the memory according to a preset rule stored in the memory, and record a backup operation. a first time point; when the number of the second storage files in the memory exceeds a preset threshold, the second storage file is merged into at least the first time point of the record as a demarcation point Two third storage files, wherein the second storage includes the first storage file and the newly generated storage file after the first time point to the current time point; the first time point of the record is used as a demarcation point, and after the first time point is backed up The third storage file.
- the processor obtains a time stamp range of the merged at least two third storage files; and determines, by using the first time point as a demarcation point, the third storage file after the first time point, and increases Volume backup.
- the processor obtains a timestamp range from a metadata block of each of the third stored files.
- the processor records a second point in time of the incremental backup operation for merging or backing up the newly generated storage file according to the second point in time.
- the data backup method and the data processing system provided by the present application determine the backup incremental data by recording the time point of the data backup, thereby avoiding the process of reading the full table data by the incremental data storage, and shortening the time of the incremental data backup. Reduces the consumption of network and disk resources by incremental data backups.
- Figure 1 is a schematic diagram of a sub-table in a user table
- FIG. 2 is a flowchart of a method for data backup of a distributed database according to an embodiment of the present invention
- FIG. 3 is a flowchart of another method for data backup of a distributed database according to an embodiment of the present invention.
- FIG. 4 is a schematic diagram of a data processing system according to an embodiment of the present invention.
- FIG. 5 is a schematic diagram of another data processing system according to an embodiment of the present invention.
- FIG. 6 is a schematic diagram of still another data processing system according to an embodiment of the present invention.
- the embodiment of the present invention is applicable to a database stored in a key-value type storage mode, that is, storing data that the user needs to store in the Value part, and constructing a Key corresponding to the Value.
- a key-value type storage mode that is, storing data that the user needs to store in the Value part, and constructing a Key corresponding to the Value.
- the user passes the value.
- the Key index finds the corresponding Value, where the data is stored. It is naturally sorted according to Key's lexicographic order.
- FIG. 1 is a schematic diagram of a child table in a user table, where Region- in Figure 1 Key-A in 1 represents an infinitesimal value in lexicographical order, and Key-Y in Region-M represents an infinite value in lexicographic order.
- the data can be written to both the WAL and the Region's memory.
- the data in the Region memory meets the preset memory threshold, the data in the Region is solidified to the disk, and the storage file Hfile is generated on the disk.
- the metadata block of the Hfile stores the timestamp of the data record in the Region. range.
- the multiple storage files Hfile on the disk are merged to obtain at least one storage file Hfile.
- FIG. 2 is a flowchart of a data backup method according to an embodiment of the present invention.
- the execution body of the method 100 is a data processing system, and the method 100 includes:
- Step 110 Backing up the first storage file, and recording a first time point of the backup operation, where the first storage file is a plurality of storage files stored on the first storage medium before the first time point;
- the second storage file is merged according to the first time point to obtain at least two third storage files.
- the data processing system can include a plurality of terminals, each terminal including a first storage medium.
- the first storage medium may be specifically a magnetic disk.
- the first storage file may store files in whole or in part on the disk of one or more terminals. At the first point in time, all or part of the storage file on the backup disk is backed up, and the time point of the current backup file is recorded.
- the first storage file may be backed up according to a preset rule.
- the preset rule may be a condition for data backup according to user requirements. For example, the user needs to perform a full backup on the first day of each month and an incremental backup every day.
- the preset rule can be implemented by a timer or other logical method that implements the user's requirements. Backing up data through preset rules is convenient for users to use and to ensure data reliability.
- backing up the first storage file may also be an artificial subjective act.
- the second storage file is a storage file stored on the first storage medium at the current time point, and the second storage file includes the backed up first storage file and the newly generated storage between the first time point and the current time point. file.
- the third storage file is a new storage file generated by merging the second storage files.
- the storage file after the first time point is incrementally backed up, and all the stored files are read.
- the timestamp range of the piece query the storage file after the first time point, and incrementally back up the data in the storage file according to the query result.
- the timestamp range of the merged at least two third storage files is obtained, and the timestamp range may be obtained from the metadata block of each third storage file.
- the method 100 further includes: recording a second time point of the incremental backup operation, for The newly generated storage file is merged or backed up according to the second time point.
- the data processing system After the data processing system performs an incremental backup on the data, the data processing system records the time point of the current incremental backup operation, so that when the number of stored files on the disk reaches a preset threshold in the time period after the time point, the data is The processing system merges the storage files according to the recorded time point, and backs up the merged incremental data.
- the method for backing up the distributed database data provided by the embodiment of the present invention, by recording the time point of the last backup, determining the file of the incremental backup, performing the incremental backup, and avoiding the process of reading the full table data by the incremental data backup. Reduces the time for incremental data backups and reduces the consumption of network and disk resources by incremental data backups.
- incrementally backing up at least two third storage files according to the first time point including:
- the data processing system reads the time stamp range of all the stored files after the merge, and determines, according to the time stamp range of each storage file, the third storage file that belongs to the time stamp range after the first time point, and the backup determines the first The third storage file after a point in time.
- the file of the incremental backup is determined by recording the time point of the last backup, and the incremental backup is performed, thereby avoiding the incremental data backup read.
- the process of taking full table data shortens the time for incremental data backup and reduces the consumption of network and disk resources by incremental data backup.
- the technical solution of the embodiment of the present invention is described in detail by taking the first storage medium as a disk and the storage file on the disk satisfying the five storage files as an example. It should be understood that this is only an example of the technical solution of the embodiments of the present invention, and is not intended to limit the embodiments of the present invention.
- the three storage files stored on the disk are backed up, namely Hfile1, Hfile2, and Hfile3, and the terminal records the time point T1 of the backup operation; during the time from the time point T1 to the time point T2, the disk is newly generated 2
- the storage files Hfile4 and Hfile5 are stored.
- the storage file on the disk satisfies the preset number threshold.
- the three storage files Hfile1, Hfile2 and Hfile3 before the time point T1 are merged into one storage file Hfile6.
- the two storage files after the time point T1 are merged into one storage file Hfile7; at the time point T3, the terminal reads the time stamp range of the merged two storage files Hfile6 and Hfile7, and determines the storage file after the time point T1.
- Hfile7, the storage file Hfile7 determined by the backup, the data in the storage file is the incremental data after the time point T1, and the backup process is called an incremental backup.
- the time point T1, the time point T2, and the time point T3 are three time points arranged in chronological order.
- the storage file Hfile is represented by a number 1-7, and the different storage files are used for the purpose of clearly describing the technical solution of the embodiment of the present invention.
- the storage file is distinguished according to each The metadata block contents of the storage file are distinguished.
- the merging process of the storage file is performed according to the preset number of the storage files on the first storage medium, and only the technical solution of the embodiment of the present invention is described in detail, in the embodiment of the present invention.
- the conditions for triggering the first storage for storing the file merge may also adopt other conditions, and are not limited in the embodiment of the present invention.
- FIG. 4 to FIG. 6 a data processing system according to an embodiment of the present invention will be described in detail.
- FIG. 4 is a schematic block diagram of a data processing system according to an embodiment of the present invention.
- the data processing system 400 shown in FIG. 5 includes a backup module 410 and a merge module 420.
- the backup module 410 is configured to back up the first storage file and record the first time point of the backup operation, where the first storage file is a plurality of storage files stored on the first storage medium before the first time point;
- the merging module 420 is configured to: when the number of the second storage files on the first storage medium meets the preset threshold, merge the second storage file according to the first time point to obtain at least two third storage files;
- the backup module 410 is further configured to perform an incremental backup on the at least two third storage files according to the first time point, where the incremental backup is to backup at least one third storage file after the first time point.
- the first storage medium may be specifically a magnetic disk.
- the first storage file may store files in whole or in part on the disk of one or more terminals.
- the backup module 410 backs up all or part of the storage file on the disk, and records the time point of the current backup file.
- the backup module 410 may back up the first storage file according to a preset rule.
- the preset rule may be a condition for data backup according to user requirements. Backing up data through preset rules is convenient for users to use and to ensure data reliability.
- backing up the first storage file may also be an artificial subjective act.
- the second storage file is a storage file stored on the first storage medium at the current time point, and the second storage file includes the backed up first storage file and the newly generated storage file between the first time point and the current time point.
- the third storage file is a new storage file generated by merging the second storage files.
- the backup module 410 performs incremental backup on the storage file after the first time point, reads the time stamp range of all the stored files, queries the storage file after the first time point, and incrementally backs up according to the query result. Store data in a file.
- the method for backing up the distributed database data provided by the embodiment of the present invention, by recording the time point of the last backup, determining the file of the incremental backup, performing the incremental backup, and avoiding the process of reading the full table data by the incremental data backup. Reduces the time for incremental data backups and reduces the consumption of network and disk resources by incremental data backups.
- the data processing system further includes an obtaining module 430 and a determining module 440.
- the obtaining module 430 is configured to obtain a time stamp range of at least two third storage files.
- a determining module 440 configured to determine, according to a timestamp range and a first time point of the at least two the third storage files, at least one third storage file of the incremental backup;
- the backup module 410 is configured to back up at least one of the third storage files.
- the obtaining module 430 reads the time stamp range of all the stored files after the merge, and according to the time stamp range of each storage file, the determining module 440 determines the third storage file that belongs to the time stamp range after the first time point, and backs up. The module 410 backs up the determined third storage file after the first time point.
- the obtaining module 430 may obtain a time stamp range from a metadata block of each third storage file.
- the backup module 410 is further configured to record a second time point of the incremental backup operation, for combining or backing up the newly generated storage file according to the second time point.
- the time point of the current incremental backup operation is recorded, so that the merged module is reached when the number of stored files on the disk reaches a preset threshold within a time period after the time point.
- 420 merges the storage files according to the recorded time point, and the backup module 410 performs an incremental backup on the merged storage files after the time point.
- the method for backing up the distributed database data provided by the embodiment of the present invention, by recording the time point of the last backup, determining the file of the incremental backup, performing the incremental backup, and avoiding the process of reading the full table data by the incremental data backup. Reduces the time for incremental data backups and reduces the consumption of network and disk resources by incremental data backups.
- the data processing system according to the embodiment of the present invention corresponds to the execution body of the method 100 according to the embodiment of the present invention, and the above and other operations and/or operations of the respective modules in the data processing system.
- the functions are respectively implemented in order to implement the corresponding processes of the respective methods in FIG. 2 and FIG. 3, and are not described herein again for the sake of brevity.
- FIG. 6 is a schematic diagram of still another data processing system according to an embodiment of the present invention.
- the data processing system 600 includes a processor 610 and a memory 620 and a communication bus system 630.
- the processor 610 and the memory 620 are shown in FIG. They are connected by a communication bus system 630. among them,
- the processor 610 is configured to back up the first storage file, and record a first time point of the backup operation, where the first storage file is a plurality of storage files stored on the first storage medium before the first time point;
- the processor 610 is configured to: when the number of the second storage files on the first storage medium meets the preset threshold, merge the second storage file according to the first time point to obtain at least two third storage files;
- the processor 610 is further configured to perform an incremental backup on the at least two third storage files according to the first time point, where the incremental backup is to backup at least one third storage file after the first time point.
- the first storage medium may be specifically a magnetic disk.
- the first storage file may store files in whole or in part on the disk of one or more terminals.
- the processor 610 backs up all or part of the storage file on the disk and records the time point of the current backup file.
- the processor 610 may back up the first storage file according to a preset rule, and the preset rule may be a condition for data backup set according to a user's requirement. In the embodiment of the present invention, the processor 610 may perform the backup of the first storage file by subjectively executing the instruction issued during the data backup.
- the second storage file is a storage file stored on the first storage medium at the current time point, and the second storage file may include the backed up first storage file and the newly generated storage file from the first time point to the current time point.
- the third storage file is a new storage file generated by merging the second storage files.
- the processor 610 performs incremental backup on the storage file after the first time point, reads the time stamp range of all the stored files, queries the storage file after the first time point, and incrementally backs up the data in the storage file according to the query result.
- the method for backing up the distributed database data provided by the embodiment of the present invention, by recording the time point of the last backup, determining the file of the incremental backup, performing the incremental backup, and avoiding the process of reading the full table data by the incremental data backup. Reduces the time for incremental data backups and reduces the consumption of network and disk resources by incremental data backups.
- the processor 610 may be a central processing unit (CPU), and the processor 610 may also be other general-purpose processors, digital signal processors (DSPs), and application specific integrated circuits. (ASIC), off-the-shelf programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and more.
- the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
- the bus system 630 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 630 in the figure.
- each step of the foregoing method may be completed by an integrated logic circuit of hardware in the processor 610 or an instruction in a form of software.
- the steps of the method disclosed in the embodiments of the present invention may be directly implemented as a hardware processor, or may be performed by a combination of hardware and software modules in the processor.
- the software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like.
- the storage medium is located in the memory, and the processor 610 reads the information in the memory and completes the steps of the above method in combination with the hardware thereof. To avoid repetition, it will not be described in detail here.
- a memory which can include read only memory and random access memory, and provides instructions and data to processor 610.
- a portion of the memory may also include a non-volatile random access memory.
- the memory can also store information of the device type.
- the processor 610 is configured to obtain a time stamp range of at least two third storage files.
- the processor 610 is configured to determine, according to the timestamp range and the first time point of the at least two the third storage files, the at least one third storage file of the incremental backup;
- the processor 610 is configured to back up at least one of the third storage files.
- the processor 610 reads a time stamp range of all the merged storage files, and according to the time stamp range in each storage file metadata block, the processor 610 determines that the time stamp range belongs to the third time after the first time point. The file is stored, and the processor 610 backs up the determined third storage file after the first time point.
- the data processing system 700 according to the embodiment of the present invention corresponds to the data processing system 400 according to the embodiment of the present invention, and the above and other operations of the respective modules in the data processing system 700 and/or Or the functions are respectively implemented in order to implement the corresponding processes of the respective methods in FIG. 2 and FIG. 3, and are not described herein again for the sake of brevity.
- the steps of a method or algorithm described in connection with the embodiments disclosed herein can be implemented in hardware, a software module executed by a processor, or a combination of both.
- the software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or technical field. Any other form of storage medium known.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Retry When Errors Occur (AREA)
Abstract
Description
Claims (10)
- 一种数据备份的方法,其特征在于,所述方法包括:备份第一存储文件,并记录备份操作的第一时间点,其中,所述第一存储文件为在所述第一时间点之前,存储在第一存储介质上的多个存储文件;当所述第一存储介质上的第二存储文件的数量满足预设阈值时,根据所述第一时间点,合并所述第二存储文件,得到至少两个第三存储文件;根据所述第一时间点,对所述至少两个第三存储文件进行增量备份,所述增量备份为备份所述第一时间点之后的至少一个所述第三存储文件。
- 根据权利要求1所述的方法,其特征在于,所述根据所述第一时间点,对所述至少两个第三存储文件进行增量备份,包括:获取至少两个所述第三存储文件的时间戳范围;根据至少两个所述第三存储文件的时间戳范围和所述第一时间点,确定增量备份的至少一个所述第三存储文件;备份至少一个所述第三存储文件。
- 根据权利要求1所述的方法,其特征在于,所述备份第一存储文件,包括:根据预设规则,备份所述第一存储文件。
- 根据权利要求2所述的方法,其特征在于,所述获取至少两个所述第三存储文件的时间戳范围,包括:从每个所述第三存储文件的元数据块中获取时间戳范围。
- 根据权利要求1至4任一项所述的方法,其特征在于,在所述根据所述第一时间点,对所述至少两个第三存储文件进行增量备份之后,所述方法还包括:记录增量备份操作的第二时间点,以用于根据所述第二时间点合并或备份新生成的存储文件。
- 一种数据处理系统,其特征在于,所述数据处理系统包括:备份模块,用于备份第一存储文件,并记录备份操作的第一时间点,其中, 所述第一存储文件为在所述第一时间点之前,存储在第一存储介质上的多个存储文件;合并模块,用于当所述第一存储介质上的第二存储文件的数量满足预设阈值时,根据所述第一时间点,合并所述第二存储文件,得到至少两个第三存储文件;所述备份模块还用于,根据所述第一时间点,对所述至少两个第三存储文件进行增量备份,所述增量备份为备份所述第一时间点之后的至少一个所述第三存储文件。
- 根据权利6所述的数据处理系统,其特征在于,所述数据处理系统还包括获取模块和确定模块,所述获取模块,用于获取至少两个所述第三存储文件的时间戳范围;所述确定模块,用于根据至少两个所述第三存储文件的时间戳范围和所述第一时间点,确定增量备份的至少一个所述第三存储文件;所述备份模块用于备份至少一个所述第三存储文件。
- 根据权利要求6所述的数据处理系统,其特征在于,所述备份模块具体用于,根据预设条件,备份所述第一存储文件。
- 根据权利要求7所述的数据处理系统,其特征在于,所述获取模块具体用于,从每个所述第三存储文件的元数据块中获取时间戳范围。
- 根据权利要求6至9任一项所述的数据处理系统,其特征在于,所述备份模块还用于,记录增量备份操作的第二时间点,以用于根据所述第二时间点合并或备份新生成的存储文件。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
BR112017023803-9A BR112017023803B1 (pt) | 2015-09-25 | 2016-06-13 | Método de backup de dados e sistema de processamento de dados |
EP16847847.7A EP3287910B1 (en) | 2015-09-25 | 2016-06-13 | Data backup method and data processing system |
US15/927,332 US11119863B2 (en) | 2015-09-25 | 2018-03-21 | Data backup method and data processing system |
US15/927,301 US11132260B2 (en) | 2015-09-25 | 2018-03-21 | Data processing method and apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510620975.9 | 2015-09-25 | ||
CN201510620975.9A CN105243109B (zh) | 2015-09-25 | 2015-09-25 | 数据备份的方法和数据处理系统 |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2016/087458 Continuation WO2018000191A1 (zh) | 2015-09-25 | 2016-06-28 | 一种数据处理的方法和装置 |
Related Child Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2016/087458 Continuation WO2018000191A1 (zh) | 2015-09-25 | 2016-06-28 | 一种数据处理的方法和装置 |
US15/927,332 Continuation US11119863B2 (en) | 2015-09-25 | 2018-03-21 | Data backup method and data processing system |
US15/927,301 Continuation US11132260B2 (en) | 2015-09-25 | 2018-03-21 | Data processing method and apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017049965A1 true WO2017049965A1 (zh) | 2017-03-30 |
Family
ID=55040757
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2016/085608 WO2017049965A1 (zh) | 2015-09-25 | 2016-06-13 | 数据备份的方法和数据处理系统 |
Country Status (5)
Country | Link |
---|---|
US (1) | US11119863B2 (zh) |
EP (1) | EP3287910B1 (zh) |
CN (2) | CN105243109B (zh) |
BR (1) | BR112017023803B1 (zh) |
WO (1) | WO2017049965A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111274253A (zh) * | 2020-01-10 | 2020-06-12 | 北京奇艺世纪科技有限公司 | 全量分区视图的生成方法、装置、存储介质和电子装置 |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105243109B (zh) | 2015-09-25 | 2021-10-15 | 华为技术有限公司 | 数据备份的方法和数据处理系统 |
US11132260B2 (en) | 2015-09-25 | 2021-09-28 | Huawei Technologies Co., Ltd. | Data processing method and apparatus |
CN108780447A (zh) * | 2016-03-02 | 2018-11-09 | 华为技术有限公司 | 差异数据备份的方法和设备 |
BR112017020732A8 (pt) * | 2016-06-28 | 2022-08-23 | Huawei Tech Co Ltd | Método e aparelho de processamento de dados, e um produto de programa de computador |
CN107168802A (zh) * | 2017-05-18 | 2017-09-15 | 郑州云海信息技术有限公司 | 一种云存储中小文件的合并方法及装置 |
CN107832169B (zh) * | 2017-08-09 | 2020-12-18 | 平安壹钱包电子商务有限公司 | 内存数据迁移方法、装置、终端设备和存储介质 |
CN109408279A (zh) * | 2017-08-16 | 2019-03-01 | 北京京东尚科信息技术有限公司 | 数据备份方法和装置 |
CN110232000B (zh) * | 2018-03-05 | 2022-02-25 | 腾讯科技(深圳)有限公司 | 数据存储管理方法及装置 |
CN108573034A (zh) * | 2018-03-30 | 2018-09-25 | 北京辰森世纪科技股份有限公司 | 数据备份方法、装置、计算机设备及可读存储介质 |
CN109981774B (zh) * | 2019-03-22 | 2021-02-19 | 联想(北京)有限公司 | 数据缓存方法和数据缓存装置 |
CN110909062A (zh) * | 2019-11-29 | 2020-03-24 | 迈普通信技术股份有限公司 | 数据处理方法、装置、电子设备及可读存储介质 |
CN111881095A (zh) * | 2020-07-29 | 2020-11-03 | 天津中新智冠信息技术有限公司 | 一种文件变更的处理方法、装置、存储介质及电子设备 |
CN112256487A (zh) * | 2020-11-12 | 2021-01-22 | 北京联创信安科技股份有限公司 | 一种数据备份的方法、装置、设备及存储介质 |
CN113791736A (zh) * | 2021-09-15 | 2021-12-14 | 京东科技信息技术有限公司 | 数据迁移方法、网卡设备、服务器及数据迁移系统 |
WO2023125412A1 (en) * | 2021-12-27 | 2023-07-06 | Huawei Cloud Computing Technologies Co., Ltd. | Method and system for synchronous data replication |
CN114924911B (zh) * | 2022-05-19 | 2023-04-14 | 广州鼎甲计算机科技有限公司 | Windows操作系统有效数据备份方法、装置、设备和存储介质 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7809691B1 (en) * | 2005-02-22 | 2010-10-05 | Symantec Operating Corporation | System and method of applying incremental changes prior to initialization of a point-in-time copy |
CN102541940A (zh) * | 2010-12-31 | 2012-07-04 | 上海可鲁系统软件有限公司 | 一种工业数据库数据完整性管控方法 |
CN102999400A (zh) * | 2012-11-22 | 2013-03-27 | 中国电信股份有限公司云计算分公司 | 一种云存储系统数据备份方法及装置 |
CN105243109A (zh) * | 2015-09-25 | 2016-01-13 | 杭州华为数字技术有限公司 | 数据备份的方法和数据处理系统 |
Family Cites Families (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1008048B1 (en) * | 1997-08-29 | 2001-10-31 | Hewlett-Packard Company | Data backup and recovery systems |
US7134041B2 (en) | 2001-09-20 | 2006-11-07 | Evault, Inc. | Systems and methods for data backup over a network |
US7234077B2 (en) | 2003-06-24 | 2007-06-19 | International Business Machines Corporation | Rapid restoration of file system usage in very large file systems |
CA2452251C (en) * | 2003-12-04 | 2010-02-09 | Timothy R. Jewell | Data backup system and method |
WO2007052531A1 (ja) | 2005-11-04 | 2007-05-10 | Matsushita Electric Industrial Co., Ltd. | ファイル記録装置及び撮像装置 |
US7904425B2 (en) * | 2005-12-13 | 2011-03-08 | International Business Machines Corporation | Generating backup sets to a specific point in time |
CN101064730A (zh) * | 2006-09-21 | 2007-10-31 | 上海交通大学 | 计算机网络数据文件本地和远程的备份方法 |
US8005797B1 (en) * | 2008-04-01 | 2011-08-23 | Acronis Inc. | File-level continuous data protection with access to previous versions |
CN101394424B (zh) | 2008-10-27 | 2011-11-09 | 中国科学院计算技术研究所 | 一种磁盘级网络数据备份的系统及方法 |
CN101650677A (zh) | 2009-07-27 | 2010-02-17 | 浪潮电子信息产业股份有限公司 | 一种基于Delta增量的文件数据备份方法 |
CN101729671A (zh) | 2009-12-31 | 2010-06-09 | 宇龙计算机通信科技(深圳)有限公司 | 一种终端、备份文件管理的方法及系统 |
US9495264B2 (en) * | 2010-08-09 | 2016-11-15 | Veritas Technologies Llc | Data replication techniques using incremental checkpoints |
CN103593256B (zh) * | 2012-08-15 | 2017-05-24 | 阿里巴巴集团控股有限公司 | 一种基于多层排重的虚机快照备份方法和系统 |
CN102955861B (zh) * | 2012-11-30 | 2017-04-12 | 华为技术有限公司 | 一种基于备份文件的索引文件生成方法和装置 |
CN103049353B (zh) | 2012-12-21 | 2016-01-06 | 华为技术有限公司 | 一种数据备份方法及相关装置 |
CN104081329A (zh) | 2013-01-25 | 2014-10-01 | 株式会社东芝 | 对数据进行备份的备份存储系统、备份存储装置以及方法 |
CN103793493B (zh) * | 2014-01-21 | 2017-12-29 | 深圳市元征科技股份有限公司 | 一种处理车载终端海量数据的方法和系统 |
CN103778033A (zh) | 2014-01-26 | 2014-05-07 | 宝龙计算机系统(湖南)有限公司 | 一种类Unix操作系统多时间点备份的方法及装置 |
CN104199901A (zh) | 2014-08-27 | 2014-12-10 | 浪潮集团有限公司 | 一种批量合并hbase表regions的方法 |
CN104199963A (zh) | 2014-09-19 | 2014-12-10 | 浪潮(北京)电子信息产业有限公司 | HBase数据备份恢复的方法和装置 |
US10078555B1 (en) | 2015-04-14 | 2018-09-18 | EMC IP Holding Company LLC | Synthetic full backups for incremental file backups |
CN105005617B (zh) | 2015-07-21 | 2018-10-12 | 领航动力信息系统有限公司 | 一种时间序列数据的存储方法及装置 |
BR112017020732A8 (pt) | 2016-06-28 | 2022-08-23 | Huawei Tech Co Ltd | Método e aparelho de processamento de dados, e um produto de programa de computador |
US10116451B2 (en) | 2016-11-11 | 2018-10-30 | Intel Corporation | File backups using a trusted storage region |
-
2015
- 2015-09-25 CN CN201510620975.9A patent/CN105243109B/zh active Active
- 2015-09-25 CN CN202010034066.8A patent/CN111240902A/zh active Pending
-
2016
- 2016-06-13 EP EP16847847.7A patent/EP3287910B1/en active Active
- 2016-06-13 WO PCT/CN2016/085608 patent/WO2017049965A1/zh active Application Filing
- 2016-06-13 BR BR112017023803-9A patent/BR112017023803B1/pt active IP Right Grant
-
2018
- 2018-03-21 US US15/927,332 patent/US11119863B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7809691B1 (en) * | 2005-02-22 | 2010-10-05 | Symantec Operating Corporation | System and method of applying incremental changes prior to initialization of a point-in-time copy |
CN102541940A (zh) * | 2010-12-31 | 2012-07-04 | 上海可鲁系统软件有限公司 | 一种工业数据库数据完整性管控方法 |
CN102999400A (zh) * | 2012-11-22 | 2013-03-27 | 中国电信股份有限公司云计算分公司 | 一种云存储系统数据备份方法及装置 |
CN105243109A (zh) * | 2015-09-25 | 2016-01-13 | 杭州华为数字技术有限公司 | 数据备份的方法和数据处理系统 |
Non-Patent Citations (1)
Title |
---|
See also references of EP3287910A4 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111274253A (zh) * | 2020-01-10 | 2020-06-12 | 北京奇艺世纪科技有限公司 | 全量分区视图的生成方法、装置、存储介质和电子装置 |
Also Published As
Publication number | Publication date |
---|---|
EP3287910B1 (en) | 2021-01-13 |
CN105243109A (zh) | 2016-01-13 |
EP3287910A4 (en) | 2018-08-08 |
BR112017023803B1 (pt) | 2023-01-03 |
CN105243109B (zh) | 2021-10-15 |
EP3287910A1 (en) | 2018-02-28 |
BR112017023803A8 (pt) | 2022-10-04 |
CN111240902A (zh) | 2020-06-05 |
US11119863B2 (en) | 2021-09-14 |
BR112017023803A2 (zh) | 2018-07-31 |
US20180210795A1 (en) | 2018-07-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017049965A1 (zh) | 数据备份的方法和数据处理系统 | |
CN109828721B (zh) | 数据删除方法、装置、计算机设备及存储介质 | |
US20220413706A1 (en) | Data Storage Method, Apparatus and Storage System | |
US9645892B1 (en) | Recording file events in change logs while incrementally backing up file systems | |
US20170277769A1 (en) | Techniques to manage time-varying cluster configuration information | |
US8548948B2 (en) | Methods and apparatus for a fine grained file data storage system | |
Mei et al. | SifrDB: A unified solution for write-optimized key-value stores in large datacenter | |
WO2020207010A1 (zh) | 数据备份方法、装置及计算机可读存储介质 | |
US11093387B1 (en) | Garbage collection based on transmission object models | |
CN111881011A (zh) | 日志管理方法、平台、服务器及存储介质 | |
WO2016116020A1 (zh) | 一种实现对象过期操作的方法、装置和设备 | |
WO2018000191A1 (zh) | 一种数据处理的方法和装置 | |
WO2022156369A1 (zh) | 存储块管理信息同步记录方法、系统、终端及存储介质 | |
US8756200B2 (en) | Undo advisor | |
US20120311021A1 (en) | Processing method of transaction-based system | |
CN108573015B (zh) | 变更表格式的方法、装置、电子设备和可读存储介质 | |
WO2017067397A1 (zh) | 一种数据恢复方法和装置 | |
CN114924914B (zh) | 磁盘分区表信息备份、恢复方法及系统 | |
DE112016004457T5 (de) | Vervielfältigen von Daten in Datenspeichervorrichtungen eines Verknüpfungsvolumens | |
US11899625B2 (en) | Systems and methods for replication time estimation in a data deduplication system | |
TWI522827B (zh) | Real-time storage and real-time reading of huge amounts of data for non-related databases | |
CN110083624B (zh) | 流数据处理方法、设备、数据处理设备、计算机介质 | |
CN113568883B (zh) | 数据写入方法及装置 | |
CN111026764A (zh) | 一种数据存储方法、装置、电子产品及存储介质 | |
CN114443224B (zh) | 分布式集群逻辑卷数据管理方法、系统、设备和介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16847847 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2016847847 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112017023803 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 112017023803 Country of ref document: BR Kind code of ref document: A2 Effective date: 20171106 |