CN111881211A - Method, system and equipment for synchronizing storage data and computer storage medium - Google Patents
Method, system and equipment for synchronizing storage data and computer storage medium Download PDFInfo
- Publication number
- CN111881211A CN111881211A CN202010724585.7A CN202010724585A CN111881211A CN 111881211 A CN111881211 A CN 111881211A CN 202010724585 A CN202010724585 A CN 202010724585A CN 111881211 A CN111881211 A CN 111881211A
- Authority
- CN
- China
- Prior art keywords
- block
- data
- storage data
- target storage
- transmitted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
- G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
- G06F11/1004—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's to protect a block of data words, e.g. CRC or checksum
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
Abstract
The application discloses a method, a system, equipment and a computer medium for synchronizing storage data, which are used for acquiring IO blocks to be transmitted; acquiring target storage data to be synchronized; judging whether the data in the IO block belongs to target storage data or not; if the data in the IO block belongs to the target storage data, transmitting the IO block by using bytes as check granularity; and if the data in the IO block does not belong to the target storage data, transmitting the IO block by using the memory page as the check granularity. According to the method, the IO blocks with data belonging to the target storage data are transmitted by taking bytes as check granularity, so that the data belonging to the target storage data can be accurately transmitted in the IO blocks; and for the IO blocks without data belonging to the target storage data, the IO blocks are transmitted by using the memory pages as the check granularity, and the performance and the resources of the equipment are released by reducing the check standard of the IO blocks, so that the loss during the synchronization of the storage data can be reduced.
Description
Technical Field
The present application relates to the field of storage data synchronization technologies, and in particular, to a storage data synchronization method, system, device, and computer-readable storage medium.
Background
In cloud computing era, in order to prevent data loss caused by system operation errors or system faults, all or part of data needs to be backed up from a disk array of an application host to a disk array of another host, such as volume mirror image copy, remote copy, local copy and the like.
In summary, how to reduce the loss in the storage data synchronization is a problem to be solved by those skilled in the art.
Disclosure of Invention
The application aims to provide a storage data synchronization method which can solve the technical problem of reducing loss during storage data synchronization to a certain extent. The application also provides a storage data synchronization system, equipment and a computer readable storage medium.
In order to achieve the above purpose, the present application provides the following technical solutions:
a method of synchronizing stored data, comprising:
obtaining an IO block to be transmitted;
acquiring target storage data to be synchronized;
judging whether the data in the IO block belongs to the target storage data or not;
if the data in the IO block belongs to the target storage data, transmitting the IO block by using bytes as check granularity;
and if the data in the IO block does not belong to the target storage data, transmitting the IO block by using an internal memory page as check granularity.
Preferably, the determining whether the data in the IO block belongs to the target storage data includes:
judging whether the IO block carries a preset mark or not;
if the IO block carries the preset mark, judging that the data in the IO block belongs to the target storage data;
if the IO block does not carry the preset mark, judging that the data in the IO block does not belong to the target storage data;
the preset mark comprises a mark for representing that the data in the IO block belongs to the target storage data.
Preferably, when the IO block is an IO block in a thin volume, the preset tag includes a tag of metadata corresponding to the IO block;
and when the IO block is an IO block in the non-compact volume, the preset mark comprises a mark of corresponding data in the IO block.
Preferably, the obtaining the IO block to be transmitted includes:
and obtaining the volume mirror image to copy the IO block to be transmitted.
Preferably, the obtaining the IO block to be transmitted includes:
and obtaining the IO blocks to be transmitted in the remote copy mode.
Preferably, the obtaining the IO block to be transmitted includes:
and obtaining the IO blocks to be transmitted under local copy.
Preferably, the determining whether the data in the IO block belongs to the target storage data includes:
determining target data belonging to the target storage data in the IO block;
judging whether the proportion of the target data in the IO block is larger than a preset proportion or not;
if the proportion of the target data in the IO block is larger than the preset proportion, judging that the data in the IO block belongs to the target storage data;
and if the proportion of the target data in the IO block is smaller than or equal to the preset proportion, judging that the data in the IO block does not belong to the target storage data.
A storage data synchronization system comprising:
the first acquisition module is used for acquiring the IO block to be transmitted;
the second acquisition module is used for acquiring target storage data to be synchronized;
the first judging module is used for judging whether the data in the IO block belongs to the target storage data or not; if the data in the IO block belongs to the target storage data, transmitting the IO block by using bytes as check granularity; and if the data in the IO block does not belong to the target storage data, transmitting the IO block by using an internal memory page as check granularity.
A storage data synchronization apparatus comprising:
a memory for storing a computer program;
a processor for implementing the steps of the storage data synchronization method as described in any one of the above when executing the computer program.
A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method for synchronizing stored data according to any one of the preceding claims.
According to the storage data synchronization method, IO blocks to be transmitted are obtained; acquiring target storage data to be synchronized; judging whether the data in the IO block belongs to target storage data or not; if the data in the IO block belongs to the target storage data, transmitting the IO block by using bytes as check granularity; and if the data in the IO block does not belong to the target storage data, transmitting the IO block by using the memory page as the check granularity. According to the method, the IO blocks with data belonging to the target storage data are transmitted by taking bytes as check granularity, so that the data belonging to the target storage data can be accurately transmitted in the IO blocks; and for the IO blocks without data belonging to the target storage data, the IO blocks are transmitted by using the memory pages as the check granularity, and the performance and the resources of the equipment are released by reducing the check standard of the IO blocks, so that the loss during the synchronization of the storage data can be reduced. The storage data synchronization system, the storage data synchronization equipment and the computer readable storage medium solve the corresponding technical problems.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a storage data synchronization method according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of a storage data synchronization system according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a storage data synchronization apparatus according to an embodiment of the present application;
fig. 4 is another schematic structural diagram of a storage data synchronization apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a flowchart illustrating a method for synchronizing storage data according to an embodiment of the present disclosure.
The storage data synchronization method provided by the embodiment of the application can comprise the following steps:
step S101: and obtaining the IO block to be transmitted.
In practical application, an IO (Input/Output) block to be transmitted may be obtained first, where the IO block may have storage data to be synchronized, but not every IO block has storage data to be synchronized, and there may be other data in the IO block of the storage data to be synchronized.
Step S102: and acquiring target storage data to be synchronized.
In practical application, after the IO block to be transmitted is obtained, target storage data to be synchronized needs to be obtained, so as to determine whether the storage data to be synchronized in the IO block is to be obtained according to the target storage data. The type of the target storage data may be determined according to actual needs, and the application is not specifically limited herein.
Step S103: judging whether the data in the IO block belongs to target storage data or not; if the data in the IO block belongs to the target storage data, executing the step S104; if the data in the IO block does not belong to the target storage data, step S105 is executed.
Step S104: and transmitting the IO block by taking bytes as check granularity.
Step S105: and transmitting the IO blocks by using the internal memory pages as check granularity.
In practical application, after target storage data is obtained, whether the data in the IO block belongs to the target storage data can be judged; if the data in the IO block belongs to the target storage data, the IO block is transmitted by using the bytes as the verification granularity, at the moment, when the IO block is transmitted, the data in the IO block needs to be verified byte by byte, and the data in the IO block needs to be written into the equipment to be synchronized byte by byte, because the IO block transmitted by using the bytes as a unit has finer granularity, the verification accuracy and the data transmission accuracy can be ensured; if the data in the IO block does not belong to the target storage data, the IO block is transmitted by using the internal memory page as the verification granularity, at the moment, when the IO block is transmitted, the data in the IO block needs to be verified page by page, and the data in the IO block needs to be written into the device to be synchronized page by page.
According to the storage data synchronization method, IO blocks to be transmitted are obtained; acquiring target storage data to be synchronized; judging whether the data in the IO block belongs to target storage data or not; if the data in the IO block belongs to the target storage data, transmitting the IO block by using bytes as check granularity; and if the data in the IO block does not belong to the target storage data, transmitting the IO block by using the memory page as the check granularity. According to the method, the IO blocks with data belonging to the target storage data are transmitted by taking bytes as check granularity, so that the data belonging to the target storage data can be accurately transmitted in the IO blocks; and for the IO blocks without data belonging to the target storage data, the IO blocks are transmitted by using the memory pages as the check granularity, and the performance and the resources of the equipment are released by reducing the check standard of the IO blocks, so that the loss during the synchronization of the storage data can be reduced.
In the storage data synchronization method provided by the embodiment of the application, in the process of judging whether the data in the IO block belongs to the target storage data, in order to conveniently judge whether the data in the IO block belongs to the target storage data, whether the IO block carries a preset mark or not can be judged; if the IO block carries a preset mark, judging that the data in the IO block belongs to target storage data; if the IO block does not carry the preset mark, judging that the data in the IO block does not belong to the target storage data; the preset mark comprises a mark for representing that the data in the IO block belongs to the target storage data. That is, the judgment result of whether the data in the IO block belongs to the target storage data can be obtained only by performing the preset marking judgment on the IO block.
In practical application, when the IO block is an IO block in a thin volume, the data in the IO block has corresponding metadata, so the preset mark may include a mark of the metadata corresponding to the IO block, and at this time, the preset mark may be a zeroiob mark or the like; and when the IO block is an IO block in the non-reduced volume, the data in the IO block does not have metadata, so the preset mark may include a mark of corresponding data in the IO block, and at this time, the preset mark may be a zerohit mark or the like.
In practical application, in the process of obtaining the IO block to be transmitted, the volume mirror image may be obtained to copy the IO block to be transmitted, or the volume mirror image may be obtained to copy the IO block to be transmitted remotely, or the volume mirror image may be obtained to copy the IO block to be transmitted locally. That is, the storage data synchronization method provided by the application can be applied to volume mirror copy scenes, remote copy scenes, local copy scenes and the like.
In the storage data synchronization method provided by the embodiment of the application, in the process of judging whether the data in the IO block belongs to the target storage data, in order to take into account the verification accuracy of the IO block and the performance loss of the transmission IO block, the target data belonging to the target storage data can be determined in the IO block; judging whether the ratio of the target data to the IO blocks is larger than a preset ratio or not; if the proportion of the target data in the IO block is larger than the preset proportion, judging that the data in the IO block belongs to target storage data; and if the proportion of the target data in the IO block is smaller than or equal to the preset proportion, judging that the data in the IO block does not belong to the target storage data. That is, the user can adjust the preset proportion according to the requirement, and whether the data in the IO block belongs to the target storage data is controlled.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a storage data synchronization system according to an embodiment of the present disclosure.
The storage data synchronization system provided by the embodiment of the application can include:
a first obtaining module 101, configured to obtain an IO block to be transmitted;
a second obtaining module 102, configured to obtain target storage data to be synchronized;
the first judging module 103 is configured to judge whether data in the IO block belongs to target storage data; if the data in the IO block belongs to the target storage data, transmitting the IO block by using bytes as check granularity; and if the data in the IO block does not belong to the target storage data, transmitting the IO block by using the memory page as the check granularity.
In an embodiment of the present application, a storage data synchronization system, a first determining module may include:
the first judgment unit is used for judging whether the IO block carries a preset mark or not; if the IO block carries a preset mark, judging that the data in the IO block belongs to target storage data; if the IO block does not carry the preset mark, judging that the data in the IO block does not belong to the target storage data; the preset mark comprises a mark for representing that the data in the IO block belongs to the target storage data.
According to the storage data synchronization system provided by the embodiment of the application, when the IO block is an IO block in a thin volume, the preset mark comprises a mark of metadata corresponding to the IO block;
and when the IO block is an IO block in the non-compact volume, the preset mark comprises a mark of corresponding data in the IO block.
In an embodiment of the present application, a storage data synchronization system, a first obtaining module may include:
the first obtaining unit is used for obtaining the IO blocks to be transmitted after the volume mirror image copy.
In an embodiment of the present application, a storage data synchronization system, a first obtaining module may include:
and the second obtaining unit is used for obtaining the IO block to be transmitted after the remote copy.
In an embodiment of the present application, a storage data synchronization system, a first obtaining module may include:
and the third obtaining unit is used for obtaining the IO block to be transmitted after the local copy.
In an embodiment of the present application, a storage data synchronization system, a first determining module may include:
the first determining unit is used for determining target data belonging to the target storage data in the IO block;
the second judging unit is used for judging whether the proportion of the target data in the IO block is larger than the preset proportion; if the proportion of the target data in the IO block is larger than the preset proportion, judging that the data in the IO block belongs to target storage data; and if the proportion of the target data in the IO block is smaller than or equal to the preset proportion, judging that the data in the IO block does not belong to the target storage data.
The application also provides a storage data synchronization device and a computer readable storage medium, which have the corresponding effects of the storage data synchronization method provided by the embodiment of the application. Referring to fig. 3, fig. 3 is a schematic structural diagram of a storage data synchronization apparatus according to an embodiment of the present disclosure.
The storage data synchronization device provided by the embodiment of the application comprises a memory 201 and a processor 202, wherein a computer program is stored in the memory 201, and the processor 202 implements the following steps when executing the computer program:
obtaining an IO block to be transmitted;
acquiring target storage data to be synchronized;
judging whether the data in the IO block belongs to target storage data or not;
if the data in the IO block belongs to the target storage data, transmitting the IO block by using bytes as check granularity;
and if the data in the IO block does not belong to the target storage data, transmitting the IO block by using the memory page as the check granularity.
The storage data synchronization device provided by the embodiment of the application comprises a memory 201 and a processor 202, wherein a computer program is stored in the memory 201, and the processor 202 implements the following steps when executing the computer program: judging whether the IO block carries a preset mark or not; if the IO block carries a preset mark, judging that the data in the IO block belongs to target storage data; if the IO block does not carry the preset mark, judging that the data in the IO block does not belong to the target storage data; the preset mark comprises a mark for representing that the data in the IO block belongs to the target storage data.
According to the storage data synchronization device provided by the embodiment of the application, when the IO block is an IO block in a thin volume, the preset mark comprises a mark of metadata corresponding to the IO block; and when the IO block is an IO block in the non-compact volume, the preset mark comprises a mark of corresponding data in the IO block.
The storage data synchronization device provided by the embodiment of the application comprises a memory 201 and a processor 202, wherein a computer program is stored in the memory 201, and the processor 202 implements the following steps when executing the computer program: and obtaining the volume mirror image to copy the IO block to be transmitted.
The storage data synchronization device provided by the embodiment of the application comprises a memory 201 and a processor 202, wherein a computer program is stored in the memory 201, and the processor 202 implements the following steps when executing the computer program: and obtaining the IO blocks to be transmitted in the remote copy.
The storage data synchronization device provided by the embodiment of the application comprises a memory 201 and a processor 202, wherein a computer program is stored in the memory 201, and the processor 202 implements the following steps when executing the computer program: and obtaining the IO blocks to be transmitted under the local copy.
The storage data synchronization device provided by the embodiment of the application comprises a memory 201 and a processor 202, wherein a computer program is stored in the memory 201, and the processor 202 implements the following steps when executing the computer program: determining target data belonging to target storage data in an IO block; judging whether the ratio of the target data to the IO blocks is larger than a preset ratio or not; if the proportion of the target data in the IO block is larger than the preset proportion, judging that the data in the IO block belongs to target storage data; and if the proportion of the target data in the IO block is smaller than or equal to the preset proportion, judging that the data in the IO block does not belong to the target storage data.
Referring to fig. 4, another storage data synchronization device provided in the embodiment of the present application may further include: an input port 203 connected to the processor 202, for transmitting externally input commands to the processor 202; a display unit 204 connected to the processor 202, for displaying the processing result of the processor 202 to the outside; and the communication module 205 is connected with the processor 202 and is used for realizing the communication between the storage data synchronization device and the outside. The display unit 204 may be a display panel, a laser scanning display, or the like; the communication method adopted by the communication module 205 includes, but is not limited to, mobile high definition link technology (HML), Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), and wireless connection: wireless fidelity technology (WiFi), bluetooth communication technology, bluetooth low energy communication technology, ieee802.11s based communication technology.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps:
obtaining an IO block to be transmitted;
acquiring target storage data to be synchronized;
judging whether the data in the IO block belongs to target storage data or not;
if the data in the IO block belongs to the target storage data, transmitting the IO block by using bytes as check granularity;
and if the data in the IO block does not belong to the target storage data, transmitting the IO block by using the memory page as the check granularity.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: judging whether the IO block carries a preset mark or not; if the IO block carries a preset mark, judging that the data in the IO block belongs to target storage data; if the IO block does not carry the preset mark, judging that the data in the IO block does not belong to the target storage data; the preset mark comprises a mark for representing that the data in the IO block belongs to the target storage data.
In the computer-readable storage medium provided by the embodiment of the application, when an IO block is an IO block in a thin volume, a preset mark includes a mark of metadata corresponding to the IO block; and when the IO block is an IO block in the non-compact volume, the preset mark comprises a mark of corresponding data in the IO block.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: and obtaining the volume mirror image to copy the IO block to be transmitted.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: and obtaining the IO blocks to be transmitted in the remote copy.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: and obtaining the IO blocks to be transmitted under the local copy.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: determining target data belonging to target storage data in an IO block; judging whether the ratio of the target data to the IO blocks is larger than a preset ratio or not; if the proportion of the target data in the IO block is larger than the preset proportion, judging that the data in the IO block belongs to target storage data; and if the proportion of the target data in the IO block is smaller than or equal to the preset proportion, judging that the data in the IO block does not belong to the target storage data.
The computer-readable storage media to which this application relates include Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage media known in the art.
For a description of a relevant part in the stored data synchronization system, the device and the computer-readable storage medium provided in the embodiment of the present application, reference is made to detailed descriptions of a corresponding part in the stored data synchronization method provided in the embodiment of the present application, and details are not repeated here. In addition, parts of the above technical solutions provided in the embodiments of the present application, which are consistent with the implementation principles of corresponding technical solutions in the prior art, are not described in detail so as to avoid redundant description.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method for synchronizing stored data, comprising:
obtaining an IO block to be transmitted;
acquiring target storage data to be synchronized;
judging whether the data in the IO block belongs to the target storage data or not;
if the data in the IO block belongs to the target storage data, transmitting the IO block by using bytes as check granularity;
and if the data in the IO block does not belong to the target storage data, transmitting the IO block by using an internal memory page as check granularity.
2. The method of claim 1, wherein the determining whether the data in the IO block belongs to the target storage data comprises:
judging whether the IO block carries a preset mark or not;
if the IO block carries the preset mark, judging that the data in the IO block belongs to the target storage data;
if the IO block does not carry the preset mark, judging that the data in the IO block does not belong to the target storage data;
the preset mark comprises a mark for representing that the data in the IO block belongs to the target storage data.
3. The method according to claim 2, wherein when the IO block is an IO block in a thin volume, the preset flag includes a flag of metadata corresponding to the IO block;
and when the IO block is an IO block in the non-compact volume, the preset mark comprises a mark of corresponding data in the IO block.
4. The method of claim 3, wherein the obtaining the IO blocks to be transmitted comprises:
and obtaining the volume mirror image to copy the IO block to be transmitted.
5. The method of claim 3, wherein the obtaining the IO blocks to be transmitted comprises:
and obtaining the IO blocks to be transmitted in the remote copy mode.
6. The method of claim 3, wherein the obtaining the IO blocks to be transmitted comprises:
and obtaining the IO blocks to be transmitted under local copy.
7. The method according to any one of claims 1 to 6, wherein the determining whether the data in the IO block belongs to the target storage data includes:
determining target data belonging to the target storage data in the IO block;
judging whether the proportion of the target data in the IO block is larger than a preset proportion or not;
if the proportion of the target data in the IO block is larger than the preset proportion, judging that the data in the IO block belongs to the target storage data;
and if the proportion of the target data in the IO block is smaller than or equal to the preset proportion, judging that the data in the IO block does not belong to the target storage data.
8. A storage data synchronization system, comprising:
the first acquisition module is used for acquiring the IO block to be transmitted;
the second acquisition module is used for acquiring target storage data to be synchronized;
the first judging module is used for judging whether the data in the IO block belongs to the target storage data or not; if the data in the IO block belongs to the target storage data, transmitting the IO block by using bytes as check granularity; and if the data in the IO block does not belong to the target storage data, transmitting the IO block by using an internal memory page as check granularity.
9. A storage data synchronization apparatus, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the method of synchronizing stored data according to any one of claims 1 to 7 when executing said computer program.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the storage data synchronization method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010724585.7A CN111881211B (en) | 2020-07-24 | 2020-07-24 | Method, system and equipment for synchronizing storage data and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010724585.7A CN111881211B (en) | 2020-07-24 | 2020-07-24 | Method, system and equipment for synchronizing storage data and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111881211A true CN111881211A (en) | 2020-11-03 |
| CN111881211B CN111881211B (en) | 2022-06-10 |
Family
ID=73201638
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010724585.7A Active CN111881211B (en) | 2020-07-24 | 2020-07-24 | Method, system and equipment for synchronizing storage data and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111881211B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101344868A (en) * | 2008-08-28 | 2009-01-14 | 北京握奇数据系统有限公司 | Data backup and acquiring method and device |
| US20100191922A1 (en) * | 2009-01-29 | 2010-07-29 | International Business Machines Corporation | Data storage performance enhancement through a write activity level metric recorded in high performance block storage metadata |
| CN104407928A (en) * | 2014-11-18 | 2015-03-11 | 杭州华为企业通信技术有限公司 | Data transmission method and device |
| CN105808371A (en) * | 2014-12-31 | 2016-07-27 | 深圳市硅格半导体有限公司 | Data backup and recovery method, control chip and storage device |
| CN105868305A (en) * | 2016-03-25 | 2016-08-17 | 西安电子科技大学 | A fuzzy matching-supporting cloud storage data dereplication method |
| US20160306588A1 (en) * | 2013-12-27 | 2016-10-20 | Huawei Technologies Co., Ltd. | Solid state disk and data moving method |
| CN109101627A (en) * | 2018-08-14 | 2018-12-28 | 交通银行股份有限公司 | heterogeneous database synchronization method and device |
| CN109710185A (en) * | 2018-12-19 | 2019-05-03 | 麒麟合盛网络技术股份有限公司 | Data processing method and device |
| US20200026779A1 (en) * | 2018-07-19 | 2020-01-23 | EMC IP Holding Company LLC | Storage system with decrement protection of reference counts |
| CN111176568A (en) * | 2019-12-26 | 2020-05-19 | 苏州浪潮智能科技有限公司 | Data analysis method and device |
-
2020
- 2020-07-24 CN CN202010724585.7A patent/CN111881211B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101344868A (en) * | 2008-08-28 | 2009-01-14 | 北京握奇数据系统有限公司 | Data backup and acquiring method and device |
| US20100191922A1 (en) * | 2009-01-29 | 2010-07-29 | International Business Machines Corporation | Data storage performance enhancement through a write activity level metric recorded in high performance block storage metadata |
| US20160306588A1 (en) * | 2013-12-27 | 2016-10-20 | Huawei Technologies Co., Ltd. | Solid state disk and data moving method |
| CN104407928A (en) * | 2014-11-18 | 2015-03-11 | 杭州华为企业通信技术有限公司 | Data transmission method and device |
| CN105808371A (en) * | 2014-12-31 | 2016-07-27 | 深圳市硅格半导体有限公司 | Data backup and recovery method, control chip and storage device |
| CN105868305A (en) * | 2016-03-25 | 2016-08-17 | 西安电子科技大学 | A fuzzy matching-supporting cloud storage data dereplication method |
| US20200026779A1 (en) * | 2018-07-19 | 2020-01-23 | EMC IP Holding Company LLC | Storage system with decrement protection of reference counts |
| CN109101627A (en) * | 2018-08-14 | 2018-12-28 | 交通银行股份有限公司 | heterogeneous database synchronization method and device |
| CN109710185A (en) * | 2018-12-19 | 2019-05-03 | 麒麟合盛网络技术股份有限公司 | Data processing method and device |
| CN111176568A (en) * | 2019-12-26 | 2020-05-19 | 苏州浪潮智能科技有限公司 | Data analysis method and device |
Non-Patent Citations (2)
| Title |
|---|
| JAE KYU LEE ET AL.: "The SPI Synchronization Method for Data Efficiency and Integrity between MCUs", 《2019 21ST INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY (ICACT)》 * |
| 郑飞龙等: "Flash中数据失效与页损坏解决算法", 《微计算机信息》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111881211B (en) | 2022-06-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8370591B2 (en) | Method and apparatus for automatic snapshot | |
| US20220100609A1 (en) | Data Replication Method, Apparatus, and System | |
| CN111339228B (en) | Map updating method, device, cloud server and storage medium | |
| CN110888844B (en) | Data deleting method, system, equipment and computer readable storage medium | |
| CN105787129B (en) | Data storage method and electronic equipment | |
| CN106775485B (en) | SD card formatting method and system based on mobile terminal | |
| CN111881211B (en) | Method, system and equipment for synchronizing storage data and computer storage medium | |
| CN110209605A (en) | The register reading/writing method and calculating equipment of PCIE Cardbus NIC Cardbus | |
| CN107391312B (en) | Data cloud backup method and system | |
| CN111399857A (en) | FRU data burning method, system, equipment and computer storage medium | |
| CN111090397B (en) | Data deduplication method, system, equipment and computer readable storage medium | |
| US20120026521A1 (en) | Image processing apparatus, computer-readable storage medium storing program and image processing method | |
| CN110995462B (en) | Cloud host function expansion method, system, equipment and computer storage medium | |
| CN109324760B (en) | Disk data cloud method, system, equipment and computer storage medium | |
| US8705871B2 (en) | Form image managing system and method | |
| CN114327647A (en) | Server startup method, system, equipment and computer readable storage medium | |
| CN112162701A (en) | Storage space recovery method, device, equipment and computer storage medium | |
| US10832132B2 (en) | Data transmission method and calculation apparatus for neural network, electronic apparatus, computer-readable storage medium and computer program product | |
| CN115033525B (en) | File system management method and electronic equipment | |
| US9311424B2 (en) | HTTP request pipeline optimization | |
| CN111104403B (en) | LSM tree data processing method, system, equipment and computer medium | |
| CN113868158B (en) | System-on-chip and data comparison method, device, equipment and computer medium | |
| CN111857583B (en) | Distributed storage volume updating method, system, equipment and computer medium | |
| CN113806445A (en) | Data synchronization method, device, equipment and computer readable storage medium | |
| CN113987791A (en) | Method and device for acquiring part attribute information, terminal equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |