WO2015074260A1

WO2015074260A1 - Data synchronization method and data synchronization system

Info

Publication number: WO2015074260A1
Application number: PCT/CN2013/087721
Authority: WO
Inventors: 孙吉峰
Original assignee: 华为技术有限公司
Priority date: 2013-11-22
Filing date: 2013-11-22
Publication date: 2015-05-28
Also published as: CN103843309A

Abstract

Disclosed are a data synchronization method and a data synchronization system in the present invention. The data synchronization method comprises: a first storage device generates snapshots of data stored in a target logical unit number LUN; the first storage device writes the data of the snapshots into a removable storage medium; a second storage device reads and stores the data in the removable storage medium; the second storage device is located on the far-end of the first storage device, and is a disaster-recovery backup storage of the first storage device. The data synchronization method and system of embodiments of the present invention can realize the data synchronization between the first storage device and the second storage device, and can shorten data transmission time compared with the present network transmission mode. Compared with the present mode of moving the storage device, the data synchronization method of the present invention is more convenient in operation, and can reduce the risk of data loss or damage.

Description

Data synchronization method and data synchronization system

Embodiments of the present invention relate to the field of information technology, and more particularly, to a data synchronization method and a data synchronization system. Background technique

In order to avoid data loss caused by disasters and other factors, the construction of disaster recovery systems is particularly important. In the construction of disaster recovery systems, the most critical is to transfer data from existing production centers to remote disaster recovery data centers. This method of remote data transfer typically uses a storage-based copying approach. The storage-based data replication technology implements remote replication and synchronization of data through the data replication software in the storage system, that is, the storage system copies the local storage update data to the storage system of the disaster recovery end and executes it to ensure data consistency. . In this mode, the data replication software runs in the storage system. Therefore, it is easier to implement the real-time replication capability of the production and disaster recovery operating systems, databases, and files without affecting the performance of the production host system. A widely used program.

Storage-based remote data replication requires the first data synchronization, which is to transfer the data on the original storage device to the remote storage device through a remote link (usually an IP link). Due to the high cost of long-distance link leases, the bandwidth of IP links is usually low, and the value is usually on the order of Mbps. The amount of data on the original storage devices is usually on the order of terabytes (terabytes). It takes a few months to transfer terabytes of data on this link, which takes too long. One solution is to relocate the disaster recovery storage device to the production data center, use the local high-bandwidth network to complete the first data synchronization, and then relocate the disaster recovery storage device to the remote disaster recovery data center. However, due to the large size of the storage system, disassembling, transporting, and installing storage devices can risk damaging the storage device and losing data. In addition, in the event of a disaster or a drill, the storage device on the disaster recovery center retains the latest data and needs to be reversely synchronized to the storage device in the production center. Since the storage device has been deployed to the data center at this time, the relocation is more complicated. At the same time, since the user has only one latest data, the risk of relocating the storage device is greater. The present invention provides a data synchronization method and system, which can solve the data storage on the storage device of the production center and the storage device of the disaster recovery center by using the removable storage medium, and can solve the storage device and disaster recovery of the production center in the prior art. The central storage device takes too long to synchronize data or the risk of inconvenience and data loss due to relocation of the storage device. Summary of the invention

The embodiment of the present invention provides a data synchronization method and a data synchronization system, which can implement data synchronization between a first storage device and a second storage device located at the remote end of the first storage device and being used for disaster recovery storage of the first storage device. .

In a first aspect, a data synchronization method is provided, including: a first storage device generating a snapshot of data stored in a target logical unit number LU, and a transmission duration required for data stored in the target LU to be transmitted over a network exceeds a transmission duration Threshold; the first storage device writes the data in the snapshot to the removable storage medium; the second storage device reads and stores the data in the removable storage medium; wherein the second storage device is located in the first storage device The remote device and the second storage device are disaster recovery storage of the first storage device.

With reference to the first aspect, in a first possible implementation manner, the first storage device writes the data in the snapshot to the removable storage medium, including: the first storage device, the data in the snapshot, and the snapshot The storage location information of the data in the first storage device is written to the removable storage medium.

In conjunction with the first possible implementation of the first aspect, in a second possible implementation, the second storage device reads and stores data in the removable storage medium, including: the second storage device reads Data in the removable storage medium and storage location information of the data; the second storage device stores the data in a local storage area of the second storage device according to the storage location information of the data.

In conjunction with the first or second possible implementation of the first aspect, in a third possible implementation, the storage location information of the data includes: a world common name WWN of the LU to which the data belongs, and the data is in the The logical block location LBA in the home LUN.

In conjunction with the first or second or third possible implementation of the first aspect, in a fourth possible implementation, the method further includes: if the data stored in the first storage device is updated and updated The transmission duration required for data transmission using the network does not exceed the transmission duration threshold, and the first storage device transmits the updated data to the second storage device through the network.

In a second aspect, a data synchronization system is provided, including: a first storage device and a second storage device, where the second storage device is located at a remote end of the first storage device and the second storage device is the first storage device The disaster recovery storage; the first storage device is configured to generate a snapshot of data stored in the target logical unit number LU, and the data stored in the target LU is transmitted by using the network. The duration exceeds the transmission duration threshold; the first storage device is further configured to write data in the snapshot to the removable storage medium; the second storage device is configured to read and store data in the removable storage medium.

With reference to the second aspect, in a first possible implementation manner, the first storage device is specifically configured to write the data in the snapshot and the storage location information of the data in the snapshot in the first storage device to the Move the storage media.

With reference to the first possible implementation of the second aspect, in a second possible implementation, the second storage device is specifically configured to: read data in the removable storage medium and storage location information of the data; The data is stored to a local storage area of the second storage device based on the storage location information of the data.

In conjunction with the first or second possible implementation of the second aspect, in a third possible implementation, the storage location information of the data includes: a world common name WWN of the LU to which the data belongs, and the data is in the The logical block location LBA in the home LUN.

In conjunction with the first or second or third possible implementation of the second aspect, in a fourth possible implementation, if the data stored in the first storage device is updated and the updated data is transmitted by using the network The required transmission duration does not exceed the transmission duration threshold, and the first storage device is further configured to transmit the updated data to the second storage device over the network.

The data synchronization method provided by the embodiment of the present invention, the data is written to the removable storage medium by the first storage device, and the second storage device reads and stores the data on the removable storage medium, wherein the second The storage device is located at the remote end of the first storage device, and the second storage device is the disaster recovery storage of the first storage device, and data synchronization between the first storage device and the second storage device can be implemented. The data synchronization method of the embodiment of the present invention can shorten the data transmission time compared with the existing network transmission method, and the data synchronization method of the embodiment of the present invention is convenient to operate compared with the existing method for relocating the storage device, and Reduce the risk of data loss or damage. DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings to be used in the embodiments of the present invention or the description of the prior art will be briefly described below. Obviously, the drawings described below are only the present invention. For some embodiments, other figures may also be obtained from those of ordinary skill in the art in view of these figures.

FIG. 1 is a schematic flowchart of a data synchronization method according to an embodiment of the present invention. FIG. 2 is another schematic flowchart of a data synchronization method according to an embodiment of the present invention.

FIG. 3 is a schematic flowchart of a data synchronization system according to an embodiment of the present invention. detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, and not all embodiments.

It should be understood that the technical solution of the embodiment of the present invention is mainly applied to the first data synchronization between the storage device of the production center and the storage device of the disaster recovery center, and can also be applied to the data that needs to be synchronized between the storage device of the production center and the storage device of the disaster recovery center. Other scenarios of larger amounts, but embodiments of the invention are not limited thereto.

1 is a schematic flow chart of a data synchronization method 100 in accordance with an embodiment of the present invention, which may be performed by a data synchronization system. The method 100 can be used to synchronously store data on the first storage device to the second storage device, where the second storage device is located at a remote end of the first storage device and the second storage device is the first storage device. Disaster recovery storage of the device. Optionally, the first storage device may be a storage device of a production center, and the production center may include a network device such as a switch and a router, a server, and the first storage device to provide external services. Correspondingly, the second storage device may be a storage device of the disaster recovery center of the production center, and the disaster recovery center is far away from the production center, but the embodiment of the present invention does not limit this. Optionally, in another embodiment, when the first storage device and the second storage device are each other's disaster recovery storage devices, the method may also be used to damage or lose data on the first storage device. The data on the second storage device is synchronously stored on the first storage device, which is not limited in this embodiment of the present invention. As shown in FIG. 1, the method 100 includes:

S110. The first storage device generates a snapshot of the data stored in the target logical unit number (LU), and the data storage time of the data stored in the target LU exceeds the transmission duration threshold when the network transmission is performed.

The transmission time threshold may be set by the user according to requirements, and may be a value or a numerical range or an expression. The embodiment of the present invention is not limited thereto.

When the first storage device performs normal operation, the working mode of the Fibre Channel (FC) port of the first storage device is a target mode, and in order to identify a removable storage medium, for example, a tape library, The working mode of the at least one FC port of the first storage device is In the Initiator mode. In addition, the removable storage medium may be in the same storage area network (SAN) as the first storage device, and the FC port of the removable storage device and the at least one FC port of the first storage device Located in the same area (Zoning) of the SAN, the first storage device can detect and identify the removable storage medium.

After the first storage device detects the removable storage medium, or before the first storage device detects the removable storage medium, the first storage device may determine at least one target LU and generate the at least one target LU A snapshot of all the data stored in a moment. Optionally, the first storage device may determine the at least one target LU according to a user instruction, but the embodiment of the present invention is not limited thereto.

S120. The first storage device writes the data in the snapshot to the removable storage medium.

The removable storage medium is easier to relocate than the first storage device and the second storage device. Optionally, the removable storage medium may be a tape library or a mobile disk, which is not limited in the embodiment of the present invention.

S130. The second storage device reads and stores data in the removable storage medium.

After the first storage device writes the data in the snapshot to the removable storage medium, the removable storage medium can be relocated to the second storage device end. Optionally, the removable storage medium is accessible to the same SAN as the second storage device, and at least one operating mode of the FC port of the removable storage medium and the second storage device is set to an initiator The FC port is in the same Zoning zone of the SAN such that the second storage device can detect and identify the removable storage medium.

After the second storage device detects the removable storage medium, the second storage device can read data in the removable storage medium and store the read data to a local storage area of the second storage device. However, embodiments of the invention are not limited thereto.

Therefore, in the data synchronization method of the embodiment of the present invention, data is written to the removable storage medium by the first storage device and the second storage device reads and stores the data on the removable storage medium. The second storage device is located at the remote end of the first storage device, and the second storage device is the disaster recovery storage of the first storage device, and data synchronization between the first storage device and the second storage device can be implemented. The data synchronization method of the embodiment of the present invention can shorten the data transmission time compared with the existing network transmission method. Compared with the existing method for relocating the storage device, the data synchronization method of the embodiment of the present invention is convenient to operate, and Reduce the risk of data loss or damage. Optionally, as another embodiment, as shown in FIG. 2, S120, the first storage device writes the data in the snapshot to the removable storage medium, including:

S121. The first storage device writes the data in the snapshot and the storage location information of the data in the snapshot in the first storage device to the removable storage medium.

The storage location information of the data may be used to mark the data, so that when the data is read and stored by the second storage device, the second storage device may store the data according to the storage location information, but the embodiment of the present invention is not limited thereto. this.

As shown in FIG. 2, S130, the second storage device reads and stores data in the removable storage medium, including:

S131. The second storage device reads data in the removable storage medium and storage location information of the data.

S132. The second storage device stores the data to a local storage area of the second storage device according to the storage location information of the data.

The second storage device may store the data according to the storage location information of the data, such that the storage location of the data on the second storage device corresponds to the storage location of the data on the first storage device, but the present invention The embodiment is not limited to this.

Optionally, the storage location information of the data includes: a world common name WWN of the LU to which the data belongs and a logical block location LBA of the data in the belonging LU.

Optionally, as another embodiment, the storage location information of the data may also be other information that can determine the storage location of the data, and the embodiment of the present invention is not limited thereto.

Optionally, as another embodiment, before the data in the snapshot is written to the removable storage medium, the first storage device may also encode data in the snapshot, for example, looping. A Cyclic Redundancy Check (CRC) code is encoded and the encoded data is written to the removable storage medium. Correspondingly, after reading the data in the removable storage medium, the second storage device may decode the read data and store the decoded data to a local storage area of the second storage device, but The embodiment of the invention is not limited thereto.

Optionally, as another embodiment, after the data on the first storage device and the second storage device are first synchronized, the data on the first storage device and the second storage device may be at intervals of a certain period. Incremental synchronization is performed, that is, the updated data on one of the first storage device and the second storage device is synchronized to another storage device. At this time, if the amount of data of the update data is small, the network synchronization may be used for incremental synchronization, and accordingly, the method 100 further Includes:

S140. If the data length of the data stored in the first storage device is updated and the updated data volume is transmitted by the network does not exceed the transmission time threshold, the first storage device transmits the update to the second storage device through the network. The data.

Before the S140, the first storage device may also establish a data replication correspondence relationship with the second storage device. Specifically, the data replication software may be installed on the first storage device and the second storage device, and the data replication software is configured to make data replication of the first storage device and the second storage device as another device. Peer device. In this way, when there is data update in the first storage device or the second storage device, the updated data can be transmitted to the other party through the network, but the embodiment of the present invention is not limited thereto.

Therefore, in the data synchronization method of the embodiment of the present invention, data is written to the removable storage medium by the first storage device, and the second storage device reads and stores the data on the removable storage medium, where the second storage device is located The remote end of the first storage device and the second storage device are the disaster recovery storage of the first storage device, which can implement data synchronization between the first storage device and the second storage device, and is compatible with the existing network transmission mode. The data synchronization method of the embodiment of the present invention can shorten the data transmission time. Compared with the existing method for relocating the storage device, the data synchronization method of the embodiment of the present invention is convenient to operate and can reduce the risk of data loss or damage.

It should be understood that the size of the sequence numbers of the above processes does not imply a sequence of executions, and the order of execution of the processes should be determined by its function and internal logic, and should not be construed as limiting the implementation process of the embodiments of the present invention.

The data synchronization method according to an embodiment of the present invention is described in detail above with reference to FIGS. 1 and 2, and a data synchronization system according to an embodiment of the present invention will be described below with reference to FIG.

FIG. 3 shows a schematic block diagram of a data synchronization system 200 according to an embodiment of the present invention. As shown in FIG. 3, the data synchronization system 200 includes: a first storage device 210 and a second storage device 220, the second storage device 220 is located at the remote end of the first storage device 210 and the second storage device 220 is a disaster recovery storage of the first storage device 210;

The first storage device 210 is configured to generate a snapshot of the data stored in the target logical unit number LUN, and the transmission time required for the data stored in the target LU to use the network transmission exceeds the transmission duration threshold;

The first storage device 210 is further configured to write data in the snapshot to the removable storage medium; the second storage device 220 is configured to read and store data in the removable storage medium. Therefore, in the data synchronization system of the embodiment of the present invention, data is written to the removable storage medium by the first storage device and the second storage device reads and stores the data on the removable storage medium. The second storage device is located at the remote end of the first storage device, and the second storage device is the disaster recovery storage of the first storage device, and data synchronization between the first storage device and the second storage device can be implemented. The data synchronization method of the embodiment of the present invention can shorten the data transmission time compared with the existing network transmission method. Compared with the existing method for relocating the storage device, the data synchronization method of the embodiment of the present invention is convenient to operate, and Reduce the risk of data loss or damage.

Optionally, the first storage device 210 is specifically configured to write the data in the snapshot and the storage location information of the data in the snapshot in the first storage device to the removable storage medium.

Optionally, in another embodiment, the second storage device 220 is specifically configured to:

Reading data in the removable storage medium and storage location information of the data;

The data is stored to a local storage area of the second storage device based on the storage location information of the data.

Optionally, as another embodiment, the storage location information of the data includes: a world common name WWN of the LU to which the data belongs and a logical block location LBA of the data in the belonging LU.

Optionally, in another embodiment, if the data length of the updated data and the updated data stored in the first storage device 210 is not exceeded by the transmission time threshold, the first storage device 210 is further used. The updated data is transmitted to the second storage device 220 over the network.

Optionally, as another embodiment, before the first storage device 210 transmits the updated data to the second storage device 220 through the network, the first storage device 210 and the second storage device 220 are further used to interact with each other. Establish a data replication correspondence.

The first storage device in the data synchronization system 200 according to the embodiment of the present invention may correspond to the first storage device in the data synchronization method according to an embodiment of the present invention, and the second storage device in the data synchronization system 200 may correspond to The second storage device in the data synchronization method of the embodiment of the present invention, and the above-mentioned and other operations and/or functions of the respective modules in the data synchronization system 200 are respectively implemented to implement the respective processes of the respective methods in FIG. 1 and FIG. For the sake of brevity, it will not be repeated here.

It should be understood that in the embodiment of the present invention, the term "and/or" is merely an association relationship describing an associated object, indicating that there may be three relationships. For example, A and / or B, can mean: There are three cases where A exists separately, A and B exist at the same time, and B exists separately. In addition, the character "/" in this article generally means that the contextual object is an "or" relationship. Those of ordinary skill in the art will appreciate that the various method steps and elements described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the steps and components of the various embodiments have been described generally in terms of functionality in the foregoing description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. Different methods may be used to implement the described functionality for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

A person skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the several embodiments provided herein, it should be understood that the disclosed systems, devices, and methods may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, or an electrical, mechanical or other form of connection.

The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention contributes in essence or to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. Including a plurality of instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the methods of the various embodiments of the present invention Step by step. The foregoing storage medium includes: a USB flash drive, a mobile hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a disk or a CD. A variety of media that can store program code.

The above description is only the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any equivalents conceivable within the technical scope of the present invention are known to those skilled in the art. Modifications or substitutions are intended to be included within the scope of the invention. Therefore, the scope of the invention should be determined by the scope of the claims.

Claims

Rights request

A data synchronization method, comprising:

The first storage device generates a snapshot of the data stored in the target logical unit number LU, and the transmission time required for the data stored in the target LU to use the network transmission exceeds the transmission duration threshold; the first storage device will be in the snapshot Data is written to the removable storage medium; the second storage device reads and stores the data in the removable storage medium;

The second storage device is located at a remote end of the first storage device, and the second storage device is a disaster recovery storage of the first storage device.

The method according to claim 1, wherein the first storage device writes the data in the snapshot to the removable storage medium, including:

The first storage device writes the data in the snapshot and the storage location information of the data in the snapshot in the first storage device to the removable storage medium.

The method according to claim 2, wherein the reading, by the second storage device, the data in the removable storage medium comprises: storing location information;

The second storage device stores the data to a local storage area of the second storage device according to the storage location information of the data.

The method according to claim 2 or 3, wherein the storage location information of the data comprises: a world common name WWN of the LU to which the data belongs and a logic of the data in the belonging LU Block location LBA.

The method according to any one of claims 1 to 4, wherein the method further comprises: the required transmission duration does not exceed the transmission duration threshold, and the first storage device The second storage device transmits the updated data.

A data synchronization system, comprising: a first storage device and a second storage device, wherein the second storage device is located at a remote end of the first storage device and the second storage device is the first storage device Disaster recovery storage;

The first storage device is configured to generate a snapshot of data stored in the target logical unit number LU, and the transmission time required for the data stored in the target LU to be transmitted by using the network exceeds the transmission length Time threshold

The first storage device is further configured to write data in the snapshot to a removable storage medium; the second storage device is configured to read and store data in the removable storage medium.

The system according to claim 6, wherein the first storage device is specifically configured to store data in the snapshot and storage location information in the first storage device Write to the removable storage medium.

The system according to claim 7, wherein the second storage device is specifically configured to: store the data to a local storage area of the second storage device according to the storage location information of the data .

The system according to claim 7 or 8, wherein the storage location information of the data comprises: a world common name WWN of the LU to which the data belongs and a logic of the data in the belonging LU Block location LBA.

The system according to any one of claims 6 to 9, wherein, if the first length does not exceed the transmission time threshold, the first storage device is further configured to use the network to the second The storage device transmits the updated data.