CN107038092B - Data copying method and device - Google Patents
Data copying method and device Download PDFInfo
- Publication number
- CN107038092B CN107038092B CN201710249043.7A CN201710249043A CN107038092B CN 107038092 B CN107038092 B CN 107038092B CN 201710249043 A CN201710249043 A CN 201710249043A CN 107038092 B CN107038092 B CN 107038092B
- Authority
- CN
- China
- Prior art keywords
- data
- copied
- storage unit
- logical address
- storage device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a data copying method and a device, wherein the method is applied to a storage device and can comprise the following steps: reading data to be copied from a local LUN storage unit; determining whether the local LUN storage unit and the target LUN storage unit are deleted LUN storage units; if any one of the local LUN storage unit and the target LUN storage unit is a duplicate LUN storage unit and the data to be copied is subjected to data duplicate deletion processing at any one of the local LUN storage unit and the target LUN storage unit, the read logical address of the data to be copied and the index information corresponding to the data to be copied are sent to the opposite-end storage device, so that the opposite-end storage device can inquire the target data identical to the data to be copied in the target LUN storage unit based on the index information and establish the mapping relation between the target data and the logical address of the data to be copied. The method provided by the application can effectively improve the efficiency of data replication.
Description
Technical Field
The present application relates to the field of computer communications, and in particular, to a data replication method and apparatus.
Background
Replication technology is a data protection technology in network storage. Generally, data synchronization of LUN (Logical Unit Number) storage units of a replication source device and a replication destination device can be realized through an IP network, and replica data of the LUN storage units is established and maintained. When the data on the device is lost due to a device failure or the like, the data in the copy source device can be recovered by using the data copy on the remote copy destination device.
However, an IP network for data transmission between a replication source device and a replication destination device is difficult to be a private physical network, and is mostly a leased public network, so that the bandwidth of the IP network is small and the response delay is large. When data synchronization is performed between the copy source device and the copy destination device, it is difficult to copy a large amount of data due to the limitation of the bandwidth of the IP network, thereby greatly reducing the efficiency of data copying.
Disclosure of Invention
In view of the above, the present application provides a data replication method and apparatus, which can improve the efficiency of data replication by reducing the data transmission amount of both replication parties when a large amount of data is replicated.
Specifically, the method is realized through the following technical scheme:
according to a first aspect of the present application, there is provided a data replication method, the method being applied to a storage device, the method including:
reading data to be copied from the local LUN storage unit in response to a copy instruction for copying the written data stored in the local LUN storage unit to a target LUN storage unit of the opposite-end storage device;
determining whether the local LUN storage unit and the target LUN storage unit are deleted LUN storage units;
if any one of the local LUN storage unit and the target LUN storage unit is a duplicate LUN storage unit and the data to be copied is subjected to data duplicate deletion processing at any one of the local LUN storage unit and the target LUN storage unit, sending the read logical address of the data to be copied and index information corresponding to the data to be copied to the opposite-end storage device, so that the opposite-end storage device inquires target data which is the same as the data to be copied in the target LUN storage unit based on the index information, establishes a mapping relation between the target data and the logical address of the data to be copied, and returns a notification message of successful copying to the device; the index information is information related to deduplication processing for the data to be copied.
According to a second aspect of the present application, there is provided a data copying apparatus, the apparatus being applied to a storage device, the apparatus comprising:
a reading unit, configured to read data to be copied from the local LUN storage unit in response to a copy instruction for copying the written data stored in the local LUN storage unit to a target LUN storage unit of the opposite-end storage device;
a determining unit, configured to determine whether the local LUN storage unit and the target LUN storage unit are duplicate LUN storage units;
a copy unit, configured to send the read logical address of the data to be copied and index information corresponding to the data to be copied to the opposite-end storage device if any one of the local LUN storage unit and the target LUN storage unit is a duplicate LUN storage unit and the data to be copied is subjected to data deduplication processing at any one of the local LUN storage unit and the target LUN storage unit, so that the opposite-end storage device queries, in the target LUN storage unit, target data identical to the data to be copied based on the index information, establishes a mapping relationship between the target data and the logical address of the data to be copied, and returns a notification message that copying is successful to the device; the index information is information related to deduplication processing for the data to be copied.
The application provides a data replication method, wherein target data which is the same as data to be replicated on local end storage equipment is stored on the opposite end storage equipment serving as replication target equipment by utilizing a deduplication technology, so that the local end storage equipment serving as replication source equipment can not send the data to be replicated to the opposite end storage equipment any more but send a logical address of the data to be replicated and index information corresponding to the logical address to be replicated to the opposite end storage equipment when the data is replicated. The opposite-end storage device can search the target data which is the same as the data to be copied based on the index information, and establish a mapping relation between the target data and the logical address of the data to be copied, so that the data to be copied is copied.
On one hand, the local storage device serving as the replication source device does not send the data to be replicated to the opposite storage device any more, but only sends the logical address and the index information of the data to be replicated to the opposite storage device, so that the data volume of sending the data to the opposite storage device can be effectively reduced during replication, the replication overhead can be greatly reduced, and the data replication efficiency can be improved.
On the other hand, because the local storage device only sends the logical address and the index information of the data to be copied to the opposite storage device, the data volume sent to the opposite storage device is greatly reduced, the logical address and the index information of a plurality of data to be copied can be transmitted at one time, the copying of the plurality of data to be copied is realized, and the data copying efficiency can be greatly improved.
Drawings
FIG. 1 is a schematic diagram illustrating data replication of a related replication technique according to an exemplary embodiment of the present application;
FIG. 2 is a flow chart illustrating a data replication process according to an exemplary embodiment of the present application;
FIG. 3 is a schematic diagram of a data replication scenario illustrated in an exemplary embodiment of the present application;
FIG. 4 is a flowchart illustrating a data replication method corresponding to the data replication scenario of FIG. 3 according to an exemplary embodiment of the present application;
FIG. 5 is a schematic diagram of another data replication scenario illustrated in an exemplary embodiment of the present application;
FIG. 6 is a flow chart illustrating a data replication method corresponding to the data replication scenario of FIG. 5 in accordance with an exemplary embodiment of the present application;
FIG. 7 is a schematic diagram of another data replication scenario illustrated in an exemplary embodiment of the present application;
FIG. 8 is a flowchart illustrating a data replication method corresponding to the data replication scenario of FIG. 7 according to an exemplary embodiment of the present application;
fig. 9 is a hardware configuration diagram of a device in which a data replication apparatus according to an exemplary embodiment of the present application is located;
fig. 10 is a block diagram of a data copying apparatus according to an exemplary embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
Replication technology is a data protection technology in network storage. Generally, data synchronization of the LUN storage units of the replication source device and the replication destination device can be realized through the IP network, and the replica data of the LUN storage units is established and maintained. When the data on the device is lost due to a device failure or the like, the data in the copy source device can be recovered by using the data copy on the remote copy destination device.
Generally, the logical addresses of the data stored in the copy source device and the copy destination device are identical, and further, the data read in the copy source device and the copy destination device are identical through the logical addresses of the data, although the physical addresses of the data stored in the copy source device and the copy destination device may be different.
The purpose of data replication is to synchronize the data to be replicated on the replication source device to the storage space corresponding to the logical address of the data to be replicated on the replication destination device.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating data replication of a related replication technique according to an exemplary embodiment of the present application.
In the related copy technology, when the copy source device receives a copy instruction to copy written data stored in the local LUN storage unit to a target LUN storage unit of the copy destination device, data to be copied (data corresponding to a shadow on the copy difference bitmap shown in fig. 1) may be read in the local LUN storage unit based on the copy difference bitmap, and then a logical address of the data to be copied and the data to be copied may be sent to the copy destination device.
After receiving the logical address of the data to be copied and the data to be copied, the copy destination device may allocate a new storage space for the data to be copied in the target LUN storage unit, and may write the data to be copied. The copy destination device may establish a mapping relationship between the logical address of the data to be copied and the physical address of the storage space allocated for the data to be copied.
However, in the related data replication technology, the replication source device needs to send the data to be replicated and the logical address of the data to be replicated to the replication destination device to complete the replication of the data. When a large amount of data needs to be copied, on one hand, the large amount of data is sent to the copying destination device, so that the copying cost is greatly increased, the copying efficiency is reduced, and meanwhile, the normal operation of front-end services is influenced.
On the other hand, when a large amount of data to be copied exists, the occupancy rate of the network bandwidth can be greatly increased, the transmission rate of the data to be copied transmitted by the network is reduced, and when the generation rate of the data to be copied is greater than the transmission rate of the data to be copied transmitted by the network, the phenomenon of untimely copying can be caused, so that the data difference between the copying source equipment and the copying destination equipment is larger and larger, and the purpose of copying and backing up is difficult to achieve.
The application provides a data replication method, which is characterized in that target data which is the same as data to be replicated on replication source equipment is stored on the replication destination equipment by utilizing a deduplication technology, so that the replication source equipment can not send the data to be replicated to the replication destination equipment any more when data is replicated, but send a logical address of the data to be replicated and index information corresponding to the logical address to be replicated to the replication destination equipment. The copy destination device may search for target data that is the same as the data to be copied based on the index information, and establish a mapping relationship between the target data and a logical address of the data to be copied.
On one hand, the replication source device does not send the data to be replicated to the replication destination device any more, but only sends the logical address and the index information of the data to be replicated to the replication destination device, so that the data volume of sending the data to the replication destination device can be effectively reduced during replication, the replication overhead can be greatly reduced, and the data replication efficiency can be improved.
On the other hand, because the replication source device only sends the logical address and the index information of the data to be replicated to the replication destination device, the data volume sent to the replication destination device is greatly reduced, the logical address and the index information of a plurality of data to be replicated can be transmitted at one time, the replication of the plurality of data to be replicated is realized, and the efficiency of data replication can be greatly improved.
The data replication method proposed in the present application is described in detail below by taking a local storage device as a replication source device and an opposite storage device as a replication destination device, but of course, the local storage device may also be a replication destination device and the opposite storage device may also be a replication source device, and is not limited specifically here.
Referring to fig. 2, fig. 2 is a flow chart illustrating data replication according to an exemplary embodiment of the present application. The data replication method may include steps 201 to 204.
Step 201: the local storage device responds to a copy instruction for copying the written data stored in the local LUN storage unit to a target LUN storage unit of the opposite storage device, and reads data to be copied from the local LUN storage unit;
step 202: the local storage device determines whether the local LUN storage unit and the target LUN storage unit are duplicate LUN storage units;
step 203: if any one of the local LUN storage unit and the target LUN storage unit is a duplicate LUN storage unit and the data to be copied is subjected to data duplicate deletion processing at any one of the local LUN storage unit and the target LUN storage unit, the local storage device sends the read logical address of the data to be copied and index information corresponding to the data to be copied to the opposite storage device;
step 204: and the opposite-end storage equipment inquires the target data which is the same as the data to be copied in the target LUN storage unit based on the index information, establishes the mapping relation between the target data and the logical address of the data to be copied, and returns a notification message of successful copying to the equipment.
The index information is mainly used to enable the copy destination device to search the target LUN storage unit for the same target data as the data to be copied based on the index information. The index information may include information related to a deduplication process for the data to be copied.
For example, when the target LUN storage unit on the peer storage device is a duplicate LUN storage unit, the index information may be a hash value of the data to be copied.
For another example, when the local LUN storage unit on the local storage device is a duplicate LUN storage unit and the target LUN storage unit on the opposite storage device is a standard LUN storage unit, the index information may be a logical address of the copied data found based on the hash value of the data to be copied. The copied data is the data which is stored in the local storage device and is subjected to deduplication processing, and the copied data is the same as the data to be copied.
The target data is the same data as the data to be copied, which is stored in the copy destination device. For example, when the target LUN storage unit on the peer storage device is a deduplication LUN storage unit, the target data is the same data that has completed deduplication processing as the data to be copied.
For another example, when the local LUN storage unit on the local storage device is a duplicate LUN storage unit and the target LUN storage unit on the peer storage device is a standard LUN storage unit, the target data may be the same copied data that has been copied to the peer storage device as the data to be copied.
It should be noted that the data to be copied read by the local storage device may be one data to be copied or multiple data to be copied, and the number of the data to be copied is not specifically limited here.
According to the data copying method and device, data copying is carried out by using the deduplication technology, the target data which is the same as the data to be copied on the local end storage device can be stored on the opposite end storage device through the deduplication technology, and therefore when data are copied, the data to be copied can not be sent to the opposite end storage device any more, and the logical address of the data to be copied and the index information corresponding to the logical address can be sent to the opposite end storage device. The opposite-end storage device can find the target data which is the same as the data to be copied based on the index information, and establish a mapping relation between the target data and the logical address of the data to be copied, so that the data copying between the local-end storage device and the opposite-end storage device is completed.
When copying the data to be copied in the local LUN storage unit to the target LUN storage unit based on the deduplication technology, three different data copying scenarios may be included, which are a deduplication LUN storage unit that copies the data to be copied from the deduplication LUN storage unit of the local storage device to the opposite storage device, a deduplication LUN storage unit that copies the data to be copied from the standard LUN storage unit of the local storage device to the opposite storage device, and a standard LUN storage unit that copies the data to be copied from the deduplication LUN storage unit of the local storage device to the opposite storage device.
In the copy initialization stage, the local storage device and the opposite storage device can mutually notify the attribute information of the LUN storage units of both sides, and the LUN types of the local LUN storage unit and the target LUN storage unit are determined according to the attribute information of the LUN storage units of both sides. The local storage device and the opposite storage device can select one flow adaptive to the types of the local LUN storage unit and the target LUN storage unit from three flows corresponding to the three scenes through the determined types of the local LUN storage unit and the target LUN storage unit, and execute a program corresponding to the flow to complete data copying.
In addition, when referring to the deduplication technology, in order to better describe the data replication method proposed in the present application, the deduplication metadata stored in the deduplication LUN storage unit is described in detail below.
The deduplication LUN storage unit on the local storage device or the opposite storage device may store deduplication metadata. The deduplication metadata may be represented by a direct mapping relationship between a logical address and a physical address of the deduplication-processed data, or may be represented by an indirect mapping relationship between a logical address and a physical address of the deduplication-processed data.
When the deduplication metadata is represented by a direct mapping relationship between a logical address and a physical address of data that has completed a deduplication process, the deduplication metadata may include a logical address mapping table and a deduplication mapping table. The logical address mapping table records a mapping relationship between a logical address and a physical address of the data subjected to the deduplication processing. The deduplication mapping table records a mapping relationship between a hash value and a physical address of data for which deduplication processing has been completed.
When the deduplication metadata is represented by an indirect mapping relationship between a logical address and a physical address of data that has been subjected to deduplication processing, the deduplication metadata may include a logical address mapping table and a deduplication mapping table. Wherein, the logical address mapping table records the mapping relation between the logical address and the hash value of the data which has been deleted. The deduplication mapping table records a mapping relationship between the hash value and the physical address of the data for which deduplication processing has been completed.
Here, the mapping method of the logical address and the physical address of the data having completed the deduplication processing in the deduplication metadata is merely exemplary and is not particularly limited.
The following describes the data replication method in detail by taking the mapping relationship between the logical address and the physical address of the data subjected to the deduplication processing in the deduplication metadata as an indirect mapping example and combining the three data replication scenarios.
1) And copying the data to be copied from the deleted LUN storage unit of the local storage device to the deleted LUN storage unit of the opposite storage device.
Referring to fig. 3, fig. 3 is a schematic diagram illustrating a data replication according to an exemplary embodiment of the present application. Fig. 3(a) shows a home storage device as a replication source device, and fig. 3(b) shows a peer storage device as a replication destination device. The local LUN storage unit on the home storage device is the deleted LUN storage unit shown in fig. 3(a 1). The deleted LUN storage unit shown in FIG. 3(a1) corresponds to the deleted copy library shown in FIG. 3(a 2). The target LUN storage unit on the peer storage device is the deleted LUN storage unit shown in FIG. 3(b1), and the deleted LUN storage unit in FIG. 3(b1) corresponds to the deleted copy library shown in FIG. 3(b 2).
The deduplication LUN storage unit is used for storing deduplication metadata. The deduplication metadata may generally include a logical address mapping table and a deduplication mapping table. The logical address table records a mapping relationship between the logical address of the data subjected to the deduplication processing and the hash value. The deduplication mapping table records a mapping relationship between the hash value and the physical address of the data for which deduplication processing has been completed.
The deduplication copy library mainly stores data which is subjected to deduplication processing. The duplicate deleted library can correspond to one deleted LUN storage unit or a plurality of deleted LUN storage units. Further, the deduplication copy library may be shared by one deduplication LUN storage unit alone, or may be shared by a plurality of deduplication LUN storage units. It is not particularly limited herein.
Referring to fig. 4, fig. 4 is a flowchart illustrating a data replication method corresponding to the data replication scenario illustrated in fig. 3 according to an exemplary embodiment of the present application. In this scenario, the data replication method specifically includes steps 401 to 408.
Step 401: the local storage equipment reads data to be copied from the local LUN storage unit;
when the copy request is implemented, in response to a copy instruction for copying the written data stored in the local LUN storage unit to the target LUN storage unit of the opposite-end storage device, the local-end storage device may read the data to be copied, which needs to be copied to the opposite-end storage device, by copying the identification information on the difference bitmap.
The identification information is mainly used for identifying whether the data is copied to the opposite storage device. For example, when the identification information is 1, it indicates that the data on the local storage device has been copied to the peer storage device. When the identification information is 0, it indicates that the data on the local storage device is not copied to the opposite storage device.
Step 402: the local storage equipment acquires the logical address and the hash value of the data to be copied;
when the copying is realized, the local storage device determines the logical address of the data to be copied according to the position of the copying difference bitmap where the identification information corresponding to the data to be copied is located.
After the logical address of the data to be copied is obtained, the local storage device may determine a hash value corresponding to the logical address of the data to be copied based on the logical address mapping table stored in the local LUN storage unit, and read the hash value.
Step 403: and the local storage device sends the logical address and the hash value of the data to be copied to the opposite storage device.
Step 404: and the opposite-end storage equipment judges whether the data which is subjected to the deduplication processing and corresponds to the hash value of the data to be copied is found in the deduplication mapping table stored in the target LUN storage unit.
If the opposite-end storage device finds the data which is corresponding to the hash value of the data to be copied and has been subjected to the deduplication processing, step 405 is executed.
If the peer storage device does not find the data that has been subjected to the deduplication processing corresponding to the hash value of the data to be copied, step 406 may be performed.
Step 405: the opposite-end storage device can increase the mapping relation between the logical address and the hash value of the data to be copied in the logical address mapping table on the target LUN storage unit.
In this embodiment of the present application, if the data that has been subjected to deduplication processing and corresponds to the hash value of the data to be copied is found, this may indicate that the data that has been subjected to deduplication processing and is the same as the data to be copied (i.e., the target data) exists on the opposite-end storage device, at this time, the local-end device does not need to transmit the data to be copied to the opposite-end storage device, but the mapping relationship between the logical address of the data to be copied and the data that has been subjected to deduplication processing is directly established on the opposite-end storage device, so that the data to be copied may be copied.
In implementation, the peer storage device may add a mapping relationship between the logical address of the data to be copied and the hash value of the data to be copied in the logical address mapping table on the target LUN storage unit.
And establishing the mapping relation between the logical address of the data to be copied and the data which is subjected to the deduplication processing by combining the existing mapping relation between the hash value and the physical address of the data which is subjected to the deduplication processing in the deduplication mapping table of the target LUN storage unit through the mapping relation between the logical address of the data to be copied and the hash value.
Step 406: and the opposite-end storage device returns a message that the data which is subjected to the deduplication processing does not exist to the local-end storage device.
If the data which is corresponding to the hash value of the data to be copied and has been subjected to the deduplication processing is not found, it can be shown that the data which is identical to the data to be copied and has been subjected to the deduplication processing does not exist on the opposite-end storage device. At this time, the local storage device may send the data to be copied and the logical address thereof to the opposite storage device to complete the copying of the data.
Step 407: and the local terminal storage device sends the logical address and the hash value of the data to be copied and the data to be copied to the opposite terminal storage device.
Step 408: the opposite-end storage device can write the data to be copied and establish the mapping relation between the logical address and the data to be copied based on the logical address and the hash value of the data to be copied.
In implementation, the peer storage device may allocate a new storage space for the data to be copied in the deduplication copy library corresponding to the target LUN storage unit, establish a mapping relationship between a logical address and a hash value of the data to be copied in a logical address mapping table of the target LUN storage unit, and establish a mapping relationship between a hash value of the data to be copied and a physical address of the new storage space allocated to the hash value in the deduplication mapping table.
For example, referring to fig. 3, it is assumed that the local storage device determines Data to be copied as Data _0 by copying the difference bitmap.
The local storage device may calculate the logical address of Data _0 based on the position of the replication difference bitmap in which the identification information representing Data _0 is located in the replication difference bitmap, assuming that the calculated logical address is Add _ 5. The local storage device may look up the hash value corresponding to the logical address Add _5 of Data _0 in the logical address mapping table shown in fig. 3.
Assume that the hash value found by the local storage device is H _ x. The local storage device may send the logical address Add _5 and hash value H _ x of Data _0 to the peer storage device.
The peer storage device may store Data looking for the same complete deduplication process as the hash value H _ x of Data _0 in the target LUN storage unit as shown in fig. 3. As can be seen from fig. 3, the peer storage device may find the same Data that has been subjected to the deduplication process as the hash value H _ x of Data _0, such as Data _0 shown in fig. 3(b2), at this time, the peer storage device may Add the mapping relationship between the logical address Add _5 of Data _0 and the hash value H _ x of the Data that has been subjected to the deduplication process in the logical address mapping table.
Assuming that the opposite-end storage device does not find the same Data that has completed the deduplication process as the hash value H _ x of Data _0, a message that the Data that has completed the deduplication process does not exist may be returned to the home-end storage device.
The local storage device may send Data _0, the logical address Add _5 of Data _0, and the hash value H _ x of Data _0 to the peer storage device.
The opposite-end storage device can allocate a new storage space for Data _0 and can write Data _ 0. The opposite-end storage device can Add the mapping relation between the logical address Add _5 and the hash value H _ x of the Data _0 in the logical address mapping table of the target LUN storage device, and Add the mapping relation between the hash value H _ x of the Data _0 and the physical address of the newly allocated storage space in the deduplication mapping table.
2) And copying the data to be copied from the standard LUN storage unit of the local storage device to the deleted LUN storage unit of the opposite storage device.
Referring to fig. 5, fig. 5 is a schematic diagram illustrating another data replication according to an exemplary embodiment of the present application. Fig. 5(a) shows a home storage device as a copy source device, and fig. 5(b) shows a peer storage device as a copy destination device. The local LUN storage unit on the local storage device is the standard LUN storage unit shown in fig. 5(a 1). The target LUN storage unit on the peer storage device is the deleted LUN storage unit shown in FIG. 5(b1), which corresponds to the deleted copy library shown in FIG. 5(b 2).
The deduplication metadata and the deduplication copy library stored in the deduplication LUN storage unit are already described above, and are not described herein again.
The standard LUN storage unit is mainly used for storing data, including storing data to be copied. Unlike the deduplication LUN storage units, the standard LUN storage units are mainly used for storing data, and the deduplication LUN storage units are mainly used for storing deduplication metadata.
Referring to fig. 6, fig. 6 is a flowchart illustrating a data replication method corresponding to the data replication scenario illustrated in fig. 5 according to an exemplary embodiment of the present application. In this scenario, the data replication method specifically includes steps 601 to 608.
Step 601: the local storage equipment reads data to be copied from the local LUN storage unit;
when the copy request is implemented, in response to a copy instruction for copying the written data stored in the local LUN storage unit to the target LUN storage unit of the opposite-end storage device, the local-end storage device may read the data to be copied, which needs to be copied to the opposite-end storage device, by copying the identification information on the difference bitmap.
Step 602: the local storage equipment acquires the logical address and the hash value of the data to be copied;
when the copying is realized, the local storage device determines the logical address of the data to be copied according to the position of the copying difference bitmap where the identification information corresponding to the data to be copied is located.
Meanwhile, the local storage device may calculate the hash value of the data to be copied based on a hash algorithm or the like.
Of course, the algorithm for calculating the hash value of the data to be copied may be a hash algorithm, or may be other algorithms, and the algorithm for calculating the hash value is not particularly limited herein.
Step 603: and the local storage device sends the logical address and the hash value of the data to be copied to the opposite storage device.
Step 604: and the opposite-end storage equipment judges whether the data which is subjected to the deduplication processing and corresponds to the hash value of the data to be copied can be found in the deduplication mapping table stored in the target LUN storage unit.
If the opposite storage device finds the data that has been subjected to the deduplication processing and corresponds to the hash value of the data to be copied, step 605 may be executed.
If the opposite-end storage device does not find the data which is corresponding to the hash value of the data to be copied and has been subjected to the deduplication processing, step 606 may be executed.
Step 605: the opposite-end storage device can increase the mapping relation between the logical address and the hash value of the data to be copied in the logical address mapping table on the target LUN storage unit.
In the embodiment of the present application, if the data that has been subjected to the deduplication processing and corresponds to the hash value of the data to be copied is found, this may indicate that the data (i.e., the target data) that has been subjected to the deduplication processing and is the same as the data to be copied exists on the opposite-end storage device. At this time, the local device does not need to transmit the data to be copied to the opposite storage device, but directly establishes a mapping relationship between the logical address of the data to be copied and the data that has been subjected to deduplication processing on the opposite storage device, so as to complete the copying of the data to be copied.
In implementation, the peer storage device may add a mapping relationship between the logical address of the data to be copied and the hash value of the data to be copied in the logical address mapping table on the target LUN storage unit.
And establishing the mapping relation between the logical address of the data to be copied and the data which is subjected to the deduplication processing by combining the existing mapping relation between the hash value and the physical address of the data which is subjected to the deduplication processing in the deduplication mapping table of the target LUN storage unit through the mapping relation between the logical address of the data to be copied and the hash value.
Step 606: and the opposite-end storage device returns a message that the data which is subjected to the deduplication processing does not exist to the local-end storage device.
If the data which is corresponding to the hash value of the data to be copied and has been subjected to the deduplication processing is not found, it can be indicated that the data which is identical to the data to be copied and has been subjected to the deduplication processing (i.e., the target data) does not exist on the opposite-end storage device. At this time, the local storage device may send the data to be copied and the logical address thereof to the opposite storage device to complete the copying of the data.
Step 607: and the local terminal storage device sends the logical address and the hash value of the data to be copied and the data to be copied to the opposite terminal storage device.
Step 608: the opposite-end storage device can write the data to be copied and establish the mapping relation between the logical address and the data to be copied based on the logical address and the hash value of the data to be copied.
In implementation, the peer storage device may allocate a new storage space for the data to be copied in the deduplication copy library corresponding to the target LUN storage unit, establish a mapping relationship between a logical address and a hash value of the data to be copied in a logical address mapping table of the target LUN storage unit, and establish a mapping relationship between a hash value of the data to be copied and a physical address of the new storage space allocated to the hash value in the deduplication mapping table.
For example, referring to fig. 5, assuming that the local storage device determines that Data to be copied is Data _0 by copying the difference bitmap, the local storage device may calculate a logical address of Data _0 based on a position of the copy difference bitmap where identification information indicating Data _0 is located in the copy difference bitmap, and assuming that the calculated logical address is Add _ 5. The local storage device may calculate the hash value of the Data _0 to be copied. Assume that the hash value calculated by the local storage device is H _ x. The local storage device may send the logical address Add _5 and hash value H _ x of Data _0 to the peer storage device.
The peer storage device can look up the same Data that has completed the deduplication process as the hash value H _ x of Data _0 in the target LUN storage unit as shown in fig. 5. As can be seen from fig. 5, the peer storage device can find the Data that has completed the deduplication process and is the same as the hash value H _ x of Data _0, such as Data _0 shown in fig. 5(b 2). At this time, the opposite-end storage device can establish a mapping relationship between the logical address Add _5 of Data _0 and the hash value H _ x of the Data which has completed the deduplication processing in the logical address mapping table.
Assuming that the opposite-end storage device does not find the same Data that has completed the deduplication process as the hash value H _ x of Data _0, a message that the Data that has completed the deduplication process does not exist may be returned to the home-end storage device.
The local storage device may send Data _0, the logical address Add _5 of Data _0, and the hash value H _ x of Data _0 to the peer storage device.
The opposite-end storage device can allocate a new storage space for Data _0 and can write Data _ 0. The opposite-end storage device can Add the mapping relation between the logical address Add _5 and the hash value H _ x of the Data _0 in the logical address mapping table of the target LUN storage device, and Add the mapping relation between the hash value H _ x of the Data _0 and the physical address of the newly allocated storage space in the deduplication mapping table.
3) And copying the data to be copied from the deleted LUN storage unit of the local storage device to the standard LUN storage unit of the opposite storage device.
FIG. 7 is a schematic diagram of another data replication scenario illustrated in an exemplary embodiment of the present application. Fig. 7(a) shows a home storage device as a copy source device, and fig. 7(b) shows a peer storage device as a copy destination device. The local LUN storage unit on the home storage device is the deleted LUN storage unit shown in fig. 7(a 1). The deleted LUN storage unit shown in FIG. 7(a1) corresponds to the deleted copy library shown in FIG. 7(a 2). The target LUN storage unit on the peer storage device is the standard LUN storage unit shown in FIG. 7(b 1).
Referring to fig. 8, fig. 8 is a flowchart illustrating a data replication method corresponding to the data replication scenario illustrated in fig. 7 according to an exemplary embodiment of the present application. In this scenario, the data replication method specifically includes steps 801 to 808.
Step 801: the local storage equipment reads data to be copied from the local LUN storage unit;
when the copy request is implemented, in response to a copy instruction for copying the written data stored in the local LUN storage unit to the target LUN storage unit of the opposite-end storage device, the local-end storage device may read the data to be copied, which needs to be copied to the opposite-end storage device, by copying the identification information on the difference bitmap.
Step 802: the local storage equipment acquires the logical address and the hash value of the data to be copied;
when the copying is realized, the local storage device determines the logical address of the data to be copied according to the position of the copying difference bitmap where the identification information corresponding to the data to be copied is located.
After the logical address of the data to be copied is obtained, the local storage device may determine a hash value corresponding to the logical address of the data to be copied based on the logical address mapping table stored in the local LUN storage unit, and read the hash value.
Step 803: and the local storage equipment judges whether the duplicated data which is subjected to the deduplication processing and is the same as the data to be duplicated is found.
In implementation, the local storage device may determine one or more copied data copied to the opposite storage device by copying the difference bitmap, and determine a logical address of the one or more copied data by a position, in the copy difference bitmap, of identification information indicating the copied data in the copy difference bitmap.
The local storage device may look up a hash value of the one or more copied data corresponding to the logical address of the one or more copied data through a logical address mapping table stored in the local LUN storage unit.
The local storage device may compare the hash value of the data to be copied with the hash values of the one or more copied data.
If the hash value of any copied data is the same as the hash value of the data to be copied, this indicates that the local storage device finds the copied data that has been subjected to deduplication processing and is the same as the data to be copied, at this time, step 804 may be executed.
It should be noted that, if the hash value of the copied data is the same as the hash value of the data to be copied, this indicates that the copied data is the same as the data to be copied, and the copied data is already saved on the opposite storage device by copying. At this time, the local storage device may no longer send the data to be copied to the opposite storage device for synchronization, but send the logical address of the data to be copied and the logical address of the copied data to the opposite storage device. The opposite-end storage device can read the copied data based on the logical address of the copied data and establish the mapping relation between the logical address of the data to be copied and the copied data.
If the hash value of any copied data is different from the hash value of the data to be copied, this indicates that the local storage device does not find the same copied data as the copied data that has been subjected to the deduplication processing, and step 807 may be executed.
Step 804: and the local storage equipment sends the logical address of the data to be copied and the logical address of the copied data to the opposite storage equipment.
Step 805: and the opposite-end storage device reads the copied data based on the logical address of the copied data.
Step 806: and the opposite-end storage equipment establishes the mapping relation between the copied data and the logic address of the data to be copied.
In implementation, the peer storage device may write the copied data into a storage space corresponding to the logical address of the data to be copied in the target LUN storage unit, so as to establish a mapping relationship between the copied data and the logical address of the data to be copied.
Step 807: and the local terminal storage equipment sends the data to be copied and the logic address thereof to the opposite terminal storage equipment.
Step 808: and writing the data to be copied into the opposite-end storage device, and establishing a mapping relation between the logical address of the data to be copied and the data to be copied.
In implementation, the opposite-end storage device may allocate a new storage space for the data to be copied in the target LUN storage unit, write the data to be copied into the new storage space, and establish a mapping relationship between a logical address of the data to be copied and a physical address of the new storage space.
For example, referring to fig. 7, assuming that the local storage device determines that Data to be copied is Data _0 by copying the difference bitmap, the local storage device may calculate a logical address of Data _0 based on a position of the copy difference bitmap where identification information indicating Data _0 is located in the copy difference bitmap, and assuming that the calculated logical address is Add _ 5. The local storage device may look up the hash value corresponding to the logical address Add _5 of Data _0, such as H _ x, in the logical address mapping table of the local LUN storage unit shown in fig. 7.
Then, the local storage device may determine one or more copied data that have been copied to the peer storage device by copying the difference bitmap, and determine a logical address of the one or more copied data by a position, in the copy difference bitmap, of identification information indicating the copied data in the copy difference bitmap, for example, the determined logical addresses of the one or more copied data are Add _0 to Add _ 4.
The local storage device may look up a hash value of the one or more copied data corresponding to the logical address of the one or more copied data through a logical address mapping table stored in the local LUN storage unit.
As shown in fig. 7, the local storage device determines that the hash value of the copied data corresponding to the logical address Add _0 is H _ x, which is the same as the hash value corresponding to the logical address Add _ 5. The local storage device may send the logical address Add _5 of the data to be copied and the logical address Add _0 of the copied data to the opposite storage device.
The peer storage device may write the copied data corresponding to the logical address Add _0 into the storage space corresponding to the logical address Add _ 5.
It is assumed that, if the hash value of the one or more copied Data is different from the hash value of the Data to be copied, the local storage device may send the Data _0 to be copied and the logical address Add _5 of the Data to be copied to the opposite storage device.
The opposite-end storage device may allocate a new storage space for the data to be copied in the target LUN storage unit, write the data to be copied into the new storage space, and establish a mapping relationship between the logical address of the data to be copied and the physical address of the new storage space.
In the embodiment of the present application, in order to improve the replication efficiency of data replication, by applying the data replication method according to the embodiment of the present application, the local storage device may transmit the logical address and the index information of one or more data to be replicated to the opposite storage device, so as to implement efficient replication of data.
The application provides a data replication method, wherein target data which is the same as data to be replicated on local end storage equipment is stored on the opposite end storage equipment serving as replication target equipment by utilizing a deduplication technology, so that the local end storage equipment serving as replication source equipment can not send the data to be replicated to the opposite end storage equipment any more but send a logical address of the data to be replicated and index information corresponding to the logical address to be replicated to the opposite end storage equipment when the data is replicated. The opposite-end storage device can search the target data which is the same as the data to be copied based on the index information, and establish a mapping relation between the target data and the logical address of the data to be copied, so that the data to be copied is copied.
On one hand, the local storage device serving as the replication source device does not send the data to be replicated to the opposite storage device any more, but only sends the logical address and the index information of the data to be replicated to the opposite storage device, so that the data volume of sending the data to the opposite storage device can be effectively reduced during replication, the replication overhead can be greatly reduced, and the data replication efficiency can be improved.
On the other hand, because the local storage device only sends the logical address and the index information of the data to be copied to the opposite storage device, the data volume sent to the opposite storage device is greatly reduced, the logical address and the index information of a plurality of data to be copied can be transmitted at one time, the copying of the plurality of data to be copied is realized, and the data copying efficiency can be greatly improved.
Corresponding to the embodiment of the data copying method, the application also provides an embodiment of the data copying device.
The embodiment of the data copying device can be applied to the storage equipment. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. Taking a software implementation as an example, as a logical device, the device is formed by reading a corresponding computer program instruction in the nonvolatile memory into the memory through the processor of the storage device where the device is located to operate. From a hardware aspect, as shown in fig. 9, a hardware structure diagram of a storage device where the data copying apparatus of the present application is located is shown, except for the processor, the memory, the network output interface, and the nonvolatile memory shown in fig. 9, the storage device where the apparatus is located in the embodiment may also include other hardware according to an actual function of the storage device, which is not described again.
Referring to fig. 10, fig. 10 is a block diagram illustrating a data copying apparatus according to an exemplary embodiment of the present application. The device is applied to the storage equipment, and the device can comprise: a reading unit 1010, a determining unit 1020, and a copying unit 1030.
A reading unit 1010, configured to read data to be copied from the local LUN storage unit in response to a copy instruction for copying the written data stored in the local LUN storage unit to a target LUN storage unit of the peer storage device;
a determining unit 1020, configured to determine whether the local LUN storage unit and the target LUN storage unit are duplicate LUN storage units;
a copying unit 1030, configured to send the read logical address of the data to be copied and the index information corresponding to the data to be copied to the opposite-end storage device if any one of the local LUN storage unit and the target LUN storage unit is a duplicate LUN storage unit and the data to be copied is subjected to data deduplication processing at any one of the local LUN storage unit and the target LUN storage unit, so that the opposite-end storage device queries, in the target LUN storage unit, target data that is the same as the data to be copied based on the index information, establishes a mapping relationship between the target data and the logical address of the data to be copied, and returns a notification message that copying is successful to the device; the index information is information related to deduplication processing for the data to be copied.
In an optional implementation manner, the index information is a hash value of the data to be copied;
the copying unit 1030 is specifically configured to, if the target LUN storage unit is a duplicate LUN storage unit, send the read logical address and hash value of the data to be copied to the opposite-end storage device, so that after the opposite-end storage device finds the data, which is corresponding to the hash value of the data to be copied and has been subjected to the duplicate deletion, in the target LUN storage unit, a mapping relationship between the logical address of the data to be copied and the data subjected to the duplicate deletion is established.
In another optional implementation manner, the index information is a logical address of the duplicated data that has been subjected to deduplication processing and is the same as the data to be duplicated;
the copying unit 1030 is specifically configured to, if the local LUN storage unit is a duplicate LUN storage unit and the target LUN storage unit is a standard LUN storage unit, search, based on a hash value of the data to be copied, copied data that matches the hash value in the local LUN storage unit; if the copied data matched with the hash value is found in the local LUN storage unit, acquiring a logical address of the copied data; and sending the logical address of the data to be copied and the logical address of the copied data to the opposite-end storage device, so that the opposite-end storage device searches the copied data in the target LUN storage unit based on the logical address of the copied data, and establishes a mapping relation between the logical address of the data to be copied and the searched copied data.
In another optional implementation manner, the replication unit 1030 is further specifically configured to receive a message that the data subjected to deduplication processing returned by the destination replication device does not exist after the opposite-end storage device does not find the data subjected to deduplication processing corresponding to the hash value of the data to be replicated in the target LUN storage unit; and sending the logical address of the data to be copied, the hash value of the data to be copied and the data to be copied to the opposite-end storage device so that the opposite-end storage device writes the data to be copied, and establishing a mapping relation between the logical address and the data to be copied based on the logical address and the hash value.
In another optional implementation manner, the copying unit 1030 is further specifically configured to send the data to be copied and the logical address of the data to be copied to the opposite-end storage device if the copied data matching the hash value is not found in the local LUN storage unit, so that the opposite-end storage device writes the data to be copied, and establishes a mapping relationship between the logical address of the data to be copied and the data to be copied.
The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the application. One of ordinary skill in the art can understand and implement it without inventive effort.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.
Claims (4)
1. A data replication method applied to a storage device, the method comprising:
reading data to be copied from the local LUN storage unit in response to a copy instruction for copying the written data stored in the local LUN storage unit to a target LUN storage unit of the opposite-end storage device;
determining whether the local LUN storage unit and the target LUN storage unit are deleted LUN storage units;
if any one of the local LUN storage unit and the target LUN storage unit is a duplicate LUN storage unit and the data to be copied is subjected to data duplicate deletion processing at any one of the local LUN storage unit and the target LUN storage unit, sending the read logical address of the data to be copied and index information corresponding to the data to be copied to the opposite-end storage device, so that the opposite-end storage device inquires target data which is the same as the data to be copied in the target LUN storage unit based on the index information, establishes a mapping relation between the target data and the logical address of the data to be copied, and returns a notification message of successful copying to the device; wherein the index information is information related to a deduplication process for the data to be copied;
the index information is a logic address of duplicated data which is subjected to deduplication processing and is the same as the data to be duplicated;
if any one of the local LUN storage unit and the target LUN storage unit is a duplicate LUN storage unit and the data to be copied is subjected to data duplicate deletion processing at any one of the local LUN storage unit and the target LUN storage unit, sending the read logical address of the data to be copied and the index information corresponding to the data to be copied to the opposite-end storage device, so that the opposite-end storage device queries the target data, which is the same as the data to be copied, in the target LUN storage unit based on the index information and establishes a mapping relationship between the target data and the logical address of the data to be copied, including:
if the local LUN storage unit is a deleted LUN storage unit and the target LUN storage unit is a standard LUN storage unit, searching copied data matched with the hash value in the local LUN storage unit based on the hash value of the data to be copied;
if the copied data matched with the hash value is found in the local LUN storage unit, acquiring a logical address of the copied data;
and sending the logical address of the data to be copied and the logical address of the copied data to the opposite-end storage device, so that the opposite-end storage device searches the copied data in the target LUN storage unit based on the logical address of the copied data, and establishes a mapping relation between the logical address of the data to be copied and the searched copied data.
2. The method according to claim 1, wherein if any one of the local LUN storage unit and the target LUN storage unit is a duplicate LUN storage unit and the data to be copied is subjected to data duplicate deletion processing at any one of the local LUN storage unit and the target LUN storage unit, sending the read logical address of the data to be copied and index information corresponding to the data to be copied to the peer storage device, so that the peer storage device queries, in the target LUN storage unit, target data identical to the data to be copied based on the index information and establishes a mapping relationship between the target data and the logical address of the data to be copied, further comprising:
if the copied data matched with the hash value is not found in the local LUN storage unit, the data to be copied and the logical address of the data to be copied are sent to the opposite-end storage device, so that the opposite-end storage device writes the data to be copied, and a mapping relation between the logical address of the data to be copied and the data to be copied is established.
3. A data copying apparatus, wherein the apparatus is applied to a storage device, the apparatus comprising:
a reading unit, configured to read data to be copied from the local LUN storage unit in response to a copy instruction for copying the written data stored in the local LUN storage unit to a target LUN storage unit of the opposite-end storage device;
a determining unit, configured to determine whether the local LUN storage unit and the target LUN storage unit are duplicate LUN storage units;
a copy unit, configured to send the read logical address of the data to be copied and index information corresponding to the data to be copied to the opposite-end storage device if any one of the local LUN storage unit and the target LUN storage unit is a duplicate LUN storage unit and the data to be copied is subjected to data deduplication processing at any one of the local LUN storage unit and the target LUN storage unit, so that the opposite-end storage device queries, in the target LUN storage unit, target data identical to the data to be copied based on the index information, establishes a mapping relationship between the target data and the logical address of the data to be copied, and returns a notification message that copying is successful to the device; wherein the index information is information related to a deduplication process for the data to be copied;
the index information is a logic address of duplicated data which is subjected to deduplication processing and is the same as the data to be duplicated;
the replication unit is specifically configured to, if the local LUN storage unit is a duplicate LUN storage unit and the target LUN storage unit is a standard LUN storage unit, search, based on a hash value of the data to be replicated, replicated data that matches the hash value in the local LUN storage unit; if the copied data matched with the hash value is found in the local LUN storage unit, acquiring a logical address of the copied data; and sending the logical address of the data to be copied and the logical address of the copied data to the opposite-end storage device, so that the opposite-end storage device searches the copied data in the target LUN storage unit based on the logical address of the copied data, and establishes a mapping relation between the logical address of the data to be copied and the searched copied data.
4. The apparatus according to claim 3, wherein the replication unit is further specifically configured to, if replicated data matching the hash value is not found in the local LUN storage unit, send the data to be replicated and the logical address of the data to be replicated to the opposite-end storage device, so that the opposite-end storage device writes the data to be replicated, and establish a mapping relationship between the logical address of the data to be replicated and the data to be replicated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710249043.7A CN107038092B (en) | 2017-04-17 | 2017-04-17 | Data copying method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710249043.7A CN107038092B (en) | 2017-04-17 | 2017-04-17 | Data copying method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107038092A CN107038092A (en) | 2017-08-11 |
| CN107038092B true CN107038092B (en) | 2020-03-10 |
Family
ID=59536337
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710249043.7A Active CN107038092B (en) | 2017-04-17 | 2017-04-17 | Data copying method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107038092B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109726575B (en) * | 2018-12-29 | 2021-06-29 | 杭州宏杉科技股份有限公司 | Data encryption method and device |
| CN113568584B (en) * | 2021-07-30 | 2023-04-21 | 杭州宏杉科技股份有限公司 | Method and device for protecting duplicate-deletion data |
| CN114442945B (en) * | 2022-01-05 | 2023-04-25 | 杭州宏杉科技股份有限公司 | Data replication method, system and equipment |
| CN115827752A (en) * | 2022-11-22 | 2023-03-21 | 中国机械总院集团江苏分院有限公司 | Data processing method and device and computer equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102663086A (en) * | 2012-04-09 | 2012-09-12 | 华中科技大学 | Method for retrieving data block indexes |
| CN103902410A (en) * | 2014-03-28 | 2014-07-02 | 西北工业大学 | Data backup acceleration method for cloud storage system |
| CN105701024A (en) * | 2015-12-31 | 2016-06-22 | 华为技术有限公司 | Storage equipment and junk data recovery method thereof |
-
2017
- 2017-04-17 CN CN201710249043.7A patent/CN107038092B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102663086A (en) * | 2012-04-09 | 2012-09-12 | 华中科技大学 | Method for retrieving data block indexes |
| CN103902410A (en) * | 2014-03-28 | 2014-07-02 | 西北工业大学 | Data backup acceleration method for cloud storage system |
| CN105701024A (en) * | 2015-12-31 | 2016-06-22 | 华为技术有限公司 | Storage equipment and junk data recovery method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107038092A (en) | 2017-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8285690B2 (en) | Storage system for eliminating duplicated data | |
| US9952783B2 (en) | Data processing method and apparatus, and shared storage device | |
| CN107038092B (en) | Data copying method and device | |
| US10628378B2 (en) | Replication of snapshots and clones | |
| CN109766341B (en) | Method, device and storage medium for establishing Hash mapping | |
| JP5693560B2 (en) | Data redistribution in data replication systems | |
| US20150113218A1 (en) | Distributed Data Processing Method and Apparatus | |
| US10628050B2 (en) | Data processing method and apparatus | |
| WO2017088705A1 (en) | Data processing method and device | |
| WO2017020576A1 (en) | Method and apparatus for file compaction in key-value storage system | |
| CN103885717B (en) | A kind of data copy method and device | |
| WO2016029743A1 (en) | Method and device for generating logical disk of virtual machine | |
| CN109144406A (en) | Metadata storing method, system and storage medium in distributed memory system | |
| CN112765182A (en) | Data synchronization method and device among cloud server clusters | |
| CN106873902B (en) | File storage system, data scheduling method and data node | |
| WO2018059239A1 (en) | Method and device for file storage | |
| US8001347B1 (en) | Coherently sharing any form of instant snapshots separately from base volumes | |
| CN107493309B (en) | File writing method and device in distributed system | |
| CN108304144B (en) | Data writing-in and reading method and system, and data reading-writing system | |
| CN104951475A (en) | Distributed file system and implementation method | |
| JP2017208113A (en) | Data storage method, data storage apparatus, and storage device | |
| CN107704208B (en) | Method, device and medium for repairing metadata | |
| CN107168645B (en) | Storage control method and system of distributed system | |
| KR20230103132A (en) | Method and apparatus for managing transaction | |
| CN115858673A (en) | Data synchronization method and device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |