CN105824724B - A kind of variance data scan method and device - Google Patents
A kind of variance data scan method and device Download PDFInfo
- Publication number
- CN105824724B CN105824724B CN201610188629.2A CN201610188629A CN105824724B CN 105824724 B CN105824724 B CN 105824724B CN 201610188629 A CN201610188629 A CN 201610188629A CN 105824724 B CN105824724 B CN 105824724B
- Authority
- CN
- China
- Prior art keywords
- difference
- granularity
- mapping
- difference granularity
- corresponding data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1456—Hardware arrangements for backup
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
- G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Abstract
The application provides a kind of variance data scan method and device, wherein this method comprises: when receiving the first mapping length of the first difference granularity of source LUN transmission, the second mapping length of the second difference granularity corresponding with the first difference granularity on the copy LUN is calculated；Action message corresponding with the first difference granularity is determined according to the second mapping length and the first mapping length；Action message corresponding with the first difference granularity is sent to the source LUN, to notify the source LUN to execute corresponding movement according to the action message.The application, by carrying out difference calculating on demand, avoids carrying out difference calculating to all differences granularity corresponding data region, reduces the resource consumption of storage, improve the overall performance in line service and duplication service when based on Message Digest 5 scanning.
Description
Technical field
This application involves technical field of network storage more particularly to a kind of variance data scan method and devices.
Background technique
Carrying out the remote copy based on automatic simplify configuration LUN (Logical Unit Number, logical unit number)
When, duplication for the first time carries out full dose duplication, subsequent synchronous to disaster backup center (copy LUN) by copy link from source LUN again
Data, at this point, only transmitting changed data between two doubling time points.Since between duplication twice, IO may
New space, recycling old space are mapped, causes the mapping of difference granularity on the LUN of source to happen change, therefore need in duplication
These difference granularities changed are scanned, and are synchronized to corresponding difference granularity on copy LUN.
Existing scanning processing method are as follows: traversal all differences granularity obtains and poor on reference source LUN according to preset algorithm
The summary info of different granularity corresponding data and difference granularity corresponding data on copy LUN, to determine whether two end datas are consistent, if
Unanimously, then continue to inquire next difference granularity, it is inconsistent, difference position is set.
However, in the prior art when judging the consistency of source LUN and copy LUN data, on the source LUN scanned
Each difference granularity will unify the calculating that the data that difference granularity is corresponded on copy LUN are carried out with summary info, in turn result in
Extra summary info calculates and compares, and not only wastes computing resource, also reduces treatment effeciency.
Summary of the invention
In view of this, the application provides a kind of variance data scan method and device, specifically, the application is by as follows
What technical solution was realized:
The application provides a kind of variance data scan method, is applied to copy logical unit number LUN, this method comprises:
When receiving the first mapping length of the first difference granularity of source LUN transmission, calculate on the copy LUN and institute
State the second mapping length of the corresponding second difference granularity of the first difference granularity；
It is determined according to the second mapping length and the first mapping length corresponding with the first difference granularity dynamic
Make information；
Action message corresponding with the first difference granularity is sent to the source LUN, with notify the source LUN according to
The action message executes corresponding movement.
The application also provides a kind of variance data scanning means, is applied to copy LUN, which includes:
Length computation unit calculates when mapping length for receiving the first of the first difference granularity of source LUN transmission
Second mapping length of the second difference granularity corresponding with the first difference granularity on the copy LUN；
First determination unit, for being determined and described first according to the second mapping length and the first mapping length
The corresponding action message of difference granularity；
Information transmitting unit, for action message corresponding with the first difference granularity to be sent to the source LUN, with
The source LUN is notified to execute corresponding movement according to the action message.
The application provides a kind of variance data scan method and device for source LUN and copy it can be seen from above description
The diversity judgement of difference granularity corresponding data between LUN give copy LUN processing, and then during balanced scan source LUN with
The workload of copy LUN.Also, when based on Message Digest 5 scanning, by carrying out difference calculating on demand, avoid to all
Difference granularity corresponding data region carries out difference calculating, reduces the resource consumption of storage, improves in line service and duplication
The overall performance of business.
Detailed description of the invention
Fig. 1 is that network environment applied by a kind of variance data scan method shown in one exemplary embodiment of the application is shown
It is intended to；
Fig. 2 is a kind of variance data scan method flow chart shown in one exemplary embodiment of the application；
Fig. 3 is a kind of underlying hardware of variance data scanning means place equipment shown in one exemplary embodiment of the application
Structural schematic diagram；
Fig. 4 is a kind of structural schematic diagram of variance data scanning means shown in one exemplary embodiment of the application.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with the application.On the contrary, they be only with it is such as appended
The example of the consistent device and method of some aspects be described in detail in claims, the application.
It is only to be not intended to be limiting the application merely for for the purpose of describing particular embodiments in term used in this application.
It is also intended in the application and the "an" of singular used in the attached claims, " described " and "the" including majority
Form, unless the context clearly indicates other meaning.It is also understood that term "and/or" used herein refers to and wraps
It may be combined containing one or more associated any or all of project listed.
It will be appreciated that though various information, but this may be described using term first, second, third, etc. in the application
A little information should not necessarily be limited by these terms.These terms are only used to for same type of information being distinguished from each other out.For example, not departing from
In the case where the application range, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as
One information.Depending on context, word as used in this " if " can be construed to " ... when " or " when ...
When " or " in response to determination ".
It is network environment schematic diagram applied by the application variance data scan method referring to Fig. 1.Including source LUN and
Copy LUN, source LUN are the source resources in a replication relation, and copy LUN is then the purpose resource in a replication relation.
Referring to fig. 2, it is one embodiment flow chart of the application variance data scan method, is applied to copy LUN, the reality
Example is applied variance data scanning process is described.
Step 201, when receiving the first mapping length of the first difference granularity of source LUN transmission, the copy is calculated
Second mapping length of upper the second difference granularity corresponding with the first difference granularity of LUN；
When based on simplifying LUN progress remote copy, since between duplication twice, upper layer application can be issued continuously largely
IO, these IO may be the operations such as reading and writing, unmap (simplifying the order that physical space is specified on LUN for recycling).Wherein, it writes
Operation and unmap can change the mapping situation of data area.Therefore before copy, source LUN needs the number for changing these
It is come out according to sector scanning, and is synchronized to corresponding difference granularity on copy LUN.Since the work of comparison in difference is generally placed upon source
On LUN, lead to source LUN heavy load, and copy LUN is more idle, so that the duplicating efficiency of source LUN is also reduced by.
In this example embodiment, source LUN can successively be obtained current with each difference granularity in scan round difference bitmap
The size of the difference granularity of scanning and the empty total size of the difference granularity, and according to the size of the difference granularity and the difference
The empty total size of different granularity calculates the mapping length of the difference granularity, can also determine the difference according to the mapping length
The mapping status of granularity corresponding data.Wherein, there may be two kinds of mapping status for difference granularity corresponding data: not mapping shape all
State, there are mapping status, and there is mapping includes part mapping state, whole mapping status again.
The size of the difference granularity is pre-set.In the case where current data volume is skyrocketed through, LUN capacity is usual
It is very big, it, will by the occupied space of difference bitmap of difference granularmetric composition if difference granularity corresponding with LUN setting is smaller
Become larger.Moreover, it safeguards that the cost of difference bitmap also will be increasing, needs to consider resource shared by difference bitmap, difference
The renewal frequency of bitmap, the access speed of difference bitmap, to copy source in factors such as the influences of line service.Therefore, at present
In the general realization of duplication, difference granularity is all relatively thicker, can generally be preset as being greater than 64KB.
The calculating of the cavity total size is then to read the cavity statistics letter that a difference granularity is returned by read operation first
Breath, it may be assumed that the empty number and each empty size of a difference granularity；Later according to the empty number of the difference granularity and respectively
Empty size calculates the empty total size of the difference granularity.
And the mapping length of the difference granularity is then that difference granule size is subtracted to empty total size in the granularity to obtain
Difference, if the mapping status of difference granularity corresponding data is whole non-mapping status, mapping length is 0.
In order to mitigate the work load of source LUN, in source, LUN (it is poor to call first in the following text calculating the difference granularity currently obtained
Different granularity) mapping length (calling the first mapping length in the following text) after, scan request can be initiated from source LUN to copy LUN, and should
First mapping length carrying is sent to copy LUN in the scan request, and the first difference granularity pair is determined by copy LUN
The data answered and the corresponding data of difference granularity (calling the second difference granularity in the following text) that space is corresponded on copy LUN are with the presence or absence of poor
It is different.
Specifically, when receiving the first mapping length of the first difference granularity of source LUN transmission in copy LUN, copy LUN
Determine the mapping status of the first difference granularity corresponding data according to the first mapping length, and calculate copy LUN on and
First difference granularity corresponds to the mapping length (calling the second mapping length in the following text) of the second difference granularity in space.Wherein, this is second poor
When the calculation method of second mapping length of different granularity can be with the first mapping length of reference source LUN the first difference granularity of calculating
Calculation method, details are not described herein.
In this example embodiment, it can be determined and the difference granularity according to the mapping length of calculated difference granularity
The mapping status of corresponding data, correspondingly, after calculating the second mapping length of the second difference granularity, copy LUN can root
The mapping status of the second difference granularity corresponding data is determined according to the second mapping length of calculated second difference granularity.
Step 202, it is determined and the first difference granularity according to the second mapping length and the first mapping length
Corresponding action message；
In the second mapping length for calculating the second difference granularity, and determine reflecting for the second difference granularity corresponding data
After penetrating state, the first mapping length of the first difference granularity for further sending calculated second mapping length and source LUN
It is compared, and corresponding action message is arranged according to comparison result.It can specifically include following several:
If 1, the first mapping length and the second mapping length are identical, and the first difference granularity corresponds to number
Accordingly and the mapping status of the second difference granularity corresponding data is that mapping status, calculating the second difference granularity have corresponded to number
According to the first summary info；The action message include first summary info and notify the source LUN calculate with it is described
The movement of second summary info of the first difference granularity corresponding data.
Specifically, when the first mapping length and the second mapping length are identical, and the first difference granularity and second poor
The mapping status of different granularity be mapping status when, it may be assumed that the mapping of source LUN and the corresponding difference granularity at this both ends copy LUN
Equal length and non-zero, during illustrating duplication twice, the first difference granularity corresponding data at both ends and the second difference granularity are corresponding
Data may not change, although alternatively, change occurred for the first difference granularity corresponding data and the second difference granularity corresponding data
Change, but only changed the occurrence or distribution situation for having mapped data, and maps length and by chance do not become.
In this case, then it needs to calculate the summary info with the second difference granularity corresponding data by preset algorithm
(calling the first summary info in the following text), which can be Message Digest 5, that is, be calculated and the by Message Digest 5
The MD5 value of two difference granularity corresponding datas.And by with the MD5 value of the second difference granularity corresponding data and notify the source LUN
The movement with the MD5 value of the first difference granularity corresponding data is calculated as action message.
If 2, determining the first difference granularity and described the according to the first mapping length and the second mapping length
The mapping status of two difference granularity corresponding datas is whole non-mapping status, determining and the first difference granularity corresponding data
And with the second difference granularity corresponding data indifference；The action message includes the result of data indifference.
Specifically, when determine mapping status of the first difference granularity with the second difference granularity corresponding data be all do not reflect
When penetrating state (the first mapping length is 0 with the second mapping length), illustrate that the difference granularity at both ends is cavity, it is poor with first
Different granularity space corresponding with the second difference is not written into data, it is determined that the first difference granularity corresponding data and the second difference
Granularity corresponding data indifference.And using the result of data indifference as action message.
3, when the first mapping length and not identical the second mapping length, determining and the first difference granularity
It corresponding data and is had differences with the second difference granularity corresponding data, the action message includes will be with the first difference granularity pair
The difference position answered is labeled as having differences.
Specifically, when determine the first mapping length with second mapping length it is not identical when, illustrate twice replicate during and
First difference granularity and the corresponding data of the second difference change, it is determined that data corresponding with the first difference granularity and with
The corresponding data of second difference granularity are variant, without going to calculate again, comparing the first difference granularity corresponding data and second
The MD5 value of difference granularity corresponding data.And difference position corresponding with the first difference granularity is labeled as the movement having differences and is made
For action message.
Step 203, action message corresponding with the first difference granularity is sent to the source LUN, described in notice
Source LUN executes corresponding movement according to the action message.
Copy LUN is comparing the first mapping length and the second mapping length and the first difference granularity and second
After the mapping status of difference granularity corresponding data obtains above-mentioned various motion information, corresponding action message can be carried and swept
It retouches in response and is sent to source LUN.Specifically:
1, when action message includes the first summary info and the source LUN is notified to calculate and the first difference granularity pair
When answering the second summary info of data, instruction source LUN calculates MD5 value (the second abstract letter of the first difference granularity corresponding data
Breath), and compared the MD5 value of the first difference granularity corresponding data and the MD5 value of the second difference granularity corresponding data by source LUN
Compared with to determine that the first difference granularity corresponding data and the second difference granularity corresponding data whether there is difference.
2, when action message includes data indifference, the action message carrying of data indifference is being sent to source LUN's
It scans in response message, to indicate that source LUN continues to scan on next difference granularity.
3, when action message include will difference position corresponding with the first difference granularity labeled as have differences when, will be with first
The corresponding difference position of difference granularity is labeled as the action message having differences and carries in the scanning response message for being sent to source LUN,
To indicate that the difference position of the first difference granularity labeled as variant, and is continued to scan on next difference granularity by source LUN.
Later, source LUN is after receiving the scanning response of copy LUN return, it can according to what is carried in scanning response
Action message executes corresponding processing, such as:
When the action message of the received scanning response of source LUN for the MD5 value with the second difference granularity corresponding data and is led to
When knowing that the source LUN calculates the movement with the MD5 value of the first difference granularity corresponding data, source LUN determines the first difference granularity pair
Answer data and the second difference granularity corresponding data whether consistent, detailed process are as follows: to judge the MD5 of the first difference granularity corresponding data
Whether value is consistent with the MD5 value of the second difference granularity corresponding data, if unanimously, determining the first difference granularity corresponding data and second
Difference granularity corresponding data indifference；Otherwise the first difference granularity corresponding data and the second difference granularity corresponding data exist poor
It is different.
When source, LUN determines the first difference granularity corresponding data and the second difference granularity corresponding data indifference, due to
The difference position of each difference granularity of difference bitmap is marked as indifference (such as being marked as 0) after last time replicates,
Therefore it when determining two end data indifferences, is marked without the difference position to the first difference granularity, source LUN is continued to scan on down
One difference granularity；When the first difference granularity corresponding data and the second difference granularity corresponding data have differences, source LUN
The difference position of the first difference granularity is labeled as variant (such as labeled as 1), and continues to scan on next difference granularity.
When the action message of the received scanning response of source LUN is data indifference, then without to the first difference granularity
Difference position is marked, and continues to scan on next difference granularity.
When the action message of the received scanning response of source LUN is to be labeled as depositing by difference position corresponding with the first difference granularity
In difference, difference position corresponding with the first difference granularity is labeled as having differences by source LUN, and continues to scan on next difference
Granularity.
It, then can be according to the presence scanned after source LUN is scanned one by one by all differences granularity of difference bitmap
The data of difference copy to copy LUN, and after the data that difference will be present copy to copy LUN, by corresponding difference granularity
Difference position be labeled as indifference.
So, this example embodiment then more intelligentized duplication completed to the variance data of entire source LUN.
The characteristic that automatic simplify configuration is utilized in this example embodiment, by the difference granularity between source LUN and copy LUN
The diversity judgement of corresponding data give copy LUN processing, and then during balanced scan source LUN and copy LUN workload.And
And when based on Message Digest 5 scanning, this example embodiment carries out difference calculating on demand, avoids to all differences granularity
Corresponding data region carries out difference calculating, reduces unnecessary expense, reduces the resource consumption of storage, improve in line service
And the overall performance of duplication service.
Corresponding with the embodiment of aforementioned differences data scanning method, present invention also provides variance data scanning means
Embodiment.
The embodiment of the application variance data scanning means can be applied on memory node.Installation practice can pass through
Software realization can also be realized by way of hardware or software and hardware combining.Taking software implementation as an example, it anticipates as a logic
Device in justice is that corresponding computer program instructions are formed in the processor run memory by equipment where it.From
For hardware view, as shown in figure 3, for a kind of hardware structure diagram of the application variance data scanning means place equipment, in addition to
Except processor shown in Fig. 3, network interface and memory, the equipment in embodiment where device is generally according to the equipment
Actual functional capability, can also include other hardware, this is repeated no more.
Referring to FIG. 4, for the structural schematic diagram of the variance data scanning means in the application one embodiment.The difference number
It is applied to copy LUN, including length computation unit 401, the first determination unit 402 and information transmitting unit according to scanning means
403, in which:
Length computation unit 401, when mapping length for receiving the first of the first difference granularity of source LUN transmission, meter
Calculate the second mapping length of the second difference granularity corresponding with the first difference granularity on the copy LUN；
First determination unit 402, for according to it is described second mapping length and first mapping length determine with it is described
The corresponding action message of first difference granularity；
Information transmitting unit 403, for action message corresponding with the first difference granularity to be sent to the source
LUN, to notify the source LUN to execute corresponding movement according to the action message.
Further, described device further includes the second determination unit 404, for being determined according to the first mapping length
The mapping status of the first difference granularity corresponding data；The second difference granularity is determined according to the second mapping length
The mapping status of corresponding data.
Further, if first determination unit 402 is reflected specifically for the first mapping length and described second
Penetrate that length is identical, and the mapping status of the first difference granularity corresponding data and the second difference granularity corresponding data is
Mapping status calculates the first summary info of the second difference granularity corresponding data；The action message includes described first
Summary info and the second summary info for notifying source the LUN calculating and the first difference granularity corresponding data；It will be described
First summary info and to notify that the source LUN is calculated dynamic with the second summary info of the first difference granularity corresponding data
It is sent to the source LUN as information, to notify the source LUN to calculate the second abstract with the first difference granularity corresponding data
Information, and the first difference granularity corresponding data and institute are judged according to first summary info and the second summary info
The second difference granularity corresponding data is stated with the presence or absence of difference.
Further, first determination unit 402 is specifically used for: if being reflected according to the first mapping length and second
It penetrates length and determines that the mapping status of the first difference granularity and the second difference granularity corresponding data is not map all
State determines the first difference granularity corresponding data and the second difference granularity corresponding data indifference；The action message
Including data indifference；The action message of data indifference is sent to the source LUN so that the source LUN according to data without
The next difference granularity of the action message scan round of difference.
Further, first determination unit 402 is specifically used for: if the first mapping length and second mapping
Length is not identical, determines with the first difference granularity corresponding data and has differences with the second difference granularity corresponding data；
The action message includes being labeled as having differences by difference position corresponding with the first difference granularity；It will be with the first difference granularity pair
The difference position answered is labeled as the action message that has differences and is sent to the source LUN, so that the source LUN is according to having differences
Difference position corresponding with the first difference granularity is labeled as having differences by action message.
Further, the length computation unit 401 is specifically used for obtaining the second difference granule size and described
The empty total size of second difference granularity；The second mapping length is the second difference granule size and second difference
The difference of the empty total size of granularity.
The function of each unit and the realization process of effect are specifically detailed in the above method and correspond to step in above-mentioned apparatus
Realization process, details are not described herein.
For device embodiment, since it corresponds essentially to embodiment of the method, so related place is referring to method reality
Apply the part explanation of example.The apparatus embodiments described above are merely exemplary, wherein described be used as separation unit
The unit of explanation may or may not be physically separated, and component shown as a unit can be or can also be with
It is not physical unit, it can it is in one place, or may be distributed over multiple network units.It can be according to actual
The purpose for needing to select some or all of the modules therein to realize application scheme.Those of ordinary skill in the art are not paying
Out in the case where creative work, it can understand and implement.
The foregoing is merely the preferred embodiments of the application, not to limit the application, all essences in the application
Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the application protection.
Claims (12)
1. a kind of variance data scan method is applied to copy logical unit number LUN, which is characterized in that further include source LUN, institute
The method of stating includes:
When receiving the first mapping length of the first difference granularity of source LUN transmission, calculate the copy LUN on and described the
Second mapping length of the corresponding second difference granularity of one difference granularity；
Movement letter corresponding with the first difference granularity is determined according to the second mapping length and the first mapping length
Breath；
Action message corresponding with the first difference granularity is sent to the source LUN, to notify the source LUN according to
Action message executes corresponding movement.
2. the method as described in claim 1, which is characterized in that the method also includes:
The mapping status of the first difference granularity corresponding data is determined according to the first mapping length；
The mapping status of the second difference granularity corresponding data is determined according to the second mapping length.
3. method according to claim 2, which is characterized in that true according to the second mapping length and the first mapping length
Action message corresponding with the first difference granularity is made to specifically include:
If it is described first mapping length and it is described second mapping length it is identical, and the first difference granularity corresponding data and
The mapping status of second difference granularity corresponding data is mapping status, calculates the of the second difference granularity corresponding data
One summary info；The action message includes first summary info and notifies that the source LUN is calculated and described first is poor
Second summary info of different granularity corresponding data；
By first summary info and notify the source LUN is calculated to pluck with the second of the first difference granularity corresponding data
The action message of information is wanted to be sent to the source LUN, to notify the source LUN to calculate and the first difference granularity corresponding data
The second summary info, and judge that the first difference granularity is corresponding according to first summary info and the second summary info
Data and the second difference granularity corresponding data whether there is difference.
4. method according to claim 2, which is characterized in that true according to the second mapping length and the first mapping length
Action message corresponding with the first difference granularity is made to specifically include:
If determining the first difference granularity and second difference according to the first mapping length and the second mapping length
The mapping status of granularity corresponding data is whole non-mapping status, determines the first difference granularity corresponding data and second
Difference granularity corresponding data indifference；The action message includes data indifference；
The action message of data indifference is sent to the source LUN, so that the source LUN believes according to the movement of data indifference
Cease the next difference granularity of scan round.
5. the method as described in claim 1, which is characterized in that true according to the second mapping length and the first mapping length
Action message corresponding with the first difference granularity is made to specifically include:
If the first mapping length and the second mapping length is not identical, determining and the first difference granularity corresponding data
And it is had differences with the second difference granularity corresponding data；The action message includes will difference corresponding with the first difference granularity
Position is labeled as having differences；
The action message that difference position corresponding with the first difference granularity is labeled as having differences is sent to the source LUN, so that
Difference position corresponding with the first difference granularity is labeled as having differences by the source LUN according to the action message having differences.
6. the method as described in claim 1, which is characterized in that described to calculate that the copy LUN is upper and the first difference grain
The the second mapping length for spending corresponding second difference granularity specifically includes:
Obtain the empty total size of the second difference granule size and the second difference granularity；
The second mapping length is the difference of the empty total size of the second difference granule size and the second difference granularity
Value.
7. a kind of variance data scanning means is applied to copy LUN, which is characterized in that further include source LUN, described device includes:
Length computation unit when mapping length for receiving the first of the first difference granularity of source LUN transmission, calculates described
Second mapping length of the second difference granularity corresponding with the first difference granularity on copy LUN；
First determination unit, for being determined and first difference according to the second mapping length and the first mapping length
The corresponding action message of granularity；
Information transmitting unit, for action message corresponding with the first difference granularity to be sent to the source LUN, with notice
The source LUN executes corresponding movement according to the action message.
8. device as claimed in claim 7, which is characterized in that described device further includes the second determination unit, is used for:
The mapping status of the first difference granularity corresponding data is determined according to the first mapping length；
The mapping status of the second difference granularity corresponding data is determined according to the second mapping length.
9. device as claimed in claim 8, which is characterized in that first determination unit is specifically used for:
If it is described first mapping length and it is described second mapping length it is identical, and the first difference granularity corresponding data and
The mapping status of second difference granularity corresponding data is mapping status, calculates the of the second difference granularity corresponding data
One summary info；The action message includes first summary info and notifies that the source LUN is calculated and described first is poor
Second summary info of different granularity corresponding data；
By first summary info and notify the source LUN is calculated to pluck with the second of the first difference granularity corresponding data
The action message of information is wanted to be sent to the source LUN, to notify the source LUN to calculate and the first difference granularity corresponding data
The second summary info, and judge that the first difference granularity is corresponding according to first summary info and the second summary info
Data and the second difference granularity corresponding data whether there is difference.
10. device as claimed in claim 8, which is characterized in that first determination unit is specifically used for:
If determining the first difference granularity and second difference according to the first mapping length and the second mapping length
The mapping status of granularity corresponding data is whole non-mapping status, determines the first difference granularity corresponding data and second
Difference granularity corresponding data indifference；The action message includes data indifference；
The action message of data indifference is sent to the source LUN, so that the source LUN believes according to the movement of data indifference
Cease the next difference granularity of scan round.
11. device as claimed in claim 7, which is characterized in that first determination unit is specifically used for:
If the first mapping length and the second mapping length is not identical, determining and the first difference granularity corresponding data
And it is had differences with the second difference granularity corresponding data；The action message includes will difference corresponding with the first difference granularity
Position is labeled as having differences；
The action message that difference position corresponding with the first difference granularity is labeled as having differences is sent to the source LUN, so that
Difference position corresponding with the first difference granularity is labeled as having differences by the source LUN according to the action message having differences.
12. device as claimed in claim 7, which is characterized in that the length computation unit is specifically used for:
Obtain the empty total size of the second difference granule size and the second difference granularity；
The second mapping length is the difference of the empty total size of the second difference granule size and the second difference granularity
Value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610188629.2A CN105824724B (en) | 2016-03-29 | 2016-03-29 | A kind of variance data scan method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610188629.2A CN105824724B (en) | 2016-03-29 | 2016-03-29 | A kind of variance data scan method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105824724A CN105824724A (en) | 2016-08-03 |
| CN105824724B true CN105824724B (en) | 2019-01-25 |
Family
ID=56525380
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610188629.2A Active CN105824724B (en) | 2016-03-29 | 2016-03-29 | A kind of variance data scan method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105824724B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113553005B (en) * | 2021-07-06 | 2023-12-22 | 杭州宏杉科技股份有限公司 | Data read-write method, device and equipment for simplifying LUN |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102096616A (en) * | 2011-02-15 | 2011-06-15 | 成都市华为赛门铁克科技有限公司 | Logical object data duplication method and related device |
| CN103885717A (en) * | 2012-12-19 | 2014-06-25 | 杭州宏杉科技有限公司 | Data replication method and data replication device |
| WO2014169738A1 (en) * | 2013-04-18 | 2014-10-23 | 中兴通讯股份有限公司 | Active and standby databases, consistency checking and recovering methods and apparatuses, and storage medium |
| CN104731792A (en) * | 2013-12-19 | 2015-06-24 | 中国银联股份有限公司 | Method and system for verifying database consistency and method and system for positioning data difference |
| CN105138426A (en) * | 2015-08-20 | 2015-12-09 | 浪潮(北京)电子信息产业有限公司 | Service-level data consistency protecting method and device based on snapshooting |
-
2016
- 2016-03-29 CN CN201610188629.2A patent/CN105824724B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102096616A (en) * | 2011-02-15 | 2011-06-15 | 成都市华为赛门铁克科技有限公司 | Logical object data duplication method and related device |
| CN103885717A (en) * | 2012-12-19 | 2014-06-25 | 杭州宏杉科技有限公司 | Data replication method and data replication device |
| WO2014169738A1 (en) * | 2013-04-18 | 2014-10-23 | 中兴通讯股份有限公司 | Active and standby databases, consistency checking and recovering methods and apparatuses, and storage medium |
| CN104731792A (en) * | 2013-12-19 | 2015-06-24 | 中国银联股份有限公司 | Method and system for verifying database consistency and method and system for positioning data difference |
| CN105138426A (en) * | 2015-08-20 | 2015-12-09 | 浪潮(北京)电子信息产业有限公司 | Service-level data consistency protecting method and device based on snapshooting |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105824724A (en) | 2016-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10594340B2 (en) | Disaster recovery with consolidated erasure coding in geographically distributed setups | |
| US20200117547A1 (en) | System state recovery in a distributed, cloud-based storage system | |
| CN106533723B (en) | Virtual resource scheduling method, device and system | |
| US8930364B1 (en) | Intelligent data integration | |
| US9612760B2 (en) | Modular block-allocator for data storage systems | |
| US8375200B2 (en) | Embedded device and file change notification method of the embedded device | |
| US10803086B2 (en) | Reducing data amplification when resynchronizing components of an object replicated across different sites | |
| US11953997B2 (en) | Systems and methods for cross-regional back up of distributed databases on a cloud service | |
| JP2021524104A (en) | Master / Standby Container System Switching | |
| CN111240806B (en) | Distributed container mirror image construction scheduling method | |
| WO2019062856A1 (en) | Data reconstruction method and apparatus, and data storage system | |
| CN110134338B (en) | Distributed storage system and data redundancy protection method and related equipment thereof | |
| CN110489225A (en) | A kind of service expansion method, device and equipment based on message queue | |
| CN105827678B (en) | Communication means and node under a kind of framework based on High Availabitity | |
| CN110413694A (en) | Metadata management method and relevant apparatus | |
| CN109669822A (en) | The creation method and computer readable storage medium of electronic device, spare memory pool | |
| CN107566470B (en) | Method and device for managing virtual machine in cloud data system | |
| CN109840051B (en) | Data storage method and device of storage system | |
| US10931750B1 (en) | Selection from dedicated source volume pool for accelerated creation of block data volumes | |
| CN105824724B (en) | A kind of variance data scan method and device | |
| US10956442B1 (en) | Dedicated source volume pool for accelerated creation of block data volumes from object data snapshots | |
| CN107340974B (en) | Virtual disk migration method and virtual disk migration device | |
| CN115981559A (en) | Distributed data storage method and device, electronic equipment and readable medium | |
| CN105843709B (en) | Variance data scan method and device | |
| US11971902B1 (en) | Data retrieval latency management system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Hangzhou City, Zhejiang Province, Binjiang District West Street 310053 Qianmo Road No. 482 building eleventh layer to the twelfth layer A Applicant after: Hangzhou Sequoia Polytron Technologies Inc Address before: Hangzhou City, Zhejiang Province, Binjiang District West Street 310053 Qianmo Road No. 482 building eleventh layer to the twelfth layer A Applicant before: Hangzhou MacroSAN Technologies Co., Ltd. |
|
| COR | Change of bibliographic data | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |