CN106484690A - A kind of verification method of Data Migration and device - Google Patents
A kind of verification method of Data Migration and device Download PDFInfo
- Publication number
- CN106484690A CN106484690A CN201510523796.3A CN201510523796A CN106484690A CN 106484690 A CN106484690 A CN 106484690A CN 201510523796 A CN201510523796 A CN 201510523796A CN 106484690 A CN106484690 A CN 106484690A
- Authority
- CN
- China
- Prior art keywords
- data
- value
- identifier
- migration
- sum
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application is related to electronic technology field, and particularly to a kind of verification method of Data Migration and device, wherein method includes, during data moves to B end by A end, entering row operation to every data line of migration, obtaining the corresponding identifier of every data line；Described identifier data line corresponding thereto is migrated together to B end；The sum of the corresponding identifier of All Datarows during computation migration, obtains the first value, and calculates the sum of the corresponding identifier of B end All Datarows, obtains second value；When the described first value and described second value are equal, described Data Migration is verified.The embodiment of the present application additionally provides the device of execution said method, and the data verification losing the problems such as row, row Data duplication for appearance in data migration process has high work efficiency.
Description
Technical field
The application is related to electronic technology field, particularly to a kind of verification method of Data Migration and device.
Background technology
Importing bulk data from file is that current data imports common business scenario to data base (DB), especially in the Internet
Application scenarios in, need to carry out the checking of correctness to the data importing, to guarantee data in data base after data imports
Integrity and correctness.Common practice is in the prior art, and data is retrieved from data base, then one by one by
Being checked with the data in file of field, often problems with verification, for mass data import scene with
Lower problem is particularly acute：
Assume file a total of N row, the data importing in data base is M row, reads data from file line by line, searching database,
Comparison data concordance line by line, if data base is point table point storehouse it is necessary to retrieve n times data base, degraded performance；
Retrieve batch of data (X bar) from data base, examine and whether there is hereof, need traversal file X time, due to being
Big file, the internal memory of system may not, thus leading to operating system frequently from internal memory and disk swapping data, performance is low
Under, and cannot detect whether a data hereof is repeatedly imported data base.
Content of the invention
In order to solve the problems, such as checking file data verification degraded performance to after database data importing in prior art, the application is real
Apply example and propose a kind of verification method of Data Migration and device, can be verified to importing data with high efficiency, thus
Reduce the impact to systematic function for the data verification after data imports.
A kind of verification method of Data Migration that the embodiment of the present application is provided, including,
During data moves to B end by A end, row operation is entered to every data line of migration, obtains every data line pair
The identifier answered；
Described identifier data line corresponding thereto is migrated together to B end；
During computation migration, the sum of the corresponding identifier of All Datarows, obtains the first value, and calculates B end All Datarows pair
The sum of the identifier answered, obtains second value；
When the described first value and described second value are equal, described Data Migration is verified.
According to an a kind of further aspect of verification method of Data Migration of the embodiment of the present application, the data line of migration is entered
Row operation, the identifier obtaining the row data specifically includes, and carries out Hash operation to the data line of migration, obtains the row data
Identifier.
According to a kind of another further aspect of the verification method of Data Migration of the embodiment of the present application, institute during computation migration
There is the sum of the corresponding identifier of row data, obtain the first value, and calculate the sum of the corresponding identifier of B end All Datarows, obtain
Specifically include among second value,
Calculate the sum of Data Migration corresponding identifier of All Datarows to during B end, obtain the first value, and calculate B end and own
The sum of the corresponding identifier of row data, obtains second value.
According to a kind of another further aspect of the verification method of Data Migration of the embodiment of the present application, institute during computation migration
There is the sum of the corresponding identifier of row data, obtain the first value, and calculate the sum of the corresponding identifier of B end All Datarows, obtain
Specifically include among second value,
In the corresponding identifier of All Datarows during computation migration, the sum of ad-hoc location character, obtains the first value, and calculates B
Described in the corresponding identifier of All Datarows of end, the sum of ad-hoc location character, obtains second value.
According to a kind of another further aspect of the verification method of Data Migration of the embodiment of the present application, institute during computation migration
There is the sum of the corresponding identifier of row data, obtain the first value, and calculate the sum of the corresponding identifier of B end All Datarows, obtain
Specifically include among second value,
Described identifier is converted to ASCII character and carries out summation operation.
The embodiment of the present application additionally provides a kind of Data Migration checking device, including,
Mark unit, during moving to B end when data by A end, enters row operation to every data line of migration, obtains
To the corresponding identifier of every data line；
Data migration unit, migrates to B end together for the data line corresponding thereto by described identifier；
Arithmetic element, for the sum of the corresponding identifier of All Datarows during computation migration, obtains the first value, and calculates B
The sum of the end corresponding identifier of All Datarows, obtains second value；
Comparing unit, for relatively more described first value and described second value, when the described first value and second value are equal, described number
It is verified according to migration.
Verify a further aspect of device according to a kind of Data Migration of the embodiment of the present application, described mark unit is right further
The data line of migration carries out Hash operation, obtains the row data identifier.
Verify another further aspect of device according to a kind of Data Migration of the embodiment of the present application, described arithmetic element is additionally operable to
Calculate the sum of Data Migration corresponding identifier of All Datarows to during B end, obtain the first value, and calculate all line numbers in B end
According to the sum of corresponding identifier, obtain second value.
Verify another further aspect of device according to a kind of Data Migration of the embodiment of the present application, described arithmetic element is additionally operable to
In the corresponding identifier of All Datarows during computation migration, the sum of ad-hoc location character, obtains the first value, and calculates B end institute
There is the sum of ad-hoc location character described in the corresponding identifier of row data, obtain second value.
Verify another further aspect of device according to a kind of Data Migration of the embodiment of the present application, described arithmetic element is further
Described identifier is converted to ASCII character and carries out summation operation.
The technical scheme being provided from above the embodiment of the present application, substitutes the checking of full line data by using identifier, reduces
Access times to data file or data base, carry out the efficiency of data verification, move for data after improve Data Migration
, there are good verification the verifying results the problems such as row, row Data duplication of losing occurring during shifting.
Certainly implement arbitrary product of the application or method must be not necessarily required to reach all the above advantage simultaneously.
Brief description
In order to be illustrated more clearly that the embodiment of the present application or technical scheme of the prior art, below will be to embodiment or prior art
In description the accompanying drawing of required use be briefly described it should be apparent that, drawings in the following description be only the application in remember
Some embodiments carrying, for those of ordinary skill in the art, without having to pay creative labor, acceptable
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 show a kind of verification method flow chart of Data Migration of the embodiment of the present application；
Fig. 2 show the structural representation that a kind of Data Migration of the embodiment of the present application verifies device；
Fig. 3 show the flow chart that the embodiment of the present application migrates into row verification method to data；
Fig. 4 a show the embodiment of the present application data move out end A schematic diagram data；
Fig. 4 b show the embodiment of the present application data move into end B storage format schematic diagram；
Fig. 4 c show the embodiment of the present application data move into end B data storage schematic diagram；
Fig. 5 show another kind of flow chart that data is migrated into row verification method of the embodiment of the present application.
Specific embodiment
The embodiment of the present application provides a kind of verification method of Data Migration and device.
In order that those skilled in the art more fully understand the technical scheme in the application, below in conjunction with the embodiment of the present application
Accompanying drawing, the technical scheme in the embodiment of the present application is clearly and completely described it is clear that described embodiment only
It is some embodiments of the present application, rather than whole embodiments.Based on the embodiment in the application, ordinary skill people
The every other embodiment that member is obtained under the premise of not making creative work, all should belong to the scope of the application protection.
It is illustrated in figure 1 a kind of verification method flow chart of Data Migration of the embodiment of the present application, logical in the embodiment shown in this figure
Cross the mode increasing identifier to a data (namely data line in file, potentially include the data of multiple row), checking
After importing data base, the whether consistent mode of identifier to be verifying the correctness of this data, thus, with the checking generation of a data
Replace the checking of a whole data, reduced the importing data of the checking pressure to system hardware, and verifying speed there has also been
The rising of geometry magnitude.
The method of this figure includes step 101, during data moves to B end by A end, every data line of migration is entered
Row operation, obtains the corresponding identifier of every data line.
Step 102, described identifier data line corresponding thereto is migrated together to B end.
Step 103, during computation migration, the sum of the corresponding identifier of All Datarows, obtains the first value, and calculates B end institute
There is the sum of the corresponding identifier of row data, obtain second value.
Step 104, when the described first value and described second value are equal, described Data Migration is verified.
According to an embodiment of the application, row operation is entered to the data line of migration, the identifier obtaining the row data specifically wraps
Include, Hash operation carried out to the data line of migration, obtains the identifier of the row data, described Hash operation for example can include,
MD5 computing, RSA operation etc.；This computing can also be that data line is converted to character string or numerical value, or by a line
Certain row or a few column data be converted to character string or numerical value, as the identifier of the row data.
According to an embodiment of the application, during computation migration, the sum of the corresponding identifier of All Datarows, obtains the first value,
And calculate the sum of the corresponding identifier of B end All Datarows, obtain specifically including among second value,
Calculate the sum of Data Migration corresponding identifier of All Datarows to during B end, obtain the first value, and calculate B end institute
There is the sum of the corresponding identifier of row data, obtain second value.By this step, it is possible to achieve from a file or data base
Data is split, and carries out Data Migration to multiple data bases or file, verifies the accuracy of each Data Migration.
According to an embodiment of the application, during computation migration, the sum of the corresponding identifier of All Datarows, obtains the first value,
And calculate the sum of the corresponding identifier of B end All Datarows, obtain specifically including among second value,
In the corresponding identifier of All Datarows during computation migration, the sum of ad-hoc location character, obtains the first value, and calculates B
Described in the corresponding identifier of All Datarows of end, the sum of ad-hoc location character, obtains second value.Wherein, ad-hoc location character can
Think identifier first 3, or latter 2, or from identifier interval select several characters, as long as ensureing migration
During the character position that selects in the character position and the B end identifier that select always, it is long so can to reduce identifier,
Or exceed the regulation of digit length due to recording the summation operation excessively causing, and the meter that computing brings to system can be reduced
Calculate pressure.
According to an embodiment of the application, during computation migration, the sum of the corresponding identifier of All Datarows, obtains the first value,
And calculate the sum of the corresponding identifier of B end All Datarows, obtain specifically including among second value,
Described identifier is converted to ASCII character and carries out summation operation.Wherein, ASCII character is a hand over word of the application
String and the embodiment of calculating character, are not construed as the restriction to technical scheme.
By the method for above-mentioned the embodiment of the present application, can by a digital independent summation operation of end B that data is moved into
To judge whether Data Migration is accurate, it is to avoid need in prior art repeatedly to read data and carry out data verification and lead to performance low
Lower problem, for appearance in data migration process lose row, row Data duplication the problems such as have good verification the verifying results.
It is illustrated in figure 2 the structural representation that a kind of Data Migration of the embodiment of the present application verifies device, the device of this embodiment is permissible
Logical block for realizing corresponding function constitutes or runs the high-performance computer of corresponding function software, moves in data
Carry out data verification during shifting or after Data Migration.
The device of this in figure includes identifying unit 201, during moving to B end when data by A end, every to migration
Data line enters row operation, obtains the corresponding identifier of every data line.
Data migration unit 202, migrates to B end together for the data line corresponding thereto by described identifier.
Arithmetic element 203, for the sum of the corresponding identifier of All Datarows during computation migration, obtains the first value, and counts
Calculate the sum of the corresponding identifier of B end All Datarows, obtain second value.
Comparing unit 204, for relatively more described first value and described second value, when the described first value and second value are equal, institute
State Data Migration to be verified.
According to an embodiment of the application, described mark unit 201 carries out Hash operation to the data line of migration further,
Obtain the row data identifier.
According to an embodiment of the application, described arithmetic element 203 is additionally operable to calculate Data Migration all row to during B end
The sum of the corresponding identifier of data, obtains the first value, and calculates the sum of the corresponding identifier of B end All Datarows, obtains second
Value.
According to an embodiment of the application, during described arithmetic element 203 is additionally operable to computation migration, All Datarows are corresponding
The sum of ad-hoc location character in identifier, obtains the first value, and calculates specific described in the corresponding identifier of B end All Datarows
The sum of position character, obtains second value.
According to an embodiment of the application, described identifier is converted to ASCII character and carries out by described arithmetic element 203 further
Summation operation.
By the device of above-mentioned the embodiment of the present application, can by a digital independent summation operation of end B that data is moved into
To judge whether Data Migration is accurate, it is to avoid need in prior art repeatedly to read data and carry out data verification and lead to performance low
Lower problem, for appearance in data migration process lose row, row Data duplication the problems such as have good verification the verifying results.
It is illustrated in figure 3 the flow chart that the embodiment of the present application migrates into row verification method to data, include data in the figure and move out
End A, data is moved into and is held B, and data is moved out and holds A to be file format in the present embodiment, and data is moved into and holds B to be data base, counts
According to moving out the end the first row data of A and the second row data as shown in fig. 4 a, for concise explanation, every line number in the present embodiment
Represent, the data of a line potentially includes more complicated character string in other embodiments according to all employing simply numeral.
This Fig. 3 includes step 301, data move out end A the first row Data Migration to data is moved into end B during, select
The data in the first row data is taken to constitute the representative character string of the row data.
Specifically, the first row data can be stitched together, form the combination of all row field character strings, form 12345678
Character string as the row data representative character string；Can also be the character string of specific fields, for example, select first row field word
Symbol " 1 ", as the representative character string of the row data, when selecting multiple field, can be the combination of selection field character string,
It is that all row field character strings compositions represent character string in this example.
Step 302, calculates the identifier that the first row data represents character string, adopts 16 hash algorithm meters of MD5 in this example
Calculate the identifier that data line represents character string.
Described identifier is stored in the internal memory of computer system, or is stored in a file, in this example, will be each
The identifier of row is stored in internal memory.
Specifically, the above-mentioned MD5 operation result representing character string 12345678 is " 83aa400af464c76d ".
Step 303, judges whether to have obtained the identifier of All Datarows, if also row data, return to step 301 continues
Continuous process next line data, otherwise enters step 304.
In circulation in this step, continue with the second row data, represent the selection mode of character string according to identical, will be whole
Conduct after row data is spliced represents character string, and obtaining the corresponding identifier of the second row data is " 39c68f5145dd2fcb ".
Step 304, increases, in the data base that data moves into end B, the field that string deposits identifier, for storing each line number
According to identifier.
Data moves into the database form of end B can as shown in Figure 4 b, and the field column name of increase is " identifier ".
Step 305, data is moved out end every data line of A and its corresponding identifier migrates to data the data of the end B that moves into
In storehouse, its corresponding accompanying drawing is as illustrated in fig. 4 c.
Step 306, calculates the sum of the corresponding identifier of All Datarows of migration in internal memory, obtains the first value.
Specifically, corresponding for the first row data identifier " 83aa400af464c76d " is converted to ASCII coding, then by the
The corresponding identifier of two row data " 39c68f5145dd2fcb " are converted to ASCII coding, calculate two ASCII codings
With obtain the first value.
Step 307, calculating data is moved into and is held the sum of the corresponding identifier of All Datarows in B data storehouse, obtains second value.
Specifically, " 83aa400af464c76d " of the identifier field of the first row data is converted to ASCII coding, then will
The identifier " 39c68f5145dd2fcb " of the second row data is converted to ASCII coding, calculates the sum of two ASCII codings
Obtain second value.
In other embodiments, self-defining coding rule or other coding rules can also be utilized, identifier is converted to number
Value, identical identifier should be converted to same numerical value by this coding rule certainly so that identical identifier be converted to first
Value is identical with second value.
Above step 306 and step 307 can in no particular order sequentially.
Step 308, compares the first value and whether second value is equal, if equal, enters step 309, otherwise enters step 31
0.
, mistake in step 309 in data migration process, data verification is passed through.
, mistake in step 310 in data migration process, data verification is not passed through.
In this step, if in data migration process, lose the second row data, may result in the first value and second value
Comparative result unequal that is to say, that bright, mistake occurs in data migration process, data verification is not passed through；
Or in data migration process, it is written with the first row data twice in the data base moving into end B to data, that is, deposits
Data write repetition situation, then calculated second value and the first value be also not desired to, illustrate in data migration process
Mistake occurs, data verification is not passed through；
Or, other any possible situations occur, cause the first value and second value unequal, all illustrate that Data Migration occurs wrong
By mistake, checking is not passed through.
The scheme of the embodiment of the present application, for the migration of mass data, for example up to ten million row data carry out Data Migration, Neng Gouming
Show and reduce the verification operations such as the reading to data base or source file, judgement, thus improving the efficiency of data verification.
It is illustrated in figure 5 another kind of flow chart that data is migrated into row verification method of the embodiment of the present application, the present embodiment and upper figure
3 illustrated embodiment differences are, data is moved out and holds A to be data base, in addition to data moves into end B (data base), also
Move into including data and hold C (file type), identifier field (as shown in Figure 4 b) is set in the data base that data moves into end B,
It is also provided with identifier field in data moves into end C, data is moved out and held the first row data and the second row data such as Fig. 4 a institute of A
Show, the third line data and fourth line data are not shown, data is moved out and holds A by the first row data and the second row Data Migration to data
Move into end B, the third line data and fourth line Data Migration to data is moved into and holds C, in this example for concise explanation, only retouch
State the process that the two row data going out to hold A before data are embedded into data built-in end B, in other embodiments, can be by first
Row data and the second row data are changed into 1000 row data or the data of more multirow, to the verification mode of more row Data Migrations are
Similar with the present embodiment, repeat no more.
This Fig. 5 includes step 501, data move out end A the first row Data Migration to data is moved into end B during, select
The data in the first row data is taken to constitute the representative character string of the row data.
Data move out end A the second row data is moved to data move into end B during, choose the second row data in data
Constitute the representative character string of the row data.
Step 502, calculates the identifier that the first row data represents character string.Except the MD in above-mentioned Fig. 3 embodiment can be adopted
Beyond 5 algorithms, row operation can also be entered using RSA scheduling algorithm.In this example directly by all column data in the first row data
It is stitched together, constitutes identifier " 12345678 ", lead to identifier long if all row are stitched together, can only choose
The character of particular column is spliced, and for example only the character of splicing first row and secondary series constitutes identifier " 12 ".In this example with
The character string " 12345678 " that all row are stitched together is as the identifier of the first row data.
In the same manner, be calculated move to data move into end B the second row data identifier " 87654321 ".
Described identifier is stored in the internal memory of computer system, or is stored in a file, in this example, will be each
The identifier of row is stored in internal memory.
Step 503, data is moved out and holds the first row data of A and its corresponding identifier, and data is moved out and held the second of A
Row data and its corresponding identifier migrate in the data base moving into end B to data.
Step 504, calculate move in internal memory data move into end B the corresponding identifier of All Datarows sum, obtain the first value.
In this example, by two row data move to data move into end B, only take the front two of the first row data identifier, with second
The front two of row data identifier carries out addition summation, this data move into end B All Datarows identifier and for " 12 "+
" 87 "=" 99 ".By this to identifier in ad-hoc location character sue for peace by way of, can reduce to multirow data
The full identity calculating pressure sued for peace of symbol.
Step 505, calculating data is moved into and is held the sum of the corresponding identifier of All Datarows in B data storehouse, obtains second value.
In the present embodiment, data moves into hold in B data storehouse two row data, consistent with above-mentioned summation method, takes the first line number
Sued for peace with the front two of the second row data identifier according to the front two of identifier, that is, " 12 "+" 87 ", obtain second value
“99”.
If in data migration process, miss the second row data, then now calculating data is moved into and held all line numbers in B data storehouse
According to corresponding identifier and be " 12 "+NULL (empty)=" 12 ".
As another embodiment, the method that the character in row data is carried out with summation operation can be carried out using following SQL statement
The calculating of this step：
sum(ascii(substr(md5_sign,1,1))+ascii(substr(md5_sign,2,1))+ascii(substr
(md5_sign,3,1)))as sign_total from table
Wherein, sum is summation operation function, and md5_sign is identifier, and substr (*, x, y) is to take spy in character string
Positioning puts the function of character, and x is which character taken from * character string, and y is to take several characters, and ascii is to turn character string
It is changed to the function of ASCII coding.
Step 506, whether with second value equal, if equal, enter step 507 if comparing the first value, otherwise enters step 50
8.
Step 507, Data Migration to data is moved into during holding B and mistake, and data verification is passed through.
Step 508, Data Migration to data is moved into during holding B and mistake, and data verification is not passed through.
By the method and apparatus in above-mentioned the embodiment of the present application, can be by a digital independent summation of end B that data is moved into
Whether computing it may determine that to go out Data Migration accurate, it is to avoid needs in prior art repeatedly to read data and carries out data verification and lead
Cause degraded performance problem, have good verification the verifying results the problems such as capable, row Data duplication is lost for appearances in data migration process.
For a technology improvement can clearly distinguish be improvement on hardware (for example, to diode, transistor, open
Close etc. circuit structure improvement) or software on improvement (for the improvement of method flow).However, with the development of technology,
The improvement of current a lot of method flows can be considered as directly improving of hardware circuit.Designer nearly all passes through will
Improved method flow is programmed into obtain corresponding hardware circuit in hardware circuit.Therefore, it cannot be said that a method flow
Improvement cannot be realized with hardware entities module.For example, PLD (Programmable Logic Device,
PLD) (such as field programmable gate array (Field Programmable Gate Array, FPGA)) is exactly such a collection
Become circuit, its logic function to be determined to device programming by user.Voluntarily program a digital display circuit " collection by designer
Become " on a piece of PLD, without chip maker please designing and make special IC chip 2.And,
Nowadays, replace and manually make IC chip, " logic compiler (logic compiler) " is also used in this programming mostly instead
Realizing, when it is write with program development, software compiler used is similar software, and the source code before will compiling is also
Write with specific programming language, this is referred to as hardware description language (Hardware Description Language, HDL),
And HDL is also not only a kind of, but there are many kinds, such as ABEL (Advanced Boolean Expression Language),
AHDL(Altera Hardware Description Language)、Confluence、CUPL(Cornell University
Programming Language)、HDCal、JHDL(Java Hardware Description Language)、Lava、Lola、
MyHDL, PALASM, RHDL (Ruby Hardware Description Language) etc., commonly use at present most
It is VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog2.
Those skilled in the art also should understand it is only necessary to slightly make programming in logic and compile method flow with above-mentioned several hardware description languages
Journey is in integrated circuit it is possible to be readily available the hardware circuit realizing this logical method flow process.
Controller can be implemented in any suitable manner, for example, controller can take such as microprocessor or processor and
Storage can by the computer-readable medium of the computer readable program code (such as software or firmware) of this (micro-) computing device,
Gate, switch, special IC (Application Specific Integrated Circuit, ASCII), FPGA
Controller and the form of embedded microcontroller, the example of controller includes but is not limited to following microcontroller：ARC 625D、Atmel
AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320, Memory Controller can also quilt
It is embodied as a part for the control logic of memorizer.
It is also known in the art that in addition to controller is realized in pure computer readable program code mode, completely permissible
Make controller by method and step is carried out programming in logic with gate, switch, special IC, FPGA control
The form of device processed and embedded microcontroller etc. is realizing identical function.Therefore this controller is considered a kind of Hardware Subdivision
Part, and the structure in hardware component can also be considered as to the device for realizing various functions including in it.Or even, may be used
The device being used for realizing various functions to be considered as not only being the software module of implementation method but also can be the knot in hardware component
Structure.
System, device, module or unit that above-described embodiment illustrates, specifically can be realized by computer chip or entity, or
To be realized by the product with certain function.
For convenience of description, it is divided into various units to be respectively described with function when describing apparatus above.Certainly, implementing the application
When the function of each unit can be realized in same or multiple softwares and/or hardware.
As seen through the above description of the embodiments, those skilled in the art can be understood that the application can be by soft
Part adds the mode of necessary general hardware platform to realize.Based on such understanding, the technical scheme of the application is substantially in other words
What prior art was contributed partly can be embodied in the form of software product, and this computer software product can be stored in
In storage medium, such as ROM/RAM, magnetic disc, CD etc., including some instructions with so that a computer equipment is (permissible
Be personal computer, server, or the network equipment etc.) execution each embodiment of the application or embodiment some part institutes
The method stated.
Each embodiment in this specification is all described by the way of going forward one by one, identical similar partly mutual between each embodiment
Referring to what each embodiment stressed is the difference with other embodiment.Especially for system embodiment
Speech, because it is substantially similar to embodiment of the method, so description is fairly simple, referring to the part of embodiment of the method in place of correlation
Illustrate.
The application can be used in numerous general or special purpose computing system environments or configuration.For example：Personal computer, server
Computer, handheld device or portable set, laptop device, multicomputer system, the system based on microprocessor, top set
Box, programmable consumer-elcetronics devices, network PC, minicomputer, mainframe computer, inclusion any of the above system or equipment
Distributed computing environment etc..
The application can be described in the general context of computer executable instructions, such as program module.
Usually, program module include executing particular task or realize the routine of particular abstract data type, program, object, assembly,
Data structure etc..The application can also be put into practice in a distributed computing environment, in these distributed computing environment, by passing through
Communication network and connected remote processing devices are executing task.In a distributed computing environment, program module may be located at bag
Include storage device in interior local and remote computer-readable storage medium.
Although the application is depicted by embodiment, it will be appreciated by the skilled addressee that the application have many deformation and a change and
Without departing from spirit herein it is desirable to appended claim includes these deformation and change without deviating from spirit herein.
Claims (10)
1. a kind of verification method of Data Migration is it is characterised in that include：
During data moves to B end by A end, row operation is entered to every data line of migration, obtains every data line pair
The identifier answered；
Described identifier data line corresponding thereto is migrated together to B end；
During computation migration, the sum of the corresponding identifier of All Datarows, obtains the first value, and calculates B end All Datarows pair
The sum of the identifier answered, obtains second value；
When the described first value and described second value are equal, described Data Migration is verified.
2. method according to claim 1, it is characterised in that entering row operation to the data line of migration, obtains this row
The identifier of data specifically includes, and carries out Hash operation to the data line of migration, obtains the identifier of the row data.
3. method according to claim 1 is it is characterised in that the corresponding mark of All Datarows during computation migration
The sum of symbol, obtains the first value, and calculates the sum of the corresponding identifier of B end All Datarows, obtains specifically including among second value,
Calculate the sum of Data Migration corresponding identifier of All Datarows to during B end, obtain the first value, and calculate B end institute
There is the sum of the corresponding identifier of row data, obtain second value.
4. method according to claim 1 is it is characterised in that the corresponding mark of All Datarows during computation migration
The sum of symbol, obtains the first value, and calculates the sum of the corresponding identifier of B end All Datarows, obtains specifically including among second value,
In the corresponding identifier of All Datarows during computation migration, the sum of ad-hoc location character, obtains the first value, and calculates B
Described in the corresponding identifier of All Datarows of end, the sum of ad-hoc location character, obtains second value.
5. method according to claim 1 is it is characterised in that the corresponding mark of All Datarows during computation migration
The sum of symbol, obtains the first value, and calculates the sum of the corresponding identifier of B end All Datarows, obtains specifically including among second value,
Described identifier is converted to ASCII character and carries out summation operation.
6. a kind of Data Migration verifies device it is characterised in that including,
Mark unit, during moving to B end when data by A end, enters row operation to every data line of migration, obtains
To the corresponding identifier of every data line；
Data migration unit, migrates to B end together for the data line corresponding thereto by described identifier；
Arithmetic element, for the sum of the corresponding identifier of All Datarows during computation migration, obtains the first value, and calculates B
The sum of the end corresponding identifier of All Datarows, obtains second value；
Comparing unit, for relatively more described first value and described second value, when the described first value and second value are equal, described number
It is verified according to migration.
7. device according to claim 6 is it is characterised in that described mark unit is further to the data line migrating
Carry out Hash operation, obtain the row data identifier.
8. device according to claim 6 is it is characterised in that described arithmetic element is additionally operable to calculate Data Migration to B
During end, the sum of the corresponding identifier of All Datarows, obtains the first value, and calculates the corresponding identifier of B end All Datarows
Sum, obtain second value.
9. device according to claim 6 is it is characterised in that described arithmetic element is additionally operable to institute during computation migration
There is the sum of ad-hoc location character in the corresponding identifier of row data, obtain the first value, and calculate the corresponding mark of B end All Datarows
Know the sum of ad-hoc location character described in symbol, obtain second value.
10. device according to claim 6 is it is characterised in that described identifier is changed by described arithmetic element further
Carry out summation operation for ASCII character.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510523796.3A CN106484690A (en) | 2015-08-24 | 2015-08-24 | A kind of verification method of Data Migration and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510523796.3A CN106484690A (en) | 2015-08-24 | 2015-08-24 | A kind of verification method of Data Migration and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106484690A true CN106484690A (en) | 2017-03-08 |
Family
ID=58233155
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510523796.3A Pending CN106484690A (en) | 2015-08-24 | 2015-08-24 | A kind of verification method of Data Migration and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106484690A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107247749A (en) * | 2017-05-25 | 2017-10-13 | 阿里巴巴集团控股有限公司 | A kind of database positioning determines method, consistency verification method and device |
| CN108665221A (en) * | 2017-03-28 | 2018-10-16 | 百度在线网络技术（北京）有限公司 | Processing method and processing device, computer equipment and the readable medium of performance data |
| CN109669989A (en) * | 2018-12-29 | 2019-04-23 | 江苏满运软件科技有限公司 | Data verification method, system, equipment and medium |
| CN111680004A (en) * | 2020-06-08 | 2020-09-18 | 中国银行股份有限公司 | Method and device for checking migration accuracy of unstructured image file |
| WO2021159639A1 (en) * | 2020-02-12 | 2021-08-19 | 平安科技（深圳）有限公司 | Checking method, apparatus, and device for data migration, and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1783887A (en) * | 2004-10-06 | 2006-06-07 | 夏普株式会社 | Method and apparatus for performing a secure transaction in a trusted network |
| CN101309269A (en) * | 2008-06-17 | 2008-11-19 | 北京锐安科技有限公司 | Method and system for silent hiding network transmission |
| US20100088271A1 (en) * | 2008-10-03 | 2010-04-08 | International Business Machines Corporation | Hsm two-way orphan reconciliation for extremely large file systems |
| CN102710758A (en) * | 2012-05-22 | 2012-10-03 | 苏州云博信息技术有限公司 | Method for continuously transferring breakpoint of data stream based on single chip system |
| CN103259616A (en) * | 2012-02-20 | 2013-08-21 | 联想(北京)有限公司 | Data transmission method |
| CN103595504A (en) * | 2013-11-04 | 2014-02-19 | 上海数字电视国家工程研究中心有限公司 | Encapsulation method and calibration method for data package |
-
2015
- 2015-08-24 CN CN201510523796.3A patent/CN106484690A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1783887A (en) * | 2004-10-06 | 2006-06-07 | 夏普株式会社 | Method and apparatus for performing a secure transaction in a trusted network |
| CN101309269A (en) * | 2008-06-17 | 2008-11-19 | 北京锐安科技有限公司 | Method and system for silent hiding network transmission |
| US20100088271A1 (en) * | 2008-10-03 | 2010-04-08 | International Business Machines Corporation | Hsm two-way orphan reconciliation for extremely large file systems |
| CN103259616A (en) * | 2012-02-20 | 2013-08-21 | 联想(北京)有限公司 | Data transmission method |
| CN102710758A (en) * | 2012-05-22 | 2012-10-03 | 苏州云博信息技术有限公司 | Method for continuously transferring breakpoint of data stream based on single chip system |
| CN103595504A (en) * | 2013-11-04 | 2014-02-19 | 上海数字电视国家工程研究中心有限公司 | Encapsulation method and calibration method for data package |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108665221A (en) * | 2017-03-28 | 2018-10-16 | 百度在线网络技术（北京）有限公司 | Processing method and processing device, computer equipment and the readable medium of performance data |
| CN107247749A (en) * | 2017-05-25 | 2017-10-13 | 阿里巴巴集团控股有限公司 | A kind of database positioning determines method, consistency verification method and device |
| CN107247749B (en) * | 2017-05-25 | 2020-08-25 | 创新先进技术有限公司 | Database state determination method, consistency verification method and device |
| US10789243B2 (en) | 2017-05-25 | 2020-09-29 | Alibaba Group Holding Limited | Database state determining method and device, and consistency verifying method and device |
| CN109669989A (en) * | 2018-12-29 | 2019-04-23 | 江苏满运软件科技有限公司 | Data verification method, system, equipment and medium |
| WO2021159639A1 (en) * | 2020-02-12 | 2021-08-19 | 平安科技（深圳）有限公司 | Checking method, apparatus, and device for data migration, and storage medium |
| CN111680004A (en) * | 2020-06-08 | 2020-09-18 | 中国银行股份有限公司 | Method and device for checking migration accuracy of unstructured image file |
| CN111680004B (en) * | 2020-06-08 | 2023-09-22 | 中国银行股份有限公司 | Method and device for checking migration accuracy of unstructured image file |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101840905B1 (en) | Counter operation in a state machine lattice | |
| CN105989089A (en) | Data comparison method and device | |
| CN107562467A (en) | Page rendering method, apparatus and equipment | |
| CN106484690A (en) | A kind of verification method of Data Migration and device | |
| KR101920956B1 (en) | Methods and systems for detection in a state machine | |
| KR101921373B1 (en) | Results generation for state machine engines | |
| CN107562775A (en) | A kind of data processing method and equipment based on block chain | |
| KR20140102274A (en) | Boolean logic in a state machine lattice | |
| CN107015882A (en) | A kind of block data method of calibration and device | |
| CN107274442A (en) | A kind of image-recognizing method and device | |
| CN103294600B (en) | Based on the automatic design for Measurability method of the automatic design for Measurability system of the EDIF net table level circuit of Perl | |
| US8522182B2 (en) | Generation of an end point report for a timing simulation of an integrated circuit | |
| US10031936B2 (en) | Database table data fabrication | |
| CN107562777A (en) | Data processing method and its equipment | |
| CN109299096A (en) | A kind of processing method of pipelined data, device and equipment | |
| CN108846069A (en) | A kind of document execution method and device based on markup language | |
| CN106095948A (en) | The querying method of form, device and equipment | |
| CN110457430A (en) | A kind of Traceability detection method of text, device and equipment | |
| CN110516915A (en) | Service node training, appraisal procedure, device and electronic equipment | |
| CN107368281A (en) | A kind of data processing method and device | |
| CN110443007A (en) | A kind of Traceability detection method of multi-medium data, device and equipment | |
| CN109409037A (en) | A kind of generation method, device and the equipment of data obfuscation rule | |
| CN108920241A (en) | A kind of display state adjustment method, device and equipment | |
| CN108334775A (en) | One kind is escaped from prison plug-in detecting method and device | |
| CN107943923A (en) | Construction method, telegraph code recognition methods and the device of telegraph code database |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170308 |
|
| RJ01 | Rejection of invention patent application after publication |